Apr 11 19:15:13 user devstack@n-api.service[72087]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Apr 11 19:15:13 user devstack@n-api.service[72087]: *** Starting uWSGI 2.0.20-debian (64bit) on [Tue Apr 11 19:15:13 2023] *** Apr 11 19:15:13 user devstack@n-api.service[72087]: compiled with version: 11.2.0 on 21 March 2022 11:00:44 Apr 11 19:15:13 user devstack@n-api.service[72087]: os: Linux-5.15.0-67-generic #74-Ubuntu SMP Wed Feb 22 14:14:39 UTC 2023 Apr 11 19:15:13 user devstack@n-api.service[72087]: nodename: user Apr 11 19:15:13 user devstack@n-api.service[72087]: machine: x86_64 Apr 11 19:15:13 user devstack@n-api.service[72087]: clock source: unix Apr 11 19:15:13 user devstack@n-api.service[72087]: pcre jit disabled Apr 11 19:15:13 user devstack@n-api.service[72087]: detected number of CPU cores: 12 Apr 11 19:15:13 user devstack@n-api.service[72087]: current working directory: / Apr 11 19:15:13 user devstack@n-api.service[72087]: detected binary path: /usr/bin/uwsgi-core Apr 11 19:15:13 user devstack@n-api.service[72087]: your processes number limit is 63637 Apr 11 19:15:13 user devstack@n-api.service[72087]: your memory page size is 4096 bytes Apr 11 19:15:13 user devstack@n-api.service[72087]: detected max file descriptor number: 2048 Apr 11 19:15:13 user devstack@n-api.service[72087]: lock engine: pthread robust mutexes Apr 11 19:15:13 user devstack@n-api.service[72087]: thunder lock: enabled Apr 11 19:15:13 user devstack@n-api.service[72087]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Apr 11 19:15:13 user devstack@n-api.service[72087]: Python version: 3.10.6 (main, Mar 10 2023, 10:55:28) [GCC 11.3.0] Apr 11 19:15:13 user devstack@n-api.service[72087]: Python main interpreter initialized at 0x558775389990 Apr 11 19:15:13 user devstack@n-api.service[72087]: python threads support enabled Apr 11 19:15:13 user devstack@n-api.service[72087]: your server socket listen backlog is limited to 100 connections Apr 11 19:15:13 user devstack@n-api.service[72087]: your mercy for graceful operations on workers is 90 seconds Apr 11 19:15:13 user devstack@n-api.service[72087]: mapped 537436 bytes (524 KB) for 3 cores Apr 11 19:15:13 user devstack@n-api.service[72087]: *** Operational MODE: preforking *** Apr 11 19:15:13 user devstack@n-api.service[72087]: *** uWSGI is running in multiple interpreter mode *** Apr 11 19:15:13 user devstack@n-api.service[72087]: spawned uWSGI master process (pid: 72087) Apr 11 19:15:13 user devstack@n-api.service[72087]: spawned uWSGI worker 1 (pid: 72088, cores: 1) Apr 11 19:15:13 user devstack@n-api.service[72087]: spawned uWSGI worker 2 (pid: 72089, cores: 1) Apr 11 19:15:13 user devstack@n-api.service[72087]: spawned uWSGI worker 3 (pid: 72090, cores: 1) Apr 11 19:15:13 user devstack@n-api.service[72087]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Apr 11 19:15:14 user devstack@n-api.service[72088]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Apr 11 19:15:14 user devstack@n-api.service[72089]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Apr 11 19:15:14 user devstack@n-api.service[72090]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2589}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2590}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2591}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2592}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2594}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 300 {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 5 {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = libvirt.LibvirtDriver {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] console_host = user {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = ext4 {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2589}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2590}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = False {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2591}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2592}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2594}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] host = user {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 300 {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 5 {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = libvirt.LibvirtDriver {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] console_host = user {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = ext4 {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = False {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] host = user {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 3 {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.0.0.210 {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.0.0.210 {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 3 {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = ps2mouse {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 3 {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.0.0.210 {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.0.0.210 {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 3 {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = ps2mouse {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = False {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 0 {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = False {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 0 {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2589}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2590}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2591}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2592}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2594}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 300 {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 5 {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = libvirt.LibvirtDriver {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] compute.vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 3 {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] console_host = user {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = ext4 {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = False {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] host = user {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] compute.vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 3 {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_wsrep_sync_wait = None {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_wsrep_sync_wait = None {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 3 {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.0.0.210 {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.0.0.210 {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 3 {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = ps2mouse {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_wsrep_sync_wait = None {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_wsrep_sync_wait = None {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = False {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 0 {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = custom {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] compute.vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 3 {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: WARNING oslo_config.cfg [-] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt". Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = ['Nehalem'] {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_high = performance {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_low = powersave {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management = False {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management_strategy = cpu_state {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = custom {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: WARNING oslo_config.cfg [-] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt". Apr 11 19:15:17 user devstack@n-api.service[72089]: WARNING oslo_config.cfg [-] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal ( Apr 11 19:15:17 user devstack@n-api.service[72089]: live_migration_uri is deprecated for removal in favor of two other options that Apr 11 19:15:17 user devstack@n-api.service[72089]: allow to change live migration scheme and target URI: ``live_migration_scheme`` Apr 11 19:15:17 user devstack@n-api.service[72089]: and ``live_migration_inbound_addr`` respectively. Apr 11 19:15:17 user devstack@n-api.service[72089]: ). Its value may be silently ignored in the future. Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_wsrep_sync_wait = None {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = ['Nehalem'] {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = qemu+ssh://stack@%s/system {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_high = performance {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_low = powersave {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management = False {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management_strategy = cpu_state {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_wsrep_sync_wait = None {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: WARNING oslo_config.cfg [-] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal ( Apr 11 19:15:17 user devstack@n-api.service[72088]: live_migration_uri is deprecated for removal in favor of two other options that Apr 11 19:15:17 user devstack@n-api.service[72088]: allow to change live migration scheme and target URI: ``live_migration_scheme`` Apr 11 19:15:17 user devstack@n-api.service[72088]: and ``live_migration_inbound_addr`` respectively. Apr 11 19:15:17 user devstack@n-api.service[72088]: ). Its value may be silently ignored in the future. Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = qemu+ssh://stack@%s/system {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 3 {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_in_placement = False {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 3 {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = custom {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: WARNING oslo_config.cfg [-] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt". Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = ['Nehalem'] {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_high = performance {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_low = powersave {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management = False {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management_strategy = cpu_state {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] spice.image_compression = None {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] spice.jpeg_compression = None {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] spice.playback_compression = None {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] spice.streaming_mode = None {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_in_placement = False {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] spice.zlib_compression = None {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: WARNING oslo_config.cfg [-] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal ( Apr 11 19:15:17 user devstack@n-api.service[72090]: live_migration_uri is deprecated for removal in favor of two other options that Apr 11 19:15:17 user devstack@n-api.service[72090]: allow to change live migration scheme and target URI: ``live_migration_scheme`` Apr 11 19:15:17 user devstack@n-api.service[72090]: and ``live_migration_inbound_addr`` respectively. Apr 11 19:15:17 user devstack@n-api.service[72090]: ). Its value may be silently ignored in the future. Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = qemu+ssh://stack@%s/system {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] spice.image_compression = None {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] spice.jpeg_compression = None {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] spice.playback_compression = None {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] spice.streaming_mode = None {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] spice.zlib_compression = None {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_at_startup = False {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_at_startup = False {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=72089) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2613}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=72088) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2613}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 3 {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_in_placement = False {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] spice.image_compression = None {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] spice.jpeg_compression = None {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] spice.playback_compression = None {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] spice.streaming_mode = None {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] spice.zlib_compression = None {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_at_startup = False {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72089]: INFO dbcounter [None req-1847cb15-3403-484f-be65-95b630870023 None None] Registered counter for database nova_api Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=72090) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2613}} Apr 11 19:15:17 user devstack@n-api.service[72088]: INFO dbcounter [None req-47a8ae2a-273f-4339-847a-cf0181b8e42d None None] Registered counter for database nova_api Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG oslo_db.sqlalchemy.engines [None req-1847cb15-3403-484f-be65-95b630870023 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72089) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG dbcounter [-] [72089] Writer thread running {{(pid=72089) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG oslo_db.sqlalchemy.engines [None req-47a8ae2a-273f-4339-847a-cf0181b8e42d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72088) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG dbcounter [-] [72088] Writer thread running {{(pid=72088) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG nova.context [None req-1847cb15-3403-484f-be65-95b630870023 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),a5b388bb-2881-480b-a232-b0dd723a272a(cell1) {{(pid=72089) load_cells /opt/stack/nova/nova/context.py:464}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-1847cb15-3403-484f-be65-95b630870023 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-1847cb15-3403-484f-be65-95b630870023 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-1847cb15-3403-484f-be65-95b630870023 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-1847cb15-3403-484f-be65-95b630870023 None None] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-1847cb15-3403-484f-be65-95b630870023 None None] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG nova.context [None req-47a8ae2a-273f-4339-847a-cf0181b8e42d None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),a5b388bb-2881-480b-a232-b0dd723a272a(cell1) {{(pid=72088) load_cells /opt/stack/nova/nova/context.py:464}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-1847cb15-3403-484f-be65-95b630870023 None None] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:15:17 user devstack@n-api.service[72089]: INFO dbcounter [None req-1847cb15-3403-484f-be65-95b630870023 None None] Registered counter for database nova_cell0 Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-47a8ae2a-273f-4339-847a-cf0181b8e42d None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-47a8ae2a-273f-4339-847a-cf0181b8e42d None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-47a8ae2a-273f-4339-847a-cf0181b8e42d None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:15:17 user devstack@n-api.service[72089]: INFO dbcounter [None req-1847cb15-3403-484f-be65-95b630870023 None None] Registered counter for database nova_cell1 Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-47a8ae2a-273f-4339-847a-cf0181b8e42d None None] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-47a8ae2a-273f-4339-847a-cf0181b8e42d None None] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-47a8ae2a-273f-4339-847a-cf0181b8e42d None None] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:15:17 user devstack@n-api.service[72088]: INFO dbcounter [None req-47a8ae2a-273f-4339-847a-cf0181b8e42d None None] Registered counter for database nova_cell0 Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG oslo_db.sqlalchemy.engines [None req-1847cb15-3403-484f-be65-95b630870023 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72089) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 11 19:15:17 user devstack@n-api.service[72088]: INFO dbcounter [None req-47a8ae2a-273f-4339-847a-cf0181b8e42d None None] Registered counter for database nova_cell1 Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG oslo_db.sqlalchemy.engines [None req-1847cb15-3403-484f-be65-95b630870023 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72089) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 11 19:15:17 user devstack@n-api.service[72089]: DEBUG dbcounter [-] [72089] Writer thread running {{(pid=72089) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 11 19:15:17 user devstack@n-api.service[72090]: INFO dbcounter [None req-81e0bbaa-4484-4f07-89e7-cd783a2dcb5a None None] Registered counter for database nova_api Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG oslo_db.sqlalchemy.engines [None req-47a8ae2a-273f-4339-847a-cf0181b8e42d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72088) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG dbcounter [-] [72088] Writer thread running {{(pid=72088) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 11 19:15:17 user devstack@n-api.service[72088]: DEBUG oslo_db.sqlalchemy.engines [None req-47a8ae2a-273f-4339-847a-cf0181b8e42d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72088) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG oslo_db.sqlalchemy.engines [None req-81e0bbaa-4484-4f07-89e7-cd783a2dcb5a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72090) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 11 19:15:17 user devstack@n-api.service[72090]: DEBUG dbcounter [-] [72090] Writer thread running {{(pid=72090) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 11 19:15:18 user devstack@n-api.service[72089]: DEBUG dbcounter [-] [72089] Writer thread running {{(pid=72089) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 11 19:15:18 user devstack@n-api.service[72090]: DEBUG nova.context [None req-81e0bbaa-4484-4f07-89e7-cd783a2dcb5a None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),a5b388bb-2881-480b-a232-b0dd723a272a(cell1) {{(pid=72090) load_cells /opt/stack/nova/nova/context.py:464}} Apr 11 19:15:18 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-81e0bbaa-4484-4f07-89e7-cd783a2dcb5a None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:15:18 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-81e0bbaa-4484-4f07-89e7-cd783a2dcb5a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:15:18 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-81e0bbaa-4484-4f07-89e7-cd783a2dcb5a None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:15:18 user devstack@n-api.service[72089]: INFO dbcounter [None req-1847cb15-3403-484f-be65-95b630870023 None None] Registered counter for database nova_cell0 Apr 11 19:15:18 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-81e0bbaa-4484-4f07-89e7-cd783a2dcb5a None None] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:15:18 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-81e0bbaa-4484-4f07-89e7-cd783a2dcb5a None None] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:15:18 user devstack@n-api.service[72088]: DEBUG dbcounter [-] [72088] Writer thread running {{(pid=72088) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 11 19:15:18 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-81e0bbaa-4484-4f07-89e7-cd783a2dcb5a None None] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:15:18 user devstack@n-api.service[72090]: INFO dbcounter [None req-81e0bbaa-4484-4f07-89e7-cd783a2dcb5a None None] Registered counter for database nova_cell0 Apr 11 19:15:18 user devstack@n-api.service[72088]: INFO dbcounter [None req-47a8ae2a-273f-4339-847a-cf0181b8e42d None None] Registered counter for database nova_cell0 Apr 11 19:15:18 user devstack@n-api.service[72090]: INFO dbcounter [None req-81e0bbaa-4484-4f07-89e7-cd783a2dcb5a None None] Registered counter for database nova_cell1 Apr 11 19:15:18 user devstack@n-api.service[72089]: DEBUG oslo_db.sqlalchemy.engines [None req-1847cb15-3403-484f-be65-95b630870023 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72089) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 11 19:15:18 user devstack@n-api.service[72089]: DEBUG dbcounter [-] [72089] Writer thread running {{(pid=72089) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 11 19:15:18 user devstack@n-api.service[72088]: DEBUG oslo_db.sqlalchemy.engines [None req-47a8ae2a-273f-4339-847a-cf0181b8e42d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72088) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 11 19:15:18 user devstack@n-api.service[72088]: DEBUG dbcounter [-] [72088] Writer thread running {{(pid=72088) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 11 19:15:18 user devstack@n-api.service[72090]: DEBUG oslo_db.sqlalchemy.engines [None req-81e0bbaa-4484-4f07-89e7-cd783a2dcb5a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72090) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 11 19:15:18 user devstack@n-api.service[72090]: DEBUG dbcounter [-] [72090] Writer thread running {{(pid=72090) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 11 19:15:18 user devstack@n-api.service[72090]: DEBUG oslo_db.sqlalchemy.engines [None req-81e0bbaa-4484-4f07-89e7-cd783a2dcb5a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72090) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 11 19:15:18 user devstack@n-api.service[72090]: DEBUG dbcounter [-] [72090] Writer thread running {{(pid=72090) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 11 19:15:18 user devstack@n-api.service[72090]: INFO dbcounter [None req-81e0bbaa-4484-4f07-89e7-cd783a2dcb5a None None] Registered counter for database nova_cell0 Apr 11 19:15:18 user devstack@n-api.service[72090]: DEBUG oslo_db.sqlalchemy.engines [None req-81e0bbaa-4484-4f07-89e7-cd783a2dcb5a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72090) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 11 19:15:18 user devstack@n-api.service[72090]: DEBUG dbcounter [-] [72090] Writer thread running {{(pid=72090) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 11 19:15:18 user devstack@n-api.service[72089]: WARNING keystonemiddleware.auth_token [None req-1847cb15-3403-484f-be65-95b630870023 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 11 19:15:18 user devstack@n-api.service[72089]: WARNING keystonemiddleware.auth_token [None req-1847cb15-3403-484f-be65-95b630870023 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 11 19:15:18 user devstack@n-api.service[72088]: WARNING keystonemiddleware.auth_token [None req-47a8ae2a-273f-4339-847a-cf0181b8e42d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 11 19:15:18 user devstack@n-api.service[72088]: WARNING keystonemiddleware.auth_token [None req-47a8ae2a-273f-4339-847a-cf0181b8e42d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 11 19:15:18 user devstack@n-api.service[72089]: WARNING keystonemiddleware.auth_token [None req-1847cb15-3403-484f-be65-95b630870023 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 11 19:15:18 user devstack@n-api.service[72089]: WARNING keystonemiddleware.auth_token [None req-1847cb15-3403-484f-be65-95b630870023 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 11 19:15:18 user devstack@n-api.service[72089]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x558775389990 pid: 72089 (default app) Apr 11 19:15:18 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [None req-1847cb15-3403-484f-be65-95b630870023 None None] Calling method '>' {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:15:18 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [None req-1847cb15-3403-484f-be65-95b630870023 None None] 10.0.0.210 "GET /compute/v2.1/" status: 200 len: 387 microversion: 2.1 time: 0.001501 Apr 11 19:15:18 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 1/1] 10.0.0.210 () {50 vars in 783 bytes} [Tue Apr 11 19:15:18 2023] GET /compute/v2.1/ => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:15:18 user devstack@n-api.service[72090]: WARNING keystonemiddleware.auth_token [None req-81e0bbaa-4484-4f07-89e7-cd783a2dcb5a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 11 19:15:18 user devstack@n-api.service[72090]: WARNING keystonemiddleware.auth_token [None req-81e0bbaa-4484-4f07-89e7-cd783a2dcb5a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 11 19:15:18 user devstack@n-api.service[72088]: WARNING keystonemiddleware.auth_token [None req-47a8ae2a-273f-4339-847a-cf0181b8e42d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 11 19:15:18 user devstack@n-api.service[72088]: WARNING keystonemiddleware.auth_token [None req-47a8ae2a-273f-4339-847a-cf0181b8e42d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 11 19:15:18 user devstack@n-api.service[72088]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x558775389990 pid: 72088 (default app) Apr 11 19:15:18 user devstack@n-api.service[72090]: WARNING keystonemiddleware.auth_token [None req-81e0bbaa-4484-4f07-89e7-cd783a2dcb5a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 11 19:15:18 user devstack@n-api.service[72090]: WARNING keystonemiddleware.auth_token [None req-81e0bbaa-4484-4f07-89e7-cd783a2dcb5a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 11 19:15:18 user devstack@n-api.service[72090]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x558775389990 pid: 72090 (default app) Apr 11 19:17:27 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [None req-1847cb15-3403-484f-be65-95b630870023 None None] Calling method '>' {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:17:27 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [None req-1847cb15-3403-484f-be65-95b630870023 None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001437 Apr 11 19:17:27 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 2/2] 10.0.0.210 () {54 vars in 924 bytes} [Tue Apr 11 19:17:27 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:17:27 user devstack@n-api.service[72088]: DEBUG dbcounter [-] [72088] Writing DB stats nova_api:SELECT=3 {{(pid=72088) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:17:27 user devstack@n-api.service[72088]: DEBUG dbcounter [-] [72088] Writing DB stats nova_cell0:SELECT=3 {{(pid=72088) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:17:27 user devstack@n-api.service[72088]: DEBUG dbcounter [-] [72088] Writing DB stats nova_cell1:SELECT=3 {{(pid=72088) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:17:27 user devstack@n-api.service[72088]: DEBUG dbcounter [-] [72088] Writing DB stats nova_cell0:SELECT=3 {{(pid=72088) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:17:27 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [None req-77cc1703-f6c9-4d28-8589-e922037c30b2 admin admin] Calling method '>' {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:17:27 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [None req-77cc1703-f6c9-4d28-8589-e922037c30b2 admin admin] 10.0.0.210 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.363010 Apr 11 19:17:27 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 1/3] 10.0.0.210 () {60 vars in 1285 bytes} [Tue Apr 11 19:17:27 2023] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:17:29 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [None req-81e0bbaa-4484-4f07-89e7-cd783a2dcb5a None None] Calling method '>' {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:17:29 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [None req-81e0bbaa-4484-4f07-89e7-cd783a2dcb5a None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.003414 Apr 11 19:17:29 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 1/4] 10.0.0.210 () {54 vars in 924 bytes} [Tue Apr 11 19:17:29 2023] GET /compute/v2.1 => generated 387 bytes in 6 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:17:29 user devstack@n-api.service[72089]: DEBUG dbcounter [-] [72089] Writing DB stats nova_api:SELECT=3 {{(pid=72089) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:17:29 user devstack@n-api.service[72089]: DEBUG dbcounter [-] [72089] Writing DB stats nova_cell1:SELECT=3 {{(pid=72089) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:17:29 user devstack@n-api.service[72089]: DEBUG dbcounter [-] [72089] Writing DB stats nova_cell0:SELECT=3 {{(pid=72089) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:17:29 user devstack@n-api.service[72089]: DEBUG dbcounter [-] [72089] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=72089) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:17:29 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [None req-9c3005cb-5bff-400f-a6e9-12dced71c80c admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "c1", "swap": 0, "rxtx_factor": 1.0, "vcpus": 1, "ram": 256, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "name": "cirros256", "disk": 1}} {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:17:30 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [None req-9c3005cb-5bff-400f-a6e9-12dced71c80c admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.324873 Apr 11 19:17:30 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 3/5] 10.0.0.210 () {64 vars in 1276 bytes} [Tue Apr 11 19:17:29 2023] POST /compute/v2.1/flavors => generated 405 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:17:30 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [None req-44b077d0-cf8c-4907-8e2a-087819a06d21 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:17:30 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [None req-44b077d0-cf8c-4907-8e2a-087819a06d21 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.237785 Apr 11 19:17:30 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 2/6] 10.0.0.210 () {64 vars in 1329 bytes} [Tue Apr 11 19:17:30 2023] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:17:32 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [None req-81e0bbaa-4484-4f07-89e7-cd783a2dcb5a None None] Calling method '>' {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:17:32 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [None req-81e0bbaa-4484-4f07-89e7-cd783a2dcb5a None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001394 Apr 11 19:17:32 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 2/7] 10.0.0.210 () {54 vars in 924 bytes} [Tue Apr 11 19:17:32 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:17:32 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [None req-54da2c58-d0de-4319-881f-01f9823a36ff admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "name": "ds512M", "os-flavor-access:is_public": true, "swap": 0, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d1", "vcpus": 1, "disk": 5}} {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:17:32 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [None req-54da2c58-d0de-4319-881f-01f9823a36ff admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.064749 Apr 11 19:17:32 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 4/8] 10.0.0.210 () {64 vars in 1276 bytes} [Tue Apr 11 19:17:32 2023] POST /compute/v2.1/flavors => generated 402 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:17:32 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [None req-dd1b3679-7fa7-4d1b-8a50-df69346df054 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:17:32 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [None req-dd1b3679-7fa7-4d1b-8a50-df69346df054 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030301 Apr 11 19:17:32 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 3/9] 10.0.0.210 () {64 vars in 1329 bytes} [Tue Apr 11 19:17:32 2023] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:17:34 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [None req-81e0bbaa-4484-4f07-89e7-cd783a2dcb5a None None] Calling method '>' {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:17:34 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [None req-81e0bbaa-4484-4f07-89e7-cd783a2dcb5a None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001278 Apr 11 19:17:34 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 3/10] 10.0.0.210 () {54 vars in 924 bytes} [Tue Apr 11 19:17:34 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:17:34 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [None req-06ea4d67-56f9-44cf-833f-7c0f61d2ecf8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "name": "ds1G", "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "disk": 10, "swap": 0, "vcpus": 1, "id": "d2", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:17:34 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [None req-06ea4d67-56f9-44cf-833f-7c0f61d2ecf8 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.064402 Apr 11 19:17:34 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 5/11] 10.0.0.210 () {64 vars in 1276 bytes} [Tue Apr 11 19:17:34 2023] POST /compute/v2.1/flavors => generated 402 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:17:34 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [None req-34dc832f-0fcd-4727-b792-d121ae87c713 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:17:34 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [None req-34dc832f-0fcd-4727-b792-d121ae87c713 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029114 Apr 11 19:17:34 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 4/12] 10.0.0.210 () {64 vars in 1329 bytes} [Tue Apr 11 19:17:34 2023] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:17:36 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [None req-81e0bbaa-4484-4f07-89e7-cd783a2dcb5a None None] Calling method '>' {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:17:36 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [None req-81e0bbaa-4484-4f07-89e7-cd783a2dcb5a None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001426 Apr 11 19:17:36 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 4/13] 10.0.0.210 () {54 vars in 924 bytes} [Tue Apr 11 19:17:36 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:17:36 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [None req-570a3ed4-accf-49cb-a65e-1d8e4937a09d admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d3", "ram": 2048, "vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "rxtx_factor": 1.0, "name": "ds2G", "os-flavor-access:is_public": true, "disk": 10}} {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:17:36 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [None req-570a3ed4-accf-49cb-a65e-1d8e4937a09d admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.058000 Apr 11 19:17:36 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 6/14] 10.0.0.210 () {64 vars in 1276 bytes} [Tue Apr 11 19:17:36 2023] POST /compute/v2.1/flavors => generated 402 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:17:36 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [None req-4c9b6be0-5f2e-4a06-88f2-377d853bb0d8 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:17:36 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [None req-4c9b6be0-5f2e-4a06-88f2-377d853bb0d8 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.037622 Apr 11 19:17:36 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 5/15] 10.0.0.210 () {64 vars in 1329 bytes} [Tue Apr 11 19:17:36 2023] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:17:38 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [None req-81e0bbaa-4484-4f07-89e7-cd783a2dcb5a None None] Calling method '>' {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:17:38 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [None req-81e0bbaa-4484-4f07-89e7-cd783a2dcb5a None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001761 Apr 11 19:17:38 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 5/16] 10.0.0.210 () {54 vars in 924 bytes} [Tue Apr 11 19:17:38 2023] GET /compute/v2.1 => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:17:38 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [None req-9f953171-ad41-413b-8689-3f8c8394e8fc admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds4G", "vcpus": 4, "id": "d4", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "disk": 20, "swap": 0, "rxtx_factor": 1.0, "ram": 4096}} {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:17:38 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [None req-9f953171-ad41-413b-8689-3f8c8394e8fc admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.058344 Apr 11 19:17:38 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 7/17] 10.0.0.210 () {64 vars in 1276 bytes} [Tue Apr 11 19:17:38 2023] POST /compute/v2.1/flavors => generated 402 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:17:38 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [None req-0b70568e-c696-4ea9-bb0b-f5ccb8aacbf0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:17:38 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [None req-0b70568e-c696-4ea9-bb0b-f5ccb8aacbf0 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.022916 Apr 11 19:17:38 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 6/18] 10.0.0.210 () {64 vars in 1329 bytes} [Tue Apr 11 19:17:38 2023] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:17:40 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [None req-81e0bbaa-4484-4f07-89e7-cd783a2dcb5a None None] Calling method '>' {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:17:40 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [None req-81e0bbaa-4484-4f07-89e7-cd783a2dcb5a None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001384 Apr 11 19:17:40 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 6/19] 10.0.0.210 () {54 vars in 924 bytes} [Tue Apr 11 19:17:40 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:17:40 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [None req-058e2bea-8792-4423-a472-af607c171877 admin admin] Calling method '>' {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:17:40 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [None req-058e2bea-8792-4423-a472-af607c171877 admin admin] 10.0.0.210 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2096 microversion: 2.61 time: 0.073131 Apr 11 19:17:40 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 8/20] 10.0.0.210 () {60 vars in 1285 bytes} [Tue Apr 11 19:17:40 2023] GET /compute/v2.1/flavors/detail?is_public=True => generated 2096 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 19:17:42 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [None req-0b70568e-c696-4ea9-bb0b-f5ccb8aacbf0 admin admin] Calling method '>' {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:17:42 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [None req-0b70568e-c696-4ea9-bb0b-f5ccb8aacbf0 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001989 Apr 11 19:17:42 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 7/21] 10.0.0.210 () {54 vars in 924 bytes} [Tue Apr 11 19:17:42 2023] GET /compute/v2.1 => generated 387 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:17:42 user devstack@n-api.service[72090]: DEBUG dbcounter [-] [72090] Writing DB stats nova_api:SELECT=3 {{(pid=72090) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:17:42 user devstack@n-api.service[72090]: DEBUG dbcounter [-] [72090] Writing DB stats nova_cell0:SELECT=3 {{(pid=72090) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:17:42 user devstack@n-api.service[72090]: DEBUG dbcounter [-] [72090] Writing DB stats nova_cell1:SELECT=3 {{(pid=72090) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:17:42 user devstack@n-api.service[72090]: DEBUG dbcounter [-] [72090] Writing DB stats nova_cell0:SELECT=3 {{(pid=72090) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:17:42 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [None req-5d969f8f-2278-4c84-b947-406182116f76 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "ram": 512, "id": "1", "disk": 1, "os-flavor-access:is_public": true, "swap": 0, "vcpus": 1, "name": "m1.tiny", "rxtx_factor": 1.0}} {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:17:42 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [None req-5d969f8f-2278-4c84-b947-406182116f76 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 400 microversion: 2.61 time: 0.311958 Apr 11 19:17:42 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 7/22] 10.0.0.210 () {64 vars in 1276 bytes} [Tue Apr 11 19:17:42 2023] POST /compute/v2.1/flavors => generated 400 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:17:42 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [None req-08a996a3-1ec1-49f6-80d8-a3ce7376a63c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:17:42 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [None req-08a996a3-1ec1-49f6-80d8-a3ce7376a63c admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.037010 Apr 11 19:17:42 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 9/23] 10.0.0.210 () {64 vars in 1326 bytes} [Tue Apr 11 19:17:42 2023] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:17:44 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [None req-0b70568e-c696-4ea9-bb0b-f5ccb8aacbf0 admin admin] Calling method '>' {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:17:44 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [None req-0b70568e-c696-4ea9-bb0b-f5ccb8aacbf0 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001361 Apr 11 19:17:44 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 8/24] 10.0.0.210 () {54 vars in 924 bytes} [Tue Apr 11 19:17:44 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:17:44 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [None req-5525bdbe-fc08-4d97-be07-b8d104d6350e admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "name": "m1.small", "ram": 2048, "os-flavor-access:is_public": true, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "2", "disk": 20, "swap": 0}} {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:17:44 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [None req-5525bdbe-fc08-4d97-be07-b8d104d6350e admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 403 microversion: 2.61 time: 0.055288 Apr 11 19:17:44 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 8/25] 10.0.0.210 () {64 vars in 1276 bytes} [Tue Apr 11 19:17:44 2023] POST /compute/v2.1/flavors => generated 403 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:17:44 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [None req-f29190f5-62e7-4920-95e8-2a7217b872bf admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:17:44 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [None req-f29190f5-62e7-4920-95e8-2a7217b872bf admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029711 Apr 11 19:17:44 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 10/26] 10.0.0.210 () {64 vars in 1326 bytes} [Tue Apr 11 19:17:44 2023] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:17:46 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [None req-0b70568e-c696-4ea9-bb0b-f5ccb8aacbf0 admin admin] Calling method '>' {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:17:46 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [None req-0b70568e-c696-4ea9-bb0b-f5ccb8aacbf0 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001537 Apr 11 19:17:46 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 9/27] 10.0.0.210 () {54 vars in 924 bytes} [Tue Apr 11 19:17:46 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:17:46 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [None req-f7312005-533c-4d71-961f-1e9b26770c29 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 2, "name": "m1.medium", "swap": 0, "ram": 4096, "id": "3", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "disk": 40}} {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:17:46 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [None req-f7312005-533c-4d71-961f-1e9b26770c29 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.056535 Apr 11 19:17:46 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 9/28] 10.0.0.210 () {64 vars in 1276 bytes} [Tue Apr 11 19:17:46 2023] POST /compute/v2.1/flavors => generated 404 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:17:46 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [None req-55990bef-4046-48a9-9bbd-e897a2040afa admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:17:46 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [None req-55990bef-4046-48a9-9bbd-e897a2040afa admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.024656 Apr 11 19:17:46 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 11/29] 10.0.0.210 () {64 vars in 1326 bytes} [Tue Apr 11 19:17:46 2023] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:17:48 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [None req-0b70568e-c696-4ea9-bb0b-f5ccb8aacbf0 admin admin] Calling method '>' {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:17:48 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [None req-0b70568e-c696-4ea9-bb0b-f5ccb8aacbf0 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001432 Apr 11 19:17:48 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 10/30] 10.0.0.210 () {54 vars in 924 bytes} [Tue Apr 11 19:17:48 2023] GET /compute/v2.1 => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:17:48 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [None req-437f9314-a179-461d-a0c2-8bf486e1afb8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 80, "vcpus": 4, "id": "4", "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.large", "rxtx_factor": 1.0, "ram": 8192, "os-flavor-access:is_public": true, "swap": 0}} {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:17:48 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [None req-437f9314-a179-461d-a0c2-8bf486e1afb8 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 403 microversion: 2.61 time: 0.064977 Apr 11 19:17:48 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 10/31] 10.0.0.210 () {64 vars in 1276 bytes} [Tue Apr 11 19:17:48 2023] POST /compute/v2.1/flavors => generated 403 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:17:48 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [None req-03e40212-310c-42b7-be22-d18339e1cdd5 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:17:48 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [None req-03e40212-310c-42b7-be22-d18339e1cdd5 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.024493 Apr 11 19:17:48 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 12/32] 10.0.0.210 () {64 vars in 1326 bytes} [Tue Apr 11 19:17:48 2023] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:17:50 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [None req-0b70568e-c696-4ea9-bb0b-f5ccb8aacbf0 admin admin] Calling method '>' {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:17:50 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [None req-0b70568e-c696-4ea9-bb0b-f5ccb8aacbf0 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001415 Apr 11 19:17:50 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 11/33] 10.0.0.210 () {54 vars in 924 bytes} [Tue Apr 11 19:17:50 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:17:50 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [None req-293227f6-2c9f-420d-90cf-666bc71bd1ee admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 8, "disk": 160, "ram": 16384, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "id": "5", "name": "m1.xlarge", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:17:50 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [None req-293227f6-2c9f-420d-90cf-666bc71bd1ee admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.060763 Apr 11 19:17:50 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 11/34] 10.0.0.210 () {64 vars in 1276 bytes} [Tue Apr 11 19:17:50 2023] POST /compute/v2.1/flavors => generated 406 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:17:50 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [None req-928f9e5b-4cd8-471e-96d8-ce01ac1701b6 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:17:50 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [None req-928f9e5b-4cd8-471e-96d8-ce01ac1701b6 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.023863 Apr 11 19:17:50 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 13/35] 10.0.0.210 () {64 vars in 1326 bytes} [Tue Apr 11 19:17:50 2023] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 19:18:22 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [None req-0b70568e-c696-4ea9-bb0b-f5ccb8aacbf0 admin admin] Calling method '>' {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:18:22 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [None req-0b70568e-c696-4ea9-bb0b-f5ccb8aacbf0 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.002561 Apr 11 19:18:22 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 12/36] 10.0.0.210 () {58 vars in 1006 bytes} [Tue Apr 11 19:18:22 2023] GET /compute/v2.1 => generated 387 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:18:22 user devstack@n-api.service[72090]: DEBUG dbcounter [-] [72090] Writing DB stats nova_api:SELECT=15,nova_api:INSERT=5 {{(pid=72090) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:18:22 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [None req-6abd95c8-d0c3-4396-8f4b-422402e55604 admin admin] Calling method '>' {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:18:22 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-6abd95c8-d0c3-4396-8f4b-422402e55604 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:18:22 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-6abd95c8-d0c3-4396-8f4b-422402e55604 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:18:22 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-6abd95c8-d0c3-4396-8f4b-422402e55604 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:18:22 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-6abd95c8-d0c3-4396-8f4b-422402e55604 admin admin] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:18:22 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-6abd95c8-d0c3-4396-8f4b-422402e55604 admin admin] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:18:22 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-6abd95c8-d0c3-4396-8f4b-422402e55604 admin admin] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:18:22 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [None req-6abd95c8-d0c3-4396-8f4b-422402e55604 admin admin] 10.0.0.210 "GET /compute/v2.1/os-services?binary=nova-compute&host=user" status: 200 len: 247 microversion: 2.69 time: 0.149520 Apr 11 19:18:22 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 12/37] 10.0.0.210 () {64 vars in 1388 bytes} [Tue Apr 11 19:18:22 2023] GET /compute/v2.1/os-services?binary=nova-compute&host=user => generated 247 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:18:55 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [None req-928f9e5b-4cd8-471e-96d8-ce01ac1701b6 admin admin] Calling method '>' {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:18:55 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [None req-928f9e5b-4cd8-471e-96d8-ce01ac1701b6 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001556 Apr 11 19:18:55 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 14/38] 10.0.0.210 () {58 vars in 1006 bytes} [Tue Apr 11 19:18:55 2023] GET /compute/v2.1 => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:18:55 user devstack@n-api.service[72088]: DEBUG dbcounter [-] [72088] Writing DB stats nova_api:SELECT=32,nova_api:SAVEPOINT=5,nova_api:INSERT=5,nova_api:RELEASE=5 {{(pid=72088) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:18:55 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [None req-94f782bd-0260-4458-87d8-f7af8038dd04 admin admin] Calling method '>' {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:18:55 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [None req-94f782bd-0260-4458-87d8-f7af8038dd04 admin admin] 10.0.0.210 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4182 microversion: 2.61 time: 0.071577 Apr 11 19:18:55 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 13/39] 10.0.0.210 () {64 vars in 1367 bytes} [Tue Apr 11 19:18:55 2023] GET /compute/v2.1/flavors/detail?is_public=True => generated 4182 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 19:18:59 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [None req-6abd95c8-d0c3-4396-8f4b-422402e55604 admin admin] Calling method '>' {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:18:59 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [None req-6abd95c8-d0c3-4396-8f4b-422402e55604 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001568 Apr 11 19:18:59 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 13/40] 10.0.0.210 () {58 vars in 1006 bytes} [Tue Apr 11 19:18:59 2023] GET /compute/v2.1 => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:18:59 user devstack@n-api.service[72089]: DEBUG dbcounter [-] [72089] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=10,nova_api:SAVEPOINT=5,nova_api:RELEASE=5 {{(pid=72089) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:18:59 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [None req-4059029a-b2c1-4b93-983b-b542537476cf admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "ram": 128, "rxtx_factor": 1.0, "id": "42", "os-flavor-access:is_public": true, "disk": 1, "vcpus": 1}} {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:18:59 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [None req-4059029a-b2c1-4b93-983b-b542537476cf admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 403 microversion: 2.61 time: 0.067525 Apr 11 19:18:59 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 15/41] 10.0.0.210 () {68 vars in 1358 bytes} [Tue Apr 11 19:18:59 2023] POST /compute/v2.1/flavors => generated 403 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:18:59 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [None req-f8c0d711-a358-4eb4-94d6-df62956863d6 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:18:59 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [None req-f8c0d711-a358-4eb4-94d6-df62956863d6 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.024547 Apr 11 19:18:59 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 14/42] 10.0.0.210 () {68 vars in 1411 bytes} [Tue Apr 11 19:18:59 2023] POST /compute/v2.1/flavors/42/os-extra_specs => generated 43 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:19:03 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [None req-6abd95c8-d0c3-4396-8f4b-422402e55604 admin admin] Calling method '>' {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:19:03 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [None req-6abd95c8-d0c3-4396-8f4b-422402e55604 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.002537 Apr 11 19:19:03 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 14/43] 10.0.0.210 () {58 vars in 1006 bytes} [Tue Apr 11 19:19:03 2023] GET /compute/v2.1 => generated 387 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:19:03 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [None req-dd770ecc-04a0-4072-8836-27a8088c696b admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "disk": 1, "name": "m1.micro", "id": "84", "vcpus": 1, "ram": 192}} {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:19:03 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [None req-dd770ecc-04a0-4072-8836-27a8088c696b admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.131399 Apr 11 19:19:03 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 16/44] 10.0.0.210 () {68 vars in 1358 bytes} [Tue Apr 11 19:19:03 2023] POST /compute/v2.1/flavors => generated 404 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:19:03 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [None req-07fb1d20-bc8d-46f4-b697-d2e2aa9380e9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:19:03 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [None req-07fb1d20-bc8d-46f4-b697-d2e2aa9380e9 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.025140 Apr 11 19:19:03 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 15/45] 10.0.0.210 () {68 vars in 1411 bytes} [Tue Apr 11 19:19:03 2023] POST /compute/v2.1/flavors/84/os-extra_specs => generated 43 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:21:17 user devstack@n-api.service[72090]: DEBUG dbcounter [-] [72090] Writing DB stats nova_cell0:SELECT=2 {{(pid=72090) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:21:17 user devstack@n-api.service[72090]: DEBUG dbcounter [-] [72090] Writing DB stats nova_cell1:SELECT=2 {{(pid=72090) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:21:17 user devstack@n-api.service[72090]: DEBUG dbcounter [-] [72090] Writing DB stats nova_api:SELECT=4 {{(pid=72090) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:21:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [None req-db124ead-bc93-46e6-b391-446376992a5b tempest-VolumesGetTestJSON-164478497 tempest-VolumesGetTestJSON-164478497-project-member] Action: 'create', calling method: .version_select at 0x7f119eaa6e60>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-2073365071", "metadata": {"Type": "work"}}} {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:21:19 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [None req-db124ead-bc93-46e6-b391-446376992a5b tempest-VolumesGetTestJSON-164478497 tempest-VolumesGetTestJSON-164478497-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 1.590220 Apr 11 19:21:19 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 15/46] 10.0.0.210 () {64 vars in 1233 bytes} [Tue Apr 11 19:21:17 2023] POST /compute/v2.1/os-volumes => generated 353 bytes in 1592 msecs (HTTP/1.1 200) 10 headers in 447 bytes (1 switches on core 0) Apr 11 19:21:19 user devstack@n-api.service[72089]: DEBUG dbcounter [-] [72089] Writing DB stats nova_api:SELECT=6,nova_api:INSERT=2 {{(pid=72089) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:21:19 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [None req-7a91f945-5dae-44cc-b53c-b22d54485c0c tempest-VolumesGetTestJSON-164478497 tempest-VolumesGetTestJSON-164478497-project-member] Calling method '.version_select at 0x7f119ea97b50>' {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:21:19 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [None req-7a91f945-5dae-44cc-b53c-b22d54485c0c tempest-VolumesGetTestJSON-164478497 tempest-VolumesGetTestJSON-164478497-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/d4fcfd65-030d-433d-8505-8e57a85a26d2" status: 200 len: 353 microversion: 2.1 time: 0.204999 Apr 11 19:21:19 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 17/47] 10.0.0.210 () {62 vars in 1322 bytes} [Tue Apr 11 19:21:19 2023] GET /compute/v2.1/os-volumes/d4fcfd65-030d-433d-8505-8e57a85a26d2 => generated 353 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:21:20 user devstack@n-api.service[72088]: DEBUG dbcounter [-] [72088] Writing DB stats nova_api:SELECT=14,nova_api:SAVEPOINT=2,nova_api:INSERT=2,nova_api:RELEASE=2 {{(pid=72088) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:21:20 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [None req-c0b79da9-ea11-4e18-9e27-98206013d2f1 tempest-VolumesGetTestJSON-164478497 tempest-VolumesGetTestJSON-164478497-project-member] Calling method '.version_select at 0x7f119ea82cb0>' {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:21:20 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [None req-c0b79da9-ea11-4e18-9e27-98206013d2f1 tempest-VolumesGetTestJSON-164478497 tempest-VolumesGetTestJSON-164478497-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/d4fcfd65-030d-433d-8505-8e57a85a26d2" status: 200 len: 354 microversion: 2.1 time: 0.356340 Apr 11 19:21:20 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 16/48] 10.0.0.210 () {62 vars in 1322 bytes} [Tue Apr 11 19:21:20 2023] GET /compute/v2.1/os-volumes/d4fcfd65-030d-433d-8505-8e57a85a26d2 => generated 354 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:21:20 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [None req-709ca279-9396-45ec-b304-46ea74015e8f tempest-VolumesGetTestJSON-164478497 tempest-VolumesGetTestJSON-164478497-project-member] Calling method '.version_select at 0x7f119e92c4c0>' {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:21:20 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [None req-709ca279-9396-45ec-b304-46ea74015e8f tempest-VolumesGetTestJSON-164478497 tempest-VolumesGetTestJSON-164478497-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/d4fcfd65-030d-433d-8505-8e57a85a26d2" status: 200 len: 354 microversion: 2.1 time: 0.066350 Apr 11 19:21:20 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 16/49] 10.0.0.210 () {62 vars in 1322 bytes} [Tue Apr 11 19:21:20 2023] GET /compute/v2.1/os-volumes/d4fcfd65-030d-433d-8505-8e57a85a26d2 => generated 354 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:21:20 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [None req-478a79a4-ec66-4072-a9b5-3de16da02270 tempest-VolumesGetTestJSON-164478497 tempest-VolumesGetTestJSON-164478497-project-member] Calling method '.version_select at 0x7f119e92ba30>' {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:21:20 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [None req-478a79a4-ec66-4072-a9b5-3de16da02270 tempest-VolumesGetTestJSON-164478497 tempest-VolumesGetTestJSON-164478497-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/d4fcfd65-030d-433d-8505-8e57a85a26d2" status: 202 len: 0 microversion: 2.1 time: 0.104333 Apr 11 19:21:20 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 18/50] 10.0.0.210 () {62 vars in 1325 bytes} [Tue Apr 11 19:21:20 2023] DELETE /compute/v2.1/os-volumes/d4fcfd65-030d-433d-8505-8e57a85a26d2 => generated 0 bytes in 107 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 19:21:20 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [None req-8b22600a-5946-4ab5-b609-7818429bcf69 tempest-VolumesGetTestJSON-164478497 tempest-VolumesGetTestJSON-164478497-project-member] Calling method '.version_select at 0x7f119e91ec20>' {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:21:20 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [None req-8b22600a-5946-4ab5-b609-7818429bcf69 tempest-VolumesGetTestJSON-164478497 tempest-VolumesGetTestJSON-164478497-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/d4fcfd65-030d-433d-8505-8e57a85a26d2" status: 200 len: 353 microversion: 2.1 time: 0.055223 Apr 11 19:21:20 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 17/51] 10.0.0.210 () {62 vars in 1322 bytes} [Tue Apr 11 19:21:20 2023] GET /compute/v2.1/os-volumes/d4fcfd65-030d-433d-8505-8e57a85a26d2 => generated 353 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:21:21 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [None req-0238b472-9b63-4af4-b91c-b01798ebf5b9 tempest-VolumesGetTestJSON-164478497 tempest-VolumesGetTestJSON-164478497-project-member] Calling method '.version_select at 0x7f119e92cb80>' {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:21:21 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [None req-0238b472-9b63-4af4-b91c-b01798ebf5b9 tempest-VolumesGetTestJSON-164478497 tempest-VolumesGetTestJSON-164478497-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/d4fcfd65-030d-433d-8505-8e57a85a26d2" status: 200 len: 353 microversion: 2.1 time: 0.046826 Apr 11 19:21:21 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 17/52] 10.0.0.210 () {62 vars in 1322 bytes} [Tue Apr 11 19:21:21 2023] GET /compute/v2.1/os-volumes/d4fcfd65-030d-433d-8505-8e57a85a26d2 => generated 353 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:21:22 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [None req-69a0fb0c-0340-4771-becf-46033c9ddd3d tempest-VolumesGetTestJSON-164478497 tempest-VolumesGetTestJSON-164478497-project-member] Calling method '.version_select at 0x7f119e940160>' {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:21:22 user devstack@n-api.service[72089]: INFO nova.api.openstack.wsgi [None req-69a0fb0c-0340-4771-becf-46033c9ddd3d tempest-VolumesGetTestJSON-164478497 tempest-VolumesGetTestJSON-164478497-project-member] HTTP exception thrown: Volume d4fcfd65-030d-433d-8505-8e57a85a26d2 could not be found. Apr 11 19:21:22 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [None req-69a0fb0c-0340-4771-becf-46033c9ddd3d tempest-VolumesGetTestJSON-164478497 tempest-VolumesGetTestJSON-164478497-project-member] Request method failure captured: Apr 11 19:21:22 user devstack@n-api.service[72089]: request: GET /compute/v2.1/os-volumes/d4fcfd65-030d-433d-8505-8e57a85a26d2 HTTP/1.1 Apr 11 19:21:22 user devstack@n-api.service[72089]: Accept: application/json Apr 11 19:21:22 user devstack@n-api.service[72089]: Accept-Encoding: identity Apr 11 19:21:22 user devstack@n-api.service[72089]: Connection: close Apr 11 19:21:22 user devstack@n-api.service[72089]: Content-Length: 0 Apr 11 19:21:22 user devstack@n-api.service[72089]: Content-Type: application/json Apr 11 19:21:22 user devstack@n-api.service[72089]: Host: 10.0.0.210 Apr 11 19:21:22 user devstack@n-api.service[72089]: Openstack-System-Scope: None Apr 11 19:21:22 user devstack@n-api.service[72089]: User-Agent: python-urllib3/1.26.15 Apr 11 19:21:22 user devstack@n-api.service[72089]: X-Auth-Token: gAAAAABkNbMth46LfMdvCEcJdNaYz_u3847USONhn7tygUhU0yowgBLDvrsbXoiE_lCJSAMUPN87pdSNx9JHw5DEdl_7TA8O_3OjMBhXXH6PZePwD1FxsuAiqNhpN4CX388p4nnS8u_xBboz2Or9o60Fh22A3_koca_6_4kWew1c8CY0wg1qt54 Apr 11 19:21:22 user devstack@n-api.service[72089]: X-Domain-Id: None Apr 11 19:21:22 user devstack@n-api.service[72089]: X-Domain-Name: None Apr 11 19:21:22 user devstack@n-api.service[72089]: X-Identity-Status: Confirmed Apr 11 19:21:22 user devstack@n-api.service[72089]: X-Is-Admin-Project: True Apr 11 19:21:22 user devstack@n-api.service[72089]: X-Project-Domain-Id: default Apr 11 19:21:22 user devstack@n-api.service[72089]: X-Project-Domain-Name: Default Apr 11 19:21:22 user devstack@n-api.service[72089]: X-Project-Id: abaca17b96ca490caa48cb9b67981221 Apr 11 19:21:22 user devstack@n-api.service[72089]: X-Project-Name: tempest-VolumesGetTestJSON-164478497 Apr 11 19:21:22 user devstack@n-api.service[72089]: X-Role: reader,member Apr 11 19:21:22 user devstack@n-api.service[72089]: X-Roles: reader,member Apr 11 19:21:22 user devstack@n-api.service[72089]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/abaca17b96ca490caa48cb9b67981221"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/abaca17b96ca490caa48cb9b67981221"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/abaca17b96ca490caa48cb9b67981221"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 11 19:21:22 user devstack@n-api.service[72089]: X-Tenant: tempest-VolumesGetTestJSON-164478497 Apr 11 19:21:22 user devstack@n-api.service[72089]: X-Tenant-Id: abaca17b96ca490caa48cb9b67981221 Apr 11 19:21:22 user devstack@n-api.service[72089]: X-Tenant-Name: tempest-VolumesGetTestJSON-164478497 Apr 11 19:21:22 user devstack@n-api.service[72089]: X-User: tempest-VolumesGetTestJSON-164478497-project-member Apr 11 19:21:22 user devstack@n-api.service[72089]: X-User-Domain-Id: default Apr 11 19:21:22 user devstack@n-api.service[72089]: X-User-Domain-Name: Default Apr 11 19:21:22 user devstack@n-api.service[72089]: X-User-Id: 4ddb50f0f76b474bbd77e86e2e3d49a8 Apr 11 19:21:22 user devstack@n-api.service[72089]: X-User-Name: tempest-VolumesGetTestJSON-164478497-project-member Apr 11 19:21:22 user devstack@n-api.service[72089]: method: Apr 11 19:21:22 user devstack@n-api.service[72089]: exception: Volume d4fcfd65-030d-433d-8505-8e57a85a26d2 could not be found. Apr 11 19:21:22 user devstack@n-api.service[72089]: action_args: {'id': 'd4fcfd65-030d-433d-8505-8e57a85a26d2'} Apr 11 19:21:22 user devstack@n-api.service[72089]: {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 19:21:22 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:21:22 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 11 19:21:22 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 11 19:21:22 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 11 19:21:22 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 11 19:21:22 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 11 19:21:22 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 11 19:21:22 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 11 19:21:22 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 11 19:21:22 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 11 19:21:22 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 11 19:21:22 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 11 19:21:22 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 11 19:21:22 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 11 19:21:22 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 11 19:21:22 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume d4fcfd65-030d-433d-8505-8e57a85a26d2 could not be found. (HTTP 404) (Request-ID: req-636c93cd-25f2-4fd2-9286-11ad5e014f4b) Apr 11 19:21:22 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi Apr 11 19:21:22 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 19:21:22 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi Apr 11 19:21:22 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:21:23 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Apr 11 19:21:23 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Apr 11 19:21:23 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 11 19:21:23 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 11 19:21:23 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 11 19:21:23 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 11 19:21:23 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 11 19:21:23 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 11 19:21:23 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 11 19:21:23 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 11 19:21:23 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 11 19:21:23 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 11 19:21:23 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 11 19:21:23 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 11 19:21:23 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 11 19:21:23 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 11 19:21:23 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 11 19:21:23 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 11 19:21:23 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 11 19:21:23 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 11 19:21:23 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 11 19:21:23 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 11 19:21:23 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume d4fcfd65-030d-433d-8505-8e57a85a26d2 could not be found. Apr 11 19:21:23 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi Apr 11 19:21:23 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 19:21:23 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi Apr 11 19:21:23 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:21:23 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 19:21:23 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 19:21:23 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 19:21:23 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 19:21:23 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 11 19:21:23 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 11 19:21:23 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 19:21:23 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 19:21:23 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Apr 11 19:21:23 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 19:21:23 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume d4fcfd65-030d-433d-8505-8e57a85a26d2 could not be found. Apr 11 19:21:23 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi Apr 11 19:21:23 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 19:21:23 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi Apr 11 19:21:23 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:21:23 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 19:21:23 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 19:21:23 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 19:21:23 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 19:21:23 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume d4fcfd65-030d-433d-8505-8e57a85a26d2 could not be found. Apr 11 19:21:23 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi Apr 11 19:21:23 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [None req-69a0fb0c-0340-4771-becf-46033c9ddd3d tempest-VolumesGetTestJSON-164478497 tempest-VolumesGetTestJSON-164478497-project-member] Returning 404 to user: Volume d4fcfd65-030d-433d-8505-8e57a85a26d2 could not be found. {{(pid=72089) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 19:21:23 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [None req-69a0fb0c-0340-4771-becf-46033c9ddd3d tempest-VolumesGetTestJSON-164478497 tempest-VolumesGetTestJSON-164478497-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/d4fcfd65-030d-433d-8505-8e57a85a26d2" status: 404 len: 109 microversion: 2.1 time: 0.083857 Apr 11 19:21:23 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 19/53] 10.0.0.210 () {62 vars in 1322 bytes} [Tue Apr 11 19:21:22 2023] GET /compute/v2.1/os-volumes/d4fcfd65-030d-433d-8505-8e57a85a26d2 => generated 109 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 19:21:27 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [None req-53b50712-9dae-4e63-a5db-3dd04028b98d tempest-VolumesTestJSON-498528481 tempest-VolumesTestJSON-498528481-project-member] Calling method '.version_select at 0x7f119e91f2e0>' {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:21:27 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [None req-53b50712-9dae-4e63-a5db-3dd04028b98d tempest-VolumesTestJSON-498528481 tempest-VolumesTestJSON-498528481-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/7d51f9d7-2e7d-47b3-b8e5-1a8287c702b3" status: 200 len: 351 microversion: 2.1 time: 0.046790 Apr 11 19:21:27 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 18/54] 10.0.0.210 () {62 vars in 1322 bytes} [Tue Apr 11 19:21:27 2023] GET /compute/v2.1/os-volumes/7d51f9d7-2e7d-47b3-b8e5-1a8287c702b3 => generated 351 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:21:29 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [None req-1327f849-9c1f-40e7-a22a-2d1a94ec1ef1 tempest-VolumesTestJSON-498528481 tempest-VolumesTestJSON-498528481-project-member] Calling method '.version_select at 0x7f119e92d240>' {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:21:29 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [None req-1327f849-9c1f-40e7-a22a-2d1a94ec1ef1 tempest-VolumesTestJSON-498528481 tempest-VolumesTestJSON-498528481-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/711217a9-2e42-4933-93ac-5541b1990503" status: 200 len: 350 microversion: 2.1 time: 0.054802 Apr 11 19:21:29 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 18/55] 10.0.0.210 () {62 vars in 1322 bytes} [Tue Apr 11 19:21:29 2023] GET /compute/v2.1/os-volumes/711217a9-2e42-4933-93ac-5541b1990503 => generated 350 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:21:31 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [None req-5042df49-7922-4a39-a546-29249be88807 tempest-VolumesTestJSON-498528481 tempest-VolumesTestJSON-498528481-project-member] Calling method '.version_select at 0x7f119e9411b0>' {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:21:31 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [None req-5042df49-7922-4a39-a546-29249be88807 tempest-VolumesTestJSON-498528481 tempest-VolumesTestJSON-498528481-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/c547293f-38db-4cb0-a2ed-439d93774301" status: 200 len: 350 microversion: 2.1 time: 0.060358 Apr 11 19:21:31 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 20/56] 10.0.0.210 () {62 vars in 1322 bytes} [Tue Apr 11 19:21:31 2023] GET /compute/v2.1/os-volumes/c547293f-38db-4cb0-a2ed-439d93774301 => generated 350 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:21:31 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [None req-9eb2443b-8890-4300-9422-5289cbc205dc tempest-VolumesTestJSON-498528481 tempest-VolumesTestJSON-498528481-project-member] Calling method '.version_select at 0x7f119e91f7f0>' {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:21:31 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [None req-9eb2443b-8890-4300-9422-5289cbc205dc tempest-VolumesTestJSON-498528481 tempest-VolumesTestJSON-498528481-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.135807 Apr 11 19:21:31 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 19/57] 10.0.0.210 () {62 vars in 1211 bytes} [Tue Apr 11 19:21:31 2023] GET /compute/v2.1/os-volumes => generated 1034 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:21:31 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [None req-8e3f9d4d-e513-4cd4-b3a5-9b8cfc7917e8 tempest-VolumesTestJSON-498528481 tempest-VolumesTestJSON-498528481-project-member] Calling method '.version_select at 0x7f119e92d480>' {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:21:31 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [None req-8e3f9d4d-e513-4cd4-b3a5-9b8cfc7917e8 tempest-VolumesTestJSON-498528481 tempest-VolumesTestJSON-498528481-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.115725 Apr 11 19:21:31 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 19/58] 10.0.0.210 () {62 vars in 1226 bytes} [Tue Apr 11 19:21:31 2023] GET /compute/v2.1/os-volumes?limit=2 => generated 693 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:21:31 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [None req-0891881d-b07f-4c01-8ce3-9dadc2e909fd tempest-VolumesTestJSON-498528481 tempest-VolumesTestJSON-498528481-project-member] Calling method '.version_select at 0x7f119e940af0>' {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:21:31 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [None req-0891881d-b07f-4c01-8ce3-9dadc2e909fd tempest-VolumesTestJSON-498528481 tempest-VolumesTestJSON-498528481-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.104922 Apr 11 19:21:31 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 21/59] 10.0.0.210 () {62 vars in 1211 bytes} [Tue Apr 11 19:21:31 2023] GET /compute/v2.1/os-volumes => generated 1034 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:21:31 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [None req-b3356b93-96d8-43c6-bdcf-1e3769b86c75 tempest-VolumesTestJSON-498528481 tempest-VolumesTestJSON-498528481-project-member] Calling method '.version_select at 0x7f119e91feb0>' {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:21:31 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [None req-b3356b93-96d8-43c6-bdcf-1e3769b86c75 tempest-VolumesTestJSON-498528481 tempest-VolumesTestJSON-498528481-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.085348 Apr 11 19:21:31 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 20/60] 10.0.0.210 () {62 vars in 1244 bytes} [Tue Apr 11 19:21:31 2023] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:21:31 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [None req-f7a12644-6e5b-4581-a603-f56e98daf736 tempest-VolumesTestJSON-498528481 tempest-VolumesTestJSON-498528481-project-member] Calling method '.version_select at 0x7f119e92d7e0>' {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:21:31 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [None req-f7a12644-6e5b-4581-a603-f56e98daf736 tempest-VolumesTestJSON-498528481 tempest-VolumesTestJSON-498528481-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.117151 Apr 11 19:21:31 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 20/61] 10.0.0.210 () {62 vars in 1247 bytes} [Tue Apr 11 19:21:31 2023] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 693 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:21:31 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [None req-a36fd31f-adcb-4ddf-84da-5e6baebf4a65 tempest-VolumesTestJSON-498528481 tempest-VolumesTestJSON-498528481-project-member] Calling method '.version_select at 0x7f119e941e10>' {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:21:31 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [None req-a36fd31f-adcb-4ddf-84da-5e6baebf4a65 tempest-VolumesTestJSON-498528481 tempest-VolumesTestJSON-498528481-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.095227 Apr 11 19:21:31 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 22/62] 10.0.0.210 () {62 vars in 1232 bytes} [Tue Apr 11 19:21:31 2023] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:21:31 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [None req-548c2065-2630-4901-b9ae-be3fb784baff tempest-VolumesTestJSON-498528481 tempest-VolumesTestJSON-498528481-project-member] Calling method '.version_select at 0x7f119e91fc70>' {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:21:32 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [None req-548c2065-2630-4901-b9ae-be3fb784baff tempest-VolumesTestJSON-498528481 tempest-VolumesTestJSON-498528481-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.257118 Apr 11 19:21:32 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 21/63] 10.0.0.210 () {62 vars in 1265 bytes} [Tue Apr 11 19:21:31 2023] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:21:32 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [None req-6bbb9e0c-f674-4f84-b48d-9201e3ffecb6 tempest-VolumesTestJSON-498528481 tempest-VolumesTestJSON-498528481-project-member] Calling method '.version_select at 0x7f119e92e7a0>' {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:21:32 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [None req-6bbb9e0c-f674-4f84-b48d-9201e3ffecb6 tempest-VolumesTestJSON-498528481 tempest-VolumesTestJSON-498528481-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.107085 Apr 11 19:21:32 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 21/64] 10.0.0.210 () {62 vars in 1232 bytes} [Tue Apr 11 19:21:32 2023] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:21:34 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [None req-8279b137-7c0b-4002-982c-a2b49cad313d tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Action: 'create', calling method: .version_select at 0x7f119e942dd0>, body: {"keypair": {"name": "tempest-keypair-253891769", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMXl985Dnl44xCHtf4FIl1xYVxoZaplMJQzbwa3Y9N5KsJvliQVBgK4OaT/SgpGEh9Q8h4HPARqY2MPNwKL+8Ropi74fbtw+x6EYUP9DMyAquimJy9wP/Ns3xiePmd0rew=="}} {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:21:34 user devstack@n-api.service[72089]: DEBUG nova.quota [None req-8279b137-7c0b-4002-982c-a2b49cad313d tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Getting quotas for project 06966e2f4d3a4dec92282c7ad348635d. Resources: {'key_pairs'} {{(pid=72089) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 19:21:34 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [None req-136dddbd-b4d6-4dd9-8c56-1b7c17a4a726 tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1297415435", "imageRef": "4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b", "flavorRef": "42", "networks": [{"uuid": "b29e55eb-c801-47f0-8cb7-be11e1471261"}]}} {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:21:34 user devstack@n-api.service[72089]: DEBUG nova.quota [None req-8279b137-7c0b-4002-982c-a2b49cad313d tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Getting quotas for user d5d405421ceb4d99967ef2e7f55e7809 and project 06966e2f4d3a4dec92282c7ad348635d. Resources: {'key_pairs'} {{(pid=72089) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 19:21:34 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [None req-8279b137-7c0b-4002-982c-a2b49cad313d tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.269044 Apr 11 19:21:34 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 23/65] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Apr 11 19:21:33 2023] POST /compute/v2.1/os-keypairs => generated 385 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:21:34 user devstack@n-api.service[72088]: DEBUG nova.network.neutron [None req-136dddbd-b4d6-4dd9-8c56-1b7c17a4a726 tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] validate_networks() for [('b29e55eb-c801-47f0-8cb7-be11e1471261', None, None, None, None, None)] {{(pid=72088) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 11 19:21:35 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [None req-d06eb8ff-850f-4684-b564-520d2f591a4e tempest-DeleteServersTestJSON-124461992 tempest-DeleteServersTestJSON-124461992-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1799394439", "imageRef": "4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b", "flavorRef": "42", "networks": [{"uuid": "ebd8b9a8-4546-4cc1-bf7c-f1c141dc58dd"}]}} {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:21:35 user devstack@n-api.service[72090]: DEBUG nova.network.neutron [None req-d06eb8ff-850f-4684-b564-520d2f591a4e tempest-DeleteServersTestJSON-124461992 tempest-DeleteServersTestJSON-124461992-project-member] validate_networks() for [('ebd8b9a8-4546-4cc1-bf7c-f1c141dc58dd', None, None, None, None, None)] {{(pid=72090) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 11 19:21:36 user devstack@n-api.service[72088]: DEBUG nova.virt.hardware [None req-136dddbd-b4d6-4dd9-8c56-1b7c17a4a726 tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] Flavor limits 0:0:0 {{(pid=72088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 19:21:36 user devstack@n-api.service[72088]: DEBUG nova.virt.hardware [None req-136dddbd-b4d6-4dd9-8c56-1b7c17a4a726 tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] Image limits 0:0:0 {{(pid=72088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 19:21:36 user devstack@n-api.service[72088]: DEBUG nova.virt.hardware [None req-136dddbd-b4d6-4dd9-8c56-1b7c17a4a726 tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] Flavor pref 0:0:0 {{(pid=72088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 19:21:36 user devstack@n-api.service[72088]: DEBUG nova.virt.hardware [None req-136dddbd-b4d6-4dd9-8c56-1b7c17a4a726 tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] Image pref 0:0:0 {{(pid=72088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 19:21:36 user devstack@n-api.service[72088]: DEBUG nova.virt.hardware [None req-136dddbd-b4d6-4dd9-8c56-1b7c17a4a726 tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 19:21:36 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-136dddbd-b4d6-4dd9-8c56-1b7c17a4a726 tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:21:36 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-136dddbd-b4d6-4dd9-8c56-1b7c17a4a726 tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:21:36 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-136dddbd-b4d6-4dd9-8c56-1b7c17a4a726 tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:21:36 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-136dddbd-b4d6-4dd9-8c56-1b7c17a4a726 tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:21:36 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-136dddbd-b4d6-4dd9-8c56-1b7c17a4a726 tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:21:36 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-136dddbd-b4d6-4dd9-8c56-1b7c17a4a726 tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:21:36 user devstack@n-api.service[72088]: DEBUG nova.quota [None req-136dddbd-b4d6-4dd9-8c56-1b7c17a4a726 tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] Getting quotas for project 0d5d7769df1e4974b295cb30407151dd. Resources: {'ram', 'instances', 'cores'} {{(pid=72088) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 19:21:36 user devstack@n-api.service[72088]: DEBUG nova.quota [None req-136dddbd-b4d6-4dd9-8c56-1b7c17a4a726 tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] Getting quotas for user 2f44dfa2528b4540a81f4eb7c3f3f2f5 and project 0d5d7769df1e4974b295cb30407151dd. Resources: {'ram', 'instances', 'cores'} {{(pid=72088) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 19:21:36 user devstack@n-api.service[72088]: DEBUG nova.compute.api [None req-136dddbd-b4d6-4dd9-8c56-1b7c17a4a726 tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] Going to run 1 instances... {{(pid=72088) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 11 19:21:36 user devstack@n-api.service[72088]: DEBUG nova.compute.api [None req-136dddbd-b4d6-4dd9-8c56-1b7c17a4a726 tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] [instance: fc48e37f-8c00-4e48-bea3-f1c2e54d78b8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=72088) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 11 19:21:36 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [None req-136dddbd-b4d6-4dd9-8c56-1b7c17a4a726 tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 2.771694 Apr 11 19:21:36 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 22/66] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 11 19:21:34 2023] POST /compute/v2.1/servers => generated 378 bytes in 2774 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 11 19:21:36 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [None req-0f517ce3-700f-4e32-ba5e-838454589274 tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] Calling method '>' {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:21:36 user devstack@n-api.service[72089]: DEBUG nova.compute.api [None req-0f517ce3-700f-4e32-ba5e-838454589274 tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] [instance: fc48e37f-8c00-4e48-bea3-f1c2e54d78b8] Fetching instance by UUID {{(pid=72089) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:21:37 user devstack@n-api.service[72089]: DEBUG nova.policy [None req-0f517ce3-700f-4e32-ba5e-838454589274 tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f44dfa2528b4540a81f4eb7c3f3f2f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5d7769df1e4974b295cb30407151dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72089) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:21:37 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [None req-0f517ce3-700f-4e32-ba5e-838454589274 tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fc48e37f-8c00-4e48-bea3-f1c2e54d78b8" status: 200 len: 1211 microversion: 2.1 time: 0.271987 Apr 11 19:21:37 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 24/67] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 19:21:36 2023] GET /compute/v2.1/servers/fc48e37f-8c00-4e48-bea3-f1c2e54d78b8 => generated 1211 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:21:37 user devstack@n-api.service[72090]: DEBUG nova.virt.hardware [None req-d06eb8ff-850f-4684-b564-520d2f591a4e tempest-DeleteServersTestJSON-124461992 tempest-DeleteServersTestJSON-124461992-project-member] Flavor limits 0:0:0 {{(pid=72090) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 19:21:37 user devstack@n-api.service[72090]: DEBUG nova.virt.hardware [None req-d06eb8ff-850f-4684-b564-520d2f591a4e tempest-DeleteServersTestJSON-124461992 tempest-DeleteServersTestJSON-124461992-project-member] Image limits 0:0:0 {{(pid=72090) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 19:21:37 user devstack@n-api.service[72090]: DEBUG nova.virt.hardware [None req-d06eb8ff-850f-4684-b564-520d2f591a4e tempest-DeleteServersTestJSON-124461992 tempest-DeleteServersTestJSON-124461992-project-member] Flavor pref 0:0:0 {{(pid=72090) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 19:21:37 user devstack@n-api.service[72090]: DEBUG nova.virt.hardware [None req-d06eb8ff-850f-4684-b564-520d2f591a4e tempest-DeleteServersTestJSON-124461992 tempest-DeleteServersTestJSON-124461992-project-member] Image pref 0:0:0 {{(pid=72090) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 19:21:37 user devstack@n-api.service[72090]: DEBUG nova.virt.hardware [None req-d06eb8ff-850f-4684-b564-520d2f591a4e tempest-DeleteServersTestJSON-124461992 tempest-DeleteServersTestJSON-124461992-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72090) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 19:21:37 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-d06eb8ff-850f-4684-b564-520d2f591a4e tempest-DeleteServersTestJSON-124461992 tempest-DeleteServersTestJSON-124461992-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:21:37 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-d06eb8ff-850f-4684-b564-520d2f591a4e tempest-DeleteServersTestJSON-124461992 tempest-DeleteServersTestJSON-124461992-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:21:37 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-d06eb8ff-850f-4684-b564-520d2f591a4e tempest-DeleteServersTestJSON-124461992 tempest-DeleteServersTestJSON-124461992-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:21:37 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-d06eb8ff-850f-4684-b564-520d2f591a4e tempest-DeleteServersTestJSON-124461992 tempest-DeleteServersTestJSON-124461992-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:21:37 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-d06eb8ff-850f-4684-b564-520d2f591a4e tempest-DeleteServersTestJSON-124461992 tempest-DeleteServersTestJSON-124461992-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:21:37 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-d06eb8ff-850f-4684-b564-520d2f591a4e tempest-DeleteServersTestJSON-124461992 tempest-DeleteServersTestJSON-124461992-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:21:37 user devstack@n-api.service[72090]: DEBUG nova.quota [None req-d06eb8ff-850f-4684-b564-520d2f591a4e tempest-DeleteServersTestJSON-124461992 tempest-DeleteServersTestJSON-124461992-project-member] Getting quotas for project 34322e02b2fc4c2c84fb77583faf4405. Resources: {'ram', 'instances', 'cores'} {{(pid=72090) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 19:21:37 user devstack@n-api.service[72090]: DEBUG nova.quota [None req-d06eb8ff-850f-4684-b564-520d2f591a4e tempest-DeleteServersTestJSON-124461992 tempest-DeleteServersTestJSON-124461992-project-member] Getting quotas for user 502b859ece744cf680123cd4e9643938 and project 34322e02b2fc4c2c84fb77583faf4405. Resources: {'ram', 'instances', 'cores'} {{(pid=72090) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 19:21:37 user devstack@n-api.service[72090]: DEBUG nova.compute.api [None req-d06eb8ff-850f-4684-b564-520d2f591a4e tempest-DeleteServersTestJSON-124461992 tempest-DeleteServersTestJSON-124461992-project-member] Going to run 1 instances... {{(pid=72090) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 11 19:21:37 user devstack@n-api.service[72090]: DEBUG nova.compute.api [None req-d06eb8ff-850f-4684-b564-520d2f591a4e tempest-DeleteServersTestJSON-124461992 tempest-DeleteServersTestJSON-124461992-project-member] [instance: efd7afec-d6d0-4e3f-a3b9-f672b3e711cf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=72090) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 11 19:21:37 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [None req-d06eb8ff-850f-4684-b564-520d2f591a4e tempest-DeleteServersTestJSON-124461992 tempest-DeleteServersTestJSON-124461992-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 1.786844 Apr 11 19:21:37 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 22/68] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 11 19:21:35 2023] POST /compute/v2.1/servers => generated 378 bytes in 1788 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Apr 11 19:21:37 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [None req-991118fd-e1a0-4c90-8ca7-a89426cd622f tempest-DeleteServersTestJSON-124461992 tempest-DeleteServersTestJSON-124461992-project-member] Calling method '>' {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:21:37 user devstack@n-api.service[72088]: DEBUG nova.compute.api [None req-991118fd-e1a0-4c90-8ca7-a89426cd622f tempest-DeleteServersTestJSON-124461992 tempest-DeleteServersTestJSON-124461992-project-member] [instance: efd7afec-d6d0-4e3f-a3b9-f672b3e711cf] Fetching instance by UUID {{(pid=72088) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:21:37 user devstack@n-api.service[72088]: DEBUG nova.policy [None req-991118fd-e1a0-4c90-8ca7-a89426cd622f tempest-DeleteServersTestJSON-124461992 tempest-DeleteServersTestJSON-124461992-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '502b859ece744cf680123cd4e9643938', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34322e02b2fc4c2c84fb77583faf4405', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72088) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:21:37 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [None req-991118fd-e1a0-4c90-8ca7-a89426cd622f tempest-DeleteServersTestJSON-124461992 tempest-DeleteServersTestJSON-124461992-project-member] 10.0.0.210 "GET /compute/v2.1/servers/efd7afec-d6d0-4e3f-a3b9-f672b3e711cf" status: 200 len: 1209 microversion: 2.1 time: 0.308481 Apr 11 19:21:37 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 23/69] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 19:21:37 2023] GET /compute/v2.1/servers/efd7afec-d6d0-4e3f-a3b9-f672b3e711cf => generated 1209 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:21:41 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [None req-bbc89398-7374-4b1a-b672-54ffb81c26f8 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1923045055", "imageRef": "4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "fb39619b-a298-4b28-9280-3fc309c5a229"}], "security_groups": [{"name": "tempest-securitygroup--1704655877"}], "key_name": "tempest-keypair-253891769", "user_data": "}} {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:21:41 user devstack@n-api.service[72089]: DEBUG nova.network.neutron [None req-bbc89398-7374-4b1a-b672-54ffb81c26f8 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] validate_networks() for [('fb39619b-a298-4b28-9280-3fc309c5a229', None, None, None, None, None)] {{(pid=72089) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 11 19:21:42 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [None req-3f022885-d12b-4735-aec3-00fdcf79add2 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] Action: 'create', calling method: .version_select at 0x7f119e9ef370>, body: {"keypair": {"name": "tempest-keypair-909036118", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFQPHRAJfFRFeAUt5MqGdWAF2Vw2uFd+0nfpM413xhOuBbSDaV6LfVNTeVPCQwsh3pP3/wPGteAXUcszYrP1qam1IH+EIRD9QQUduJX8PlHQPLpnCt50NfjnO6EpONvQTg=="}} {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:21:42 user devstack@n-api.service[72090]: DEBUG nova.quota [None req-3f022885-d12b-4735-aec3-00fdcf79add2 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] Getting quotas for project 11ee7c68b277420ba524c2a99cd444ea. Resources: {'key_pairs'} {{(pid=72090) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 19:21:42 user devstack@n-api.service[72090]: DEBUG nova.quota [None req-3f022885-d12b-4735-aec3-00fdcf79add2 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] Getting quotas for user 26f091a1508b4d2689005b660f6a1380 and project 11ee7c68b277420ba524c2a99cd444ea. Resources: {'key_pairs'} {{(pid=72090) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 19:21:42 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [None req-3f022885-d12b-4735-aec3-00fdcf79add2 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.213156 Apr 11 19:21:42 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 23/70] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Apr 11 19:21:42 2023] POST /compute/v2.1/os-keypairs => generated 385 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:21:44 user devstack@n-api.service[72089]: DEBUG nova.virt.hardware [None req-bbc89398-7374-4b1a-b672-54ffb81c26f8 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Flavor limits 0:0:0 {{(pid=72089) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 19:21:44 user devstack@n-api.service[72089]: DEBUG nova.virt.hardware [None req-bbc89398-7374-4b1a-b672-54ffb81c26f8 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Image limits 0:0:0 {{(pid=72089) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 19:21:44 user devstack@n-api.service[72089]: DEBUG nova.virt.hardware [None req-bbc89398-7374-4b1a-b672-54ffb81c26f8 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Flavor pref 0:0:0 {{(pid=72089) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 19:21:44 user devstack@n-api.service[72089]: DEBUG nova.virt.hardware [None req-bbc89398-7374-4b1a-b672-54ffb81c26f8 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Image pref 0:0:0 {{(pid=72089) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 19:21:44 user devstack@n-api.service[72089]: DEBUG nova.virt.hardware [None req-bbc89398-7374-4b1a-b672-54ffb81c26f8 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72089) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 19:21:44 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-bbc89398-7374-4b1a-b672-54ffb81c26f8 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:21:44 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-bbc89398-7374-4b1a-b672-54ffb81c26f8 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:21:44 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-bbc89398-7374-4b1a-b672-54ffb81c26f8 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:21:44 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-bbc89398-7374-4b1a-b672-54ffb81c26f8 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:21:44 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-bbc89398-7374-4b1a-b672-54ffb81c26f8 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:21:44 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-bbc89398-7374-4b1a-b672-54ffb81c26f8 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:21:44 user devstack@n-api.service[72089]: DEBUG nova.quota [None req-bbc89398-7374-4b1a-b672-54ffb81c26f8 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Getting quotas for project 06966e2f4d3a4dec92282c7ad348635d. Resources: {'ram', 'instances', 'cores'} {{(pid=72089) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 19:21:44 user devstack@n-api.service[72089]: DEBUG nova.quota [None req-bbc89398-7374-4b1a-b672-54ffb81c26f8 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Getting quotas for user d5d405421ceb4d99967ef2e7f55e7809 and project 06966e2f4d3a4dec92282c7ad348635d. Resources: {'ram', 'instances', 'cores'} {{(pid=72089) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 19:21:44 user devstack@n-api.service[72089]: DEBUG nova.compute.api [None req-bbc89398-7374-4b1a-b672-54ffb81c26f8 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Going to run 1 instances... {{(pid=72089) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 11 19:21:44 user devstack@n-api.service[72089]: DEBUG nova.compute.api [None req-bbc89398-7374-4b1a-b672-54ffb81c26f8 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] [instance: bed4001c-02c2-4c6b-84c8-61654df66d8b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=72089) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 11 19:21:44 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [None req-bbc89398-7374-4b1a-b672-54ffb81c26f8 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 2.965334 Apr 11 19:21:44 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 25/71] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 11 19:21:41 2023] POST /compute/v2.1/servers => generated 400 bytes in 2967 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 11 19:21:44 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [None req-f7316ee1-3192-4375-a8a3-561e7fa893fe tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Calling method '>' {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:21:44 user devstack@n-api.service[72088]: DEBUG nova.compute.api [None req-f7316ee1-3192-4375-a8a3-561e7fa893fe tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] [instance: bed4001c-02c2-4c6b-84c8-61654df66d8b] Fetching instance by UUID {{(pid=72088) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:21:44 user devstack@n-api.service[72088]: DEBUG nova.policy [None req-f7316ee1-3192-4375-a8a3-561e7fa893fe tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5d405421ceb4d99967ef2e7f55e7809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06966e2f4d3a4dec92282c7ad348635d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72088) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:21:44 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [None req-f7316ee1-3192-4375-a8a3-561e7fa893fe tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bed4001c-02c2-4c6b-84c8-61654df66d8b" status: 200 len: 1235 microversion: 2.1 time: 0.154908 Apr 11 19:21:44 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 24/72] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 19:21:44 2023] GET /compute/v2.1/servers/bed4001c-02c2-4c6b-84c8-61654df66d8b => generated 1235 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:21:45 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [req-760183a6-4985-4eb6-b665-3bcc1461902d req-0c2a0fbc-dacd-43e5-9efa-1472cd653dc1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "efd7afec-d6d0-4e3f-a3b9-f672b3e711cf", "tag": "096d6451-049b-4ff5-9eaf-8ee3884c8715"}]} {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:21:45 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-760183a6-4985-4eb6-b665-3bcc1461902d req-0c2a0fbc-dacd-43e5-9efa-1472cd653dc1 service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:21:45 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-760183a6-4985-4eb6-b665-3bcc1461902d req-0c2a0fbc-dacd-43e5-9efa-1472cd653dc1 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:21:45 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-760183a6-4985-4eb6-b665-3bcc1461902d req-0c2a0fbc-dacd-43e5-9efa-1472cd653dc1 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:21:45 user devstack@n-api.service[72090]: INFO nova.api.openstack.compute.server_external_events [req-760183a6-4985-4eb6-b665-3bcc1461902d req-0c2a0fbc-dacd-43e5-9efa-1472cd653dc1 service nova] Creating event network-changed:096d6451-049b-4ff5-9eaf-8ee3884c8715 for instance efd7afec-d6d0-4e3f-a3b9-f672b3e711cf on user Apr 11 19:21:45 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-760183a6-4985-4eb6-b665-3bcc1461902d req-0c2a0fbc-dacd-43e5-9efa-1472cd653dc1 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=72090) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}} Apr 11 19:21:45 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-760183a6-4985-4eb6-b665-3bcc1461902d req-0c2a0fbc-dacd-43e5-9efa-1472cd653dc1 service nova] Acquired lock "compute-rpcapi-router" {{(pid=72090) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}} Apr 11 19:21:45 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-930fb937-35cf-436b-bb14-38d4d449b488 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:21:45 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-930fb937-35cf-436b-bb14-38d4d449b488 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:21:45 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-930fb937-35cf-436b-bb14-38d4d449b488 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:21:45 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-930fb937-35cf-436b-bb14-38d4d449b488 None None] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:21:45 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-930fb937-35cf-436b-bb14-38d4d449b488 None None] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:21:45 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-930fb937-35cf-436b-bb14-38d4d449b488 None None] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:21:45 user devstack@n-api.service[72090]: INFO nova.compute.rpcapi [None req-930fb937-35cf-436b-bb14-38d4d449b488 None None] Automatically selected compute RPC version 6.2 from minimum service version 66 Apr 11 19:21:45 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-930fb937-35cf-436b-bb14-38d4d449b488 None None] Releasing lock "compute-rpcapi-router" {{(pid=72090) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}} Apr 11 19:21:45 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [None req-930fb937-35cf-436b-bb14-38d4d449b488 None None] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.198400 Apr 11 19:21:45 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 24/73] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:21:45 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:21:46 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [req-7fd52a62-c5b0-45c2-a14c-295fcd57dfbd req-17bd8f62-22e2-4cef-a05a-72c0689440ed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fc48e37f-8c00-4e48-bea3-f1c2e54d78b8", "tag": "b4beb6cf-d11a-487e-b95d-6adec8a8ee4d"}]} {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:21:46 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-7fd52a62-c5b0-45c2-a14c-295fcd57dfbd req-17bd8f62-22e2-4cef-a05a-72c0689440ed service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:21:46 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-7fd52a62-c5b0-45c2-a14c-295fcd57dfbd req-17bd8f62-22e2-4cef-a05a-72c0689440ed service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:21:46 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-7fd52a62-c5b0-45c2-a14c-295fcd57dfbd req-17bd8f62-22e2-4cef-a05a-72c0689440ed service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:21:46 user devstack@n-api.service[72089]: INFO nova.api.openstack.compute.server_external_events [req-7fd52a62-c5b0-45c2-a14c-295fcd57dfbd req-17bd8f62-22e2-4cef-a05a-72c0689440ed service nova] Creating event network-changed:b4beb6cf-d11a-487e-b95d-6adec8a8ee4d for instance fc48e37f-8c00-4e48-bea3-f1c2e54d78b8 on user Apr 11 19:21:46 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-7fd52a62-c5b0-45c2-a14c-295fcd57dfbd req-17bd8f62-22e2-4cef-a05a-72c0689440ed service nova] Acquiring lock "compute-rpcapi-router" {{(pid=72089) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}} Apr 11 19:21:46 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-7fd52a62-c5b0-45c2-a14c-295fcd57dfbd req-17bd8f62-22e2-4cef-a05a-72c0689440ed service nova] Acquired lock "compute-rpcapi-router" {{(pid=72089) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}} Apr 11 19:21:46 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-3fb15a93-4ea2-42d6-8cbb-f8c8cf5c4c74 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:21:46 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-3fb15a93-4ea2-42d6-8cbb-f8c8cf5c4c74 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:21:46 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-3fb15a93-4ea2-42d6-8cbb-f8c8cf5c4c74 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:21:46 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-3fb15a93-4ea2-42d6-8cbb-f8c8cf5c4c74 None None] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:21:46 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-3fb15a93-4ea2-42d6-8cbb-f8c8cf5c4c74 None None] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:21:46 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-3fb15a93-4ea2-42d6-8cbb-f8c8cf5c4c74 None None] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:21:46 user devstack@n-api.service[72089]: INFO nova.compute.rpcapi [None req-3fb15a93-4ea2-42d6-8cbb-f8c8cf5c4c74 None None] Automatically selected compute RPC version 6.2 from minimum service version 66 Apr 11 19:21:46 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-3fb15a93-4ea2-42d6-8cbb-f8c8cf5c4c74 None None] Releasing lock "compute-rpcapi-router" {{(pid=72089) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}} Apr 11 19:21:46 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [None req-3fb15a93-4ea2-42d6-8cbb-f8c8cf5c4c74 None None] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.320374 Apr 11 19:21:46 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 26/74] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:21:46 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:21:48 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [None req-ebce8406-fb4b-495c-8077-9faa681c5912 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerStableDeviceRescueTest-server-309951304", "imageRef": "4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b", "flavorRef": "42", "networks": [{"uuid": "e637d15d-90c0-48cc-8229-ffd26c0be8c6"}], "security_groups": [{"name": "tempest-securitygroup--1363690818"}], "key_name": "tempest-keypair-909036118", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:21:48 user devstack@n-api.service[72088]: DEBUG dbcounter [-] [72088] Writing DB stats nova_cell0:SELECT=2 {{(pid=72088) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:21:48 user devstack@n-api.service[72088]: DEBUG dbcounter [-] [72088] Writing DB stats nova_cell1:SELECT=2 {{(pid=72088) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:21:48 user devstack@n-api.service[72088]: DEBUG nova.network.neutron [None req-ebce8406-fb4b-495c-8077-9faa681c5912 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] validate_networks() for [('e637d15d-90c0-48cc-8229-ffd26c0be8c6', None, None, None, None, None)] {{(pid=72088) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 11 19:21:50 user devstack@n-api.service[72088]: DEBUG nova.virt.hardware [None req-ebce8406-fb4b-495c-8077-9faa681c5912 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] Flavor limits 0:0:0 {{(pid=72088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 19:21:50 user devstack@n-api.service[72088]: DEBUG nova.virt.hardware [None req-ebce8406-fb4b-495c-8077-9faa681c5912 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] Image limits 0:0:0 {{(pid=72088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 19:21:50 user devstack@n-api.service[72088]: DEBUG nova.virt.hardware [None req-ebce8406-fb4b-495c-8077-9faa681c5912 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] Flavor pref 0:0:0 {{(pid=72088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 19:21:50 user devstack@n-api.service[72088]: DEBUG nova.virt.hardware [None req-ebce8406-fb4b-495c-8077-9faa681c5912 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] Image pref 0:0:0 {{(pid=72088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 19:21:50 user devstack@n-api.service[72088]: DEBUG nova.virt.hardware [None req-ebce8406-fb4b-495c-8077-9faa681c5912 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 19:21:50 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-ebce8406-fb4b-495c-8077-9faa681c5912 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:21:50 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-ebce8406-fb4b-495c-8077-9faa681c5912 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:21:50 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-ebce8406-fb4b-495c-8077-9faa681c5912 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:21:50 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-ebce8406-fb4b-495c-8077-9faa681c5912 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:21:50 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-ebce8406-fb4b-495c-8077-9faa681c5912 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:21:50 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-ebce8406-fb4b-495c-8077-9faa681c5912 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:21:50 user devstack@n-api.service[72088]: DEBUG nova.quota [None req-ebce8406-fb4b-495c-8077-9faa681c5912 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] Getting quotas for project 11ee7c68b277420ba524c2a99cd444ea. Resources: {'ram', 'instances', 'cores'} {{(pid=72088) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 19:21:50 user devstack@n-api.service[72088]: DEBUG nova.quota [None req-ebce8406-fb4b-495c-8077-9faa681c5912 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] Getting quotas for user 26f091a1508b4d2689005b660f6a1380 and project 11ee7c68b277420ba524c2a99cd444ea. Resources: {'ram', 'instances', 'cores'} {{(pid=72088) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 19:21:50 user devstack@n-api.service[72088]: DEBUG nova.compute.api [None req-ebce8406-fb4b-495c-8077-9faa681c5912 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] Going to run 1 instances... {{(pid=72088) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 11 19:21:50 user devstack@n-api.service[72088]: DEBUG nova.compute.api [None req-ebce8406-fb4b-495c-8077-9faa681c5912 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] [instance: aa0bb9aa-a93d-45bc-9f90-46eeb6416365] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=72088) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 11 19:21:50 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [None req-ebce8406-fb4b-495c-8077-9faa681c5912 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 2.232390 Apr 11 19:21:50 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 25/75] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 11 19:21:48 2023] POST /compute/v2.1/servers => generated 404 bytes in 2235 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 11 19:21:50 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [None req-390b1a56-c24e-4948-b6ef-4aba9d344f37 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] Calling method '>' {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:21:50 user devstack@n-api.service[72090]: DEBUG nova.compute.api [None req-390b1a56-c24e-4948-b6ef-4aba9d344f37 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] [instance: aa0bb9aa-a93d-45bc-9f90-46eeb6416365] Fetching instance by UUID {{(pid=72090) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:21:50 user devstack@n-api.service[72090]: DEBUG nova.policy [None req-390b1a56-c24e-4948-b6ef-4aba9d344f37 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26f091a1508b4d2689005b660f6a1380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ee7c68b277420ba524c2a99cd444ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72090) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:21:50 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [None req-390b1a56-c24e-4948-b6ef-4aba9d344f37 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] 10.0.0.210 "GET /compute/v2.1/servers/aa0bb9aa-a93d-45bc-9f90-46eeb6416365" status: 200 len: 1238 microversion: 2.1 time: 0.126278 Apr 11 19:21:50 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 25/76] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 19:21:50 2023] GET /compute/v2.1/servers/aa0bb9aa-a93d-45bc-9f90-46eeb6416365 => generated 1238 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:21:52 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [req-b8e776db-4646-4716-9736-7273550801d0 req-5abaabe2-e4c9-476e-877b-a9955381c045 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "efd7afec-d6d0-4e3f-a3b9-f672b3e711cf", "name": "network-vif-plugged", "status": "completed", "tag": "096d6451-049b-4ff5-9eaf-8ee3884c8715"}]} {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:21:52 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-b8e776db-4646-4716-9736-7273550801d0 req-5abaabe2-e4c9-476e-877b-a9955381c045 service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:21:52 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-b8e776db-4646-4716-9736-7273550801d0 req-5abaabe2-e4c9-476e-877b-a9955381c045 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:21:52 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-b8e776db-4646-4716-9736-7273550801d0 req-5abaabe2-e4c9-476e-877b-a9955381c045 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:21:52 user devstack@n-api.service[72089]: INFO nova.api.openstack.compute.server_external_events [req-b8e776db-4646-4716-9736-7273550801d0 req-5abaabe2-e4c9-476e-877b-a9955381c045 service nova] Creating event network-vif-plugged:096d6451-049b-4ff5-9eaf-8ee3884c8715 for instance efd7afec-d6d0-4e3f-a3b9-f672b3e711cf on user Apr 11 19:21:52 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [req-b8e776db-4646-4716-9736-7273550801d0 req-5abaabe2-e4c9-476e-877b-a9955381c045 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060755 Apr 11 19:21:52 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 27/77] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:21:52 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:21:52 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [req-fc2407b1-3791-4275-883e-1d0696cc4889 req-407c4af9-a564-443a-bc30-664d8ac417f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fc48e37f-8c00-4e48-bea3-f1c2e54d78b8", "name": "network-vif-plugged", "status": "completed", "tag": "b4beb6cf-d11a-487e-b95d-6adec8a8ee4d"}]} {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:21:52 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-fc2407b1-3791-4275-883e-1d0696cc4889 req-407c4af9-a564-443a-bc30-664d8ac417f6 service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:21:52 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-fc2407b1-3791-4275-883e-1d0696cc4889 req-407c4af9-a564-443a-bc30-664d8ac417f6 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:21:52 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-fc2407b1-3791-4275-883e-1d0696cc4889 req-407c4af9-a564-443a-bc30-664d8ac417f6 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:21:52 user devstack@n-api.service[72088]: INFO nova.api.openstack.compute.server_external_events [req-fc2407b1-3791-4275-883e-1d0696cc4889 req-407c4af9-a564-443a-bc30-664d8ac417f6 service nova] Creating event network-vif-plugged:b4beb6cf-d11a-487e-b95d-6adec8a8ee4d for instance fc48e37f-8c00-4e48-bea3-f1c2e54d78b8 on user Apr 11 19:21:52 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-fc2407b1-3791-4275-883e-1d0696cc4889 req-407c4af9-a564-443a-bc30-664d8ac417f6 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=72088) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}} Apr 11 19:21:52 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-fc2407b1-3791-4275-883e-1d0696cc4889 req-407c4af9-a564-443a-bc30-664d8ac417f6 service nova] Acquired lock "compute-rpcapi-router" {{(pid=72088) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}} Apr 11 19:21:52 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-58dad701-c59d-4812-a091-42d1b5543785 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:21:52 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-58dad701-c59d-4812-a091-42d1b5543785 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:21:52 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-58dad701-c59d-4812-a091-42d1b5543785 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:21:52 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-58dad701-c59d-4812-a091-42d1b5543785 None None] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:21:52 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-58dad701-c59d-4812-a091-42d1b5543785 None None] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:21:52 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-58dad701-c59d-4812-a091-42d1b5543785 None None] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:21:52 user devstack@n-api.service[72088]: INFO nova.compute.rpcapi [None req-58dad701-c59d-4812-a091-42d1b5543785 None None] Automatically selected compute RPC version 6.2 from minimum service version 66 Apr 11 19:21:52 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-58dad701-c59d-4812-a091-42d1b5543785 None None] Releasing lock "compute-rpcapi-router" {{(pid=72088) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}} Apr 11 19:21:52 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [None req-58dad701-c59d-4812-a091-42d1b5543785 None None] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.296257 Apr 11 19:21:52 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 26/78] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:21:52 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:21:54 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [req-f07a72fb-56e4-402e-8957-a7d4dd8feed5 req-00c6428f-1237-48ac-8a1b-c82de30bcdf4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "efd7afec-d6d0-4e3f-a3b9-f672b3e711cf", "name": "network-vif-plugged", "status": "completed", "tag": "096d6451-049b-4ff5-9eaf-8ee3884c8715"}]} {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:21:54 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-f07a72fb-56e4-402e-8957-a7d4dd8feed5 req-00c6428f-1237-48ac-8a1b-c82de30bcdf4 service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:21:54 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-f07a72fb-56e4-402e-8957-a7d4dd8feed5 req-00c6428f-1237-48ac-8a1b-c82de30bcdf4 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:21:54 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-f07a72fb-56e4-402e-8957-a7d4dd8feed5 req-00c6428f-1237-48ac-8a1b-c82de30bcdf4 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:21:54 user devstack@n-api.service[72090]: INFO nova.api.openstack.compute.server_external_events [req-f07a72fb-56e4-402e-8957-a7d4dd8feed5 req-00c6428f-1237-48ac-8a1b-c82de30bcdf4 service nova] Creating event network-vif-plugged:096d6451-049b-4ff5-9eaf-8ee3884c8715 for instance efd7afec-d6d0-4e3f-a3b9-f672b3e711cf on user Apr 11 19:21:54 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [req-f07a72fb-56e4-402e-8957-a7d4dd8feed5 req-00c6428f-1237-48ac-8a1b-c82de30bcdf4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064366 Apr 11 19:21:54 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 26/79] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:21:54 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:21:54 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [req-24eff254-cf1c-4ad1-b1cb-027bb99ce5ad req-4acaf707-e485-43e9-9abb-9ac08761f5eb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bed4001c-02c2-4c6b-84c8-61654df66d8b", "tag": "b644e09b-afb0-43e7-9773-0df435010320"}, {"server_uuid": "fc48e37f-8c00-4e48-bea3-f1c2e54d78b8", "name": "network-vif-plugged", "status": "completed", "tag": "b4beb6cf-d11a-487e-b95d-6adec8a8ee4d"}]} {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:21:54 user devstack@n-api.service[72089]: DEBUG dbcounter [-] [72089] Writing DB stats nova_cell0:SELECT=12 {{(pid=72089) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:21:54 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-24eff254-cf1c-4ad1-b1cb-027bb99ce5ad req-4acaf707-e485-43e9-9abb-9ac08761f5eb service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:21:54 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-24eff254-cf1c-4ad1-b1cb-027bb99ce5ad req-4acaf707-e485-43e9-9abb-9ac08761f5eb service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:21:54 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-24eff254-cf1c-4ad1-b1cb-027bb99ce5ad req-4acaf707-e485-43e9-9abb-9ac08761f5eb service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:21:54 user devstack@n-api.service[72089]: INFO nova.api.openstack.compute.server_external_events [req-24eff254-cf1c-4ad1-b1cb-027bb99ce5ad req-4acaf707-e485-43e9-9abb-9ac08761f5eb service nova] Creating event network-changed:b644e09b-afb0-43e7-9773-0df435010320 for instance bed4001c-02c2-4c6b-84c8-61654df66d8b on user Apr 11 19:21:54 user devstack@n-api.service[72089]: INFO nova.api.openstack.compute.server_external_events [req-24eff254-cf1c-4ad1-b1cb-027bb99ce5ad req-4acaf707-e485-43e9-9abb-9ac08761f5eb service nova] Creating event network-vif-plugged:b4beb6cf-d11a-487e-b95d-6adec8a8ee4d for instance fc48e37f-8c00-4e48-bea3-f1c2e54d78b8 on user Apr 11 19:21:54 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [req-24eff254-cf1c-4ad1-b1cb-027bb99ce5ad req-4acaf707-e485-43e9-9abb-9ac08761f5eb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.068239 Apr 11 19:21:54 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 28/80] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:21:54 2023] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:21:57 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [req-3a32bf8e-96c8-450e-902a-67ca3cf4a385 req-e9a3a4e5-21ee-4a8d-ad7a-5ff39706088f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bed4001c-02c2-4c6b-84c8-61654df66d8b", "name": "network-vif-plugged", "status": "completed", "tag": "b644e09b-afb0-43e7-9773-0df435010320"}]} {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:21:57 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-3a32bf8e-96c8-450e-902a-67ca3cf4a385 req-e9a3a4e5-21ee-4a8d-ad7a-5ff39706088f service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:21:57 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-3a32bf8e-96c8-450e-902a-67ca3cf4a385 req-e9a3a4e5-21ee-4a8d-ad7a-5ff39706088f service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:21:57 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-3a32bf8e-96c8-450e-902a-67ca3cf4a385 req-e9a3a4e5-21ee-4a8d-ad7a-5ff39706088f service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:21:57 user devstack@n-api.service[72088]: INFO nova.api.openstack.compute.server_external_events [req-3a32bf8e-96c8-450e-902a-67ca3cf4a385 req-e9a3a4e5-21ee-4a8d-ad7a-5ff39706088f service nova] Creating event network-vif-plugged:b644e09b-afb0-43e7-9773-0df435010320 for instance bed4001c-02c2-4c6b-84c8-61654df66d8b on user Apr 11 19:21:57 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [req-3a32bf8e-96c8-450e-902a-67ca3cf4a385 req-e9a3a4e5-21ee-4a8d-ad7a-5ff39706088f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059235 Apr 11 19:21:57 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 27/81] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:21:57 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:21:59 user devstack@n-api.service[72090]: DEBUG dbcounter [-] [72090] Writing DB stats nova_cell0:SELECT=4 {{(pid=72090) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:21:59 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [req-9f5fe43a-bd79-4673-b3e5-88982b9722c4 req-ed78d362-51b6-489d-9d8c-03c69bb83ce8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bed4001c-02c2-4c6b-84c8-61654df66d8b", "name": "network-vif-plugged", "status": "completed", "tag": "b644e09b-afb0-43e7-9773-0df435010320"}]} {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:21:59 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-9f5fe43a-bd79-4673-b3e5-88982b9722c4 req-ed78d362-51b6-489d-9d8c-03c69bb83ce8 service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:21:59 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-9f5fe43a-bd79-4673-b3e5-88982b9722c4 req-ed78d362-51b6-489d-9d8c-03c69bb83ce8 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:21:59 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-9f5fe43a-bd79-4673-b3e5-88982b9722c4 req-ed78d362-51b6-489d-9d8c-03c69bb83ce8 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:21:59 user devstack@n-api.service[72090]: INFO nova.api.openstack.compute.server_external_events [req-9f5fe43a-bd79-4673-b3e5-88982b9722c4 req-ed78d362-51b6-489d-9d8c-03c69bb83ce8 service nova] Creating event network-vif-plugged:b644e09b-afb0-43e7-9773-0df435010320 for instance bed4001c-02c2-4c6b-84c8-61654df66d8b on user Apr 11 19:21:59 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [req-9f5fe43a-bd79-4673-b3e5-88982b9722c4 req-ed78d362-51b6-489d-9d8c-03c69bb83ce8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.127577 Apr 11 19:21:59 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 27/82] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:21:59 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:22:00 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [req-5397c6be-900e-4af2-99e4-92ace345a422 req-71b1e2f6-0588-4bf6-9391-94ab63b9611c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aa0bb9aa-a93d-45bc-9f90-46eeb6416365", "tag": "5a15e207-1839-4be5-80b2-fc995098dbbf"}]} {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:22:00 user devstack@n-api.service[72089]: DEBUG dbcounter [-] [72089] Writing DB stats nova_cell0:SELECT=4 {{(pid=72089) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:22:00 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-5397c6be-900e-4af2-99e4-92ace345a422 req-71b1e2f6-0588-4bf6-9391-94ab63b9611c service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:22:00 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-5397c6be-900e-4af2-99e4-92ace345a422 req-71b1e2f6-0588-4bf6-9391-94ab63b9611c service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:22:00 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-5397c6be-900e-4af2-99e4-92ace345a422 req-71b1e2f6-0588-4bf6-9391-94ab63b9611c service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:22:00 user devstack@n-api.service[72089]: INFO nova.api.openstack.compute.server_external_events [req-5397c6be-900e-4af2-99e4-92ace345a422 req-71b1e2f6-0588-4bf6-9391-94ab63b9611c service nova] Creating event network-changed:5a15e207-1839-4be5-80b2-fc995098dbbf for instance aa0bb9aa-a93d-45bc-9f90-46eeb6416365 on user Apr 11 19:22:00 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [req-5397c6be-900e-4af2-99e4-92ace345a422 req-71b1e2f6-0588-4bf6-9391-94ab63b9611c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066099 Apr 11 19:22:00 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 29/83] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:22:00 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:22:04 user devstack@n-api.service[72088]: DEBUG dbcounter [-] [72088] Writing DB stats nova_cell0:SELECT=16 {{(pid=72088) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:22:04 user devstack@n-api.service[72088]: DEBUG dbcounter [-] [72088] Writing DB stats nova_cell0:SELECT=4 {{(pid=72088) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:22:04 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [req-bf10d6eb-ca72-4a67-85e8-99e70e5d3f19 req-bb60d0a3-4764-4c42-924d-c0294df897a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa0bb9aa-a93d-45bc-9f90-46eeb6416365", "name": "network-vif-plugged", "status": "completed", "tag": "5a15e207-1839-4be5-80b2-fc995098dbbf"}]} {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:22:04 user devstack@n-api.service[72088]: DEBUG dbcounter [-] [72088] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=6 {{(pid=72088) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:22:05 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-bf10d6eb-ca72-4a67-85e8-99e70e5d3f19 req-bb60d0a3-4764-4c42-924d-c0294df897a3 service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:22:05 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-bf10d6eb-ca72-4a67-85e8-99e70e5d3f19 req-bb60d0a3-4764-4c42-924d-c0294df897a3 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:22:05 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-bf10d6eb-ca72-4a67-85e8-99e70e5d3f19 req-bb60d0a3-4764-4c42-924d-c0294df897a3 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:22:05 user devstack@n-api.service[72088]: INFO nova.api.openstack.compute.server_external_events [req-bf10d6eb-ca72-4a67-85e8-99e70e5d3f19 req-bb60d0a3-4764-4c42-924d-c0294df897a3 service nova] Creating event network-vif-plugged:5a15e207-1839-4be5-80b2-fc995098dbbf for instance aa0bb9aa-a93d-45bc-9f90-46eeb6416365 on user Apr 11 19:22:05 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [req-bf10d6eb-ca72-4a67-85e8-99e70e5d3f19 req-bb60d0a3-4764-4c42-924d-c0294df897a3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094437 Apr 11 19:22:05 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 28/84] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:22:04 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:22:05 user devstack@n-api.service[72090]: DEBUG dbcounter [-] [72090] Writing DB stats nova_cell0:SELECT=12 {{(pid=72090) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:22:05 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [None req-40f881a3-116d-4456-ae89-b14e1e206310 tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] Action: 'create', calling method: .version_select at 0x7f119e08e710>, body: {"keypair": {"name": "tempest-keypair-1434827992", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBENNIAFAXgldDZ23gkfsz1j1aOWnEH0MZh4aSHSnn1OZB1BmGyYdsPQXM8u6LOOszDd5job+4SPRJzI9j1CzY2ryRwaV1faRl+V6jcoViXB4uLPiI16HL/Vfx/IZpK+Nsg=="}} {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:22:05 user devstack@n-api.service[72090]: DEBUG dbcounter [-] [72090] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=4 {{(pid=72090) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:22:05 user devstack@n-api.service[72090]: DEBUG nova.quota [None req-40f881a3-116d-4456-ae89-b14e1e206310 tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] Getting quotas for project f4c6f64ecc104480a149bcfd0610dfef. Resources: {'key_pairs'} {{(pid=72090) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 19:22:05 user devstack@n-api.service[72090]: DEBUG nova.quota [None req-40f881a3-116d-4456-ae89-b14e1e206310 tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] Getting quotas for user 26555f273c374f9ba0ed151d2f1cbaef and project f4c6f64ecc104480a149bcfd0610dfef. Resources: {'key_pairs'} {{(pid=72090) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 19:22:06 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [None req-40f881a3-116d-4456-ae89-b14e1e206310 tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.638664 Apr 11 19:22:06 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 28/85] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Apr 11 19:22:05 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:22:07 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [req-7630ec0e-cee4-4ad2-b689-3a0816e70f34 req-f28cb49a-c36a-4329-93ee-eb0febf99a53 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa0bb9aa-a93d-45bc-9f90-46eeb6416365", "name": "network-vif-plugged", "status": "completed", "tag": "5a15e207-1839-4be5-80b2-fc995098dbbf"}]} {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:22:07 user devstack@n-api.service[72089]: DEBUG dbcounter [-] [72089] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=4 {{(pid=72089) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:22:07 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-7630ec0e-cee4-4ad2-b689-3a0816e70f34 req-f28cb49a-c36a-4329-93ee-eb0febf99a53 service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:22:07 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-7630ec0e-cee4-4ad2-b689-3a0816e70f34 req-f28cb49a-c36a-4329-93ee-eb0febf99a53 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:22:07 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-7630ec0e-cee4-4ad2-b689-3a0816e70f34 req-f28cb49a-c36a-4329-93ee-eb0febf99a53 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:22:07 user devstack@n-api.service[72089]: INFO nova.api.openstack.compute.server_external_events [req-7630ec0e-cee4-4ad2-b689-3a0816e70f34 req-f28cb49a-c36a-4329-93ee-eb0febf99a53 service nova] Creating event network-vif-plugged:5a15e207-1839-4be5-80b2-fc995098dbbf for instance aa0bb9aa-a93d-45bc-9f90-46eeb6416365 on user Apr 11 19:22:07 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [req-7630ec0e-cee4-4ad2-b689-3a0816e70f34 req-f28cb49a-c36a-4329-93ee-eb0febf99a53 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059164 Apr 11 19:22:07 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 30/86] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:22:07 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:22:07 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [None req-724a0902-43e9-4078-a0a1-57477384f12e tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] Action: 'create', calling method: .version_select at 0x7f119e03b1c0>, body: {"keypair": {"name": "tempest-keypair-1479395347", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMAzMdMSQLLiV3JpjVwmLTTmwbzkoJeV6SA3UR8oDreyp/7jf42SjayBVPZUVEXJCuPvBauTtzXHflWxGcTjSNelxaY2xGUn/tnq1c/9lLP/bJj0WIjeFFfa+9CmZIz9FA=="}} {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:22:07 user devstack@n-api.service[72088]: DEBUG nova.quota [None req-724a0902-43e9-4078-a0a1-57477384f12e tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] Getting quotas for project e9f8ee2edca748e0bd03ace6f93be649. Resources: {'key_pairs'} {{(pid=72088) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 19:22:07 user devstack@n-api.service[72088]: DEBUG nova.quota [None req-724a0902-43e9-4078-a0a1-57477384f12e tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] Getting quotas for user 24e95f55f8f9497592320a19f2ca7fb8 and project e9f8ee2edca748e0bd03ace6f93be649. Resources: {'key_pairs'} {{(pid=72088) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 19:22:07 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [None req-724a0902-43e9-4078-a0a1-57477384f12e tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.131667 Apr 11 19:22:07 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 29/87] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Apr 11 19:22:07 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:22:09 user devstack@n-api.service[72090]: DEBUG dbcounter [-] [72090] Writing DB stats nova_cell1:SELECT=10 {{(pid=72090) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:22:09 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [None req-b9588cf8-74a8-44a9-9ebf-715275ff8aa1 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] Action: 'create', calling method: .version_select at 0x7f119e08f520>, body: {"keypair": {"name": "tempest-keypair-791454951", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIyckVm5q0K/VWofCbMcEV46KQZxBj3ALqxEq1WGPCmcfHfh7/cOxJHS+Hv+mvtlg5mQG1fMlQSB7wNEnw7JVo1xfMS0/PlorNNkjUUfy3JiEb0Ab+MsHcBaiy3VJowOJw=="}} {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:22:09 user devstack@n-api.service[72090]: DEBUG nova.quota [None req-b9588cf8-74a8-44a9-9ebf-715275ff8aa1 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] Getting quotas for project 1afa97b49ae647c899a05d54b7f0f16b. Resources: {'key_pairs'} {{(pid=72090) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 19:22:09 user devstack@n-api.service[72090]: DEBUG nova.quota [None req-b9588cf8-74a8-44a9-9ebf-715275ff8aa1 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] Getting quotas for user 2f44f0d0807342ba9b851e7530a82294 and project 1afa97b49ae647c899a05d54b7f0f16b. Resources: {'key_pairs'} {{(pid=72090) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 19:22:09 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [None req-b9588cf8-74a8-44a9-9ebf-715275ff8aa1 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.42 time: 0.153908 Apr 11 19:22:09 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 29/88] 10.0.0.210 () {66 vars in 1277 bytes} [Tue Apr 11 19:22:09 2023] POST /compute/v2.1/os-keypairs => generated 400 bytes in 159 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Apr 11 19:22:10 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [None req-a8156b66-76f0-459f-821d-767c6e9f4913 tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachSCSIVolumeTestJSON-server-1588512874", "imageRef": "8ddd1597-acbd-47c5-9492-af80f88fdca1", "flavorRef": "42", "config_drive": true, "networks": [{"uuid": "a4f38bbd-d96e-48df-855f-7eff4d122089"}], "security_groups": [{"name": "tempest-securitygroup--1442118119"}], "key_name": "tempest-keypair-1434827992", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:22:11 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [None req-7ddaea4e-7f3b-4eb3-9854-b4903e1c1926 tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] Action: 'create', calling method: .version_select at 0x7f119e9eb2e0>, body: {"keypair": {"name": "tempest-keypair-837441637", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBODsmyLx9btIMCYnKduEXVz7JAuk7UhzzERb5FI4FKe+6s/Du4EGpizaOPcFRAe03vOmbzTlXTZKfjibJnH2fbJO2ZanWvJcEb81dDY4qGyrsZxZsx7z4jkiSNbg+OQg3w=="}} {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:22:11 user devstack@n-api.service[72088]: DEBUG nova.quota [None req-7ddaea4e-7f3b-4eb3-9854-b4903e1c1926 tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] Getting quotas for project f153e6b272924b8fa0ef28fb5f0970bb. Resources: {'key_pairs'} {{(pid=72088) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 19:22:11 user devstack@n-api.service[72088]: DEBUG nova.quota [None req-7ddaea4e-7f3b-4eb3-9854-b4903e1c1926 tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] Getting quotas for user 54b4a383f04d4269a0099a738e14807e and project f153e6b272924b8fa0ef28fb5f0970bb. Resources: {'key_pairs'} {{(pid=72088) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 19:22:11 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [None req-7ddaea4e-7f3b-4eb3-9854-b4903e1c1926 tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.246859 Apr 11 19:22:11 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 30/89] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Apr 11 19:22:11 2023] POST /compute/v2.1/os-keypairs => generated 385 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:22:11 user devstack@n-api.service[72089]: DEBUG nova.network.neutron [None req-a8156b66-76f0-459f-821d-767c6e9f4913 tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] validate_networks() for [('a4f38bbd-d96e-48df-855f-7eff4d122089', None, None, None, None, None)] {{(pid=72089) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 11 19:22:12 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [None req-6c7e8024-5649-40b6-b7e1-b8340618e3c1 tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeSwap-server-1592033128", "imageRef": "4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b", "flavorRef": "42", "networks": [{"uuid": "f46874c2-3c80-4650-be3d-22d674b93195"}], "security_groups": [{"name": "tempest-securitygroup--360781840"}], "key_name": "tempest-keypair-1479395347", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:22:12 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [None req-7bd73526-96c4-4492-884f-f570f1651e09 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-2047298222", "imageRef": "4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b", "flavorRef": "42", "config_drive": true, "networks": [{"uuid": "17e7d3c3-aefe-4aac-82cb-be854d82b261"}, {"port": "4768cc5b-e792-4c52-805a-7f288ed9fbe5", "tag": "port-1"}, {"port": "1d14016e-af6d-4ce8-bd51-8a9dba7c4261", "tag": "port-2"}, {"uuid": "6a9ec2be-6611-45ca-8b5d-d038014f5fd1", "tag": "net-1"}, {"uuid": "6a9ec2be-6611-45ca-8b5d-d038014f5fd1"}, {"uuid": "cd5b7d14-5fc8-4029-82c0-4f44b7c7a975", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "cd5b7d14-5fc8-4029-82c0-4f44b7c7a975", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "a38d7c75-168f-480e-8f42-0c2606086f09", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "125a0bcb-5bbf-4fa8-81f5-f9054a4a2235", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "0b6fb879-bd91-4f68-a952-095dadc5eaef", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--275193064"}], "key_name": "tempest-keypair-791454951", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:22:13 user devstack@n-api.service[72090]: DEBUG nova.network.neutron [None req-6c7e8024-5649-40b6-b7e1-b8340618e3c1 tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] validate_networks() for [('f46874c2-3c80-4650-be3d-22d674b93195', None, None, None, None, None)] {{(pid=72090) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 11 19:22:13 user devstack@n-api.service[72089]: DEBUG nova.virt.hardware [None req-a8156b66-76f0-459f-821d-767c6e9f4913 tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] Flavor limits 0:0:0 {{(pid=72089) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 19:22:13 user devstack@n-api.service[72089]: DEBUG nova.virt.hardware [None req-a8156b66-76f0-459f-821d-767c6e9f4913 tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] Image limits 0:0:0 {{(pid=72089) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 19:22:13 user devstack@n-api.service[72089]: DEBUG nova.virt.hardware [None req-a8156b66-76f0-459f-821d-767c6e9f4913 tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] Flavor pref 0:0:0 {{(pid=72089) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 19:22:13 user devstack@n-api.service[72089]: DEBUG nova.virt.hardware [None req-a8156b66-76f0-459f-821d-767c6e9f4913 tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] Image pref 0:0:0 {{(pid=72089) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 19:22:13 user devstack@n-api.service[72089]: DEBUG nova.virt.hardware [None req-a8156b66-76f0-459f-821d-767c6e9f4913 tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72089) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 19:22:13 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-a8156b66-76f0-459f-821d-767c6e9f4913 tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:22:13 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-a8156b66-76f0-459f-821d-767c6e9f4913 tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:22:13 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-a8156b66-76f0-459f-821d-767c6e9f4913 tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:22:13 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-a8156b66-76f0-459f-821d-767c6e9f4913 tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:22:13 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-a8156b66-76f0-459f-821d-767c6e9f4913 tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:22:13 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-a8156b66-76f0-459f-821d-767c6e9f4913 tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:22:13 user devstack@n-api.service[72089]: DEBUG dbcounter [-] [72089] Writing DB stats nova_cell1:SELECT=15 {{(pid=72089) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:22:13 user devstack@n-api.service[72089]: DEBUG nova.quota [None req-a8156b66-76f0-459f-821d-767c6e9f4913 tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] Getting quotas for project f4c6f64ecc104480a149bcfd0610dfef. Resources: {'ram', 'instances', 'cores'} {{(pid=72089) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 19:22:13 user devstack@n-api.service[72089]: DEBUG nova.quota [None req-a8156b66-76f0-459f-821d-767c6e9f4913 tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] Getting quotas for user 26555f273c374f9ba0ed151d2f1cbaef and project f4c6f64ecc104480a149bcfd0610dfef. Resources: {'ram', 'instances', 'cores'} {{(pid=72089) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 19:22:13 user devstack@n-api.service[72089]: DEBUG nova.compute.api [None req-a8156b66-76f0-459f-821d-767c6e9f4913 tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] Going to run 1 instances... {{(pid=72089) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 11 19:22:13 user devstack@n-api.service[72089]: DEBUG nova.compute.api [None req-a8156b66-76f0-459f-821d-767c6e9f4913 tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] [instance: 1ded3918-3bae-465c-a53c-e88011914c50] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8ddd1597-acbd-47c5-9492-af80f88fdca1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=72089) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 11 19:22:13 user devstack@n-api.service[72088]: DEBUG nova.network.neutron [None req-7bd73526-96c4-4492-884f-f570f1651e09 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] validate_networks() for [('17e7d3c3-aefe-4aac-82cb-be854d82b261', None, None, None, None, None), (None, None, '4768cc5b-e792-4c52-805a-7f288ed9fbe5', None, None, None), (None, None, '1d14016e-af6d-4ce8-bd51-8a9dba7c4261', None, None, None), ('6a9ec2be-6611-45ca-8b5d-d038014f5fd1', None, None, None, None, None), ('6a9ec2be-6611-45ca-8b5d-d038014f5fd1', None, None, None, None, None), ('cd5b7d14-5fc8-4029-82c0-4f44b7c7a975', '10.2.2.100', None, None, None, None), ('cd5b7d14-5fc8-4029-82c0-4f44b7c7a975', '10.2.2.200', None, None, None, None)] {{(pid=72088) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 11 19:22:13 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [None req-a8156b66-76f0-459f-821d-767c6e9f4913 tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 2.452570 Apr 11 19:22:13 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 31/90] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 11 19:22:10 2023] POST /compute/v2.1/servers => generated 404 bytes in 2455 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 11 19:22:13 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [None req-951a76ae-65f4-4bb0-aa27-3db2d64b2bd1 tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] Calling method '>' {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:22:13 user devstack@n-api.service[72089]: DEBUG nova.compute.api [None req-951a76ae-65f4-4bb0-aa27-3db2d64b2bd1 tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] [instance: 1ded3918-3bae-465c-a53c-e88011914c50] Fetching instance by UUID {{(pid=72089) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:22:13 user devstack@n-api.service[72089]: DEBUG nova.policy [None req-951a76ae-65f4-4bb0-aa27-3db2d64b2bd1 tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26555f273c374f9ba0ed151d2f1cbaef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4c6f64ecc104480a149bcfd0610dfef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72089) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:22:13 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [None req-951a76ae-65f4-4bb0-aa27-3db2d64b2bd1 tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1ded3918-3bae-465c-a53c-e88011914c50" status: 200 len: 1240 microversion: 2.1 time: 0.102099 Apr 11 19:22:13 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 32/91] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 19:22:13 2023] GET /compute/v2.1/servers/1ded3918-3bae-465c-a53c-e88011914c50 => generated 1240 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:22:13 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [None req-8afd0b2e-1ad2-4b3b-b21d-d2c473c3d7aa tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] Action: 'create', calling method: .version_select at 0x7f119df01bd0>, body: {"keypair": {"name": "tempest-keypair-1575443570", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNkMpWQuEm1Fv+W/mgY2OYSpggOfZUkoqqxBP4ppJK2h2yfEMM/I7umHLLvv+GHOLnvt+9wKNIfVoID5wNvYw3ZjffzrYq9zAWGLTOYlDtqreEy1EmtTM6C5cfTlcrcO1Q=="}} {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:22:13 user devstack@n-api.service[72089]: DEBUG nova.quota [None req-8afd0b2e-1ad2-4b3b-b21d-d2c473c3d7aa tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] Getting quotas for project f39e7fdf571442b0a6f136020a99f7fb. Resources: {'key_pairs'} {{(pid=72089) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 19:22:13 user devstack@n-api.service[72089]: DEBUG nova.quota [None req-8afd0b2e-1ad2-4b3b-b21d-d2c473c3d7aa tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] Getting quotas for user 2f84e7cbdf6a4e588753fea907beba0c and project f39e7fdf571442b0a6f136020a99f7fb. Resources: {'key_pairs'} {{(pid=72089) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 19:22:13 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [None req-8afd0b2e-1ad2-4b3b-b21d-d2c473c3d7aa tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.49 time: 0.081595 Apr 11 19:22:13 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 33/92] 10.0.0.210 () {66 vars in 1277 bytes} [Tue Apr 11 19:22:13 2023] POST /compute/v2.1/os-keypairs => generated 401 bytes in 84 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Apr 11 19:22:14 user devstack@n-api.service[72090]: DEBUG nova.virt.hardware [None req-6c7e8024-5649-40b6-b7e1-b8340618e3c1 tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] Flavor limits 0:0:0 {{(pid=72090) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 19:22:14 user devstack@n-api.service[72090]: DEBUG nova.virt.hardware [None req-6c7e8024-5649-40b6-b7e1-b8340618e3c1 tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] Image limits 0:0:0 {{(pid=72090) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 19:22:14 user devstack@n-api.service[72090]: DEBUG nova.virt.hardware [None req-6c7e8024-5649-40b6-b7e1-b8340618e3c1 tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] Flavor pref 0:0:0 {{(pid=72090) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 19:22:14 user devstack@n-api.service[72090]: DEBUG nova.virt.hardware [None req-6c7e8024-5649-40b6-b7e1-b8340618e3c1 tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] Image pref 0:0:0 {{(pid=72090) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 19:22:14 user devstack@n-api.service[72090]: DEBUG nova.virt.hardware [None req-6c7e8024-5649-40b6-b7e1-b8340618e3c1 tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72090) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 19:22:14 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-6c7e8024-5649-40b6-b7e1-b8340618e3c1 tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:22:14 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-6c7e8024-5649-40b6-b7e1-b8340618e3c1 tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:22:14 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-6c7e8024-5649-40b6-b7e1-b8340618e3c1 tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:22:14 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-6c7e8024-5649-40b6-b7e1-b8340618e3c1 tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:22:14 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-6c7e8024-5649-40b6-b7e1-b8340618e3c1 tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:22:14 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-6c7e8024-5649-40b6-b7e1-b8340618e3c1 tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:22:14 user devstack@n-api.service[72090]: DEBUG nova.quota [None req-6c7e8024-5649-40b6-b7e1-b8340618e3c1 tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] Getting quotas for project e9f8ee2edca748e0bd03ace6f93be649. Resources: {'ram', 'instances', 'cores'} {{(pid=72090) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 19:22:14 user devstack@n-api.service[72090]: DEBUG nova.quota [None req-6c7e8024-5649-40b6-b7e1-b8340618e3c1 tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] Getting quotas for user 24e95f55f8f9497592320a19f2ca7fb8 and project e9f8ee2edca748e0bd03ace6f93be649. Resources: {'ram', 'instances', 'cores'} {{(pid=72090) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 19:22:14 user devstack@n-api.service[72090]: DEBUG nova.compute.api [None req-6c7e8024-5649-40b6-b7e1-b8340618e3c1 tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] Going to run 1 instances... {{(pid=72090) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 11 19:22:14 user devstack@n-api.service[72090]: DEBUG nova.compute.api [None req-6c7e8024-5649-40b6-b7e1-b8340618e3c1 tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] [instance: a49d379e-3976-4d68-b6df-f572a922107c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=72090) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 11 19:22:14 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [None req-6c7e8024-5649-40b6-b7e1-b8340618e3c1 tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 1.693724 Apr 11 19:22:14 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 30/93] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 11 19:22:12 2023] POST /compute/v2.1/servers => generated 403 bytes in 1695 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Apr 11 19:22:14 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [None req-4a8e310d-ba66-4e5b-94be-d798d02c4247 tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] Calling method '>' {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:22:14 user devstack@n-api.service[72089]: DEBUG nova.compute.api [None req-4a8e310d-ba66-4e5b-94be-d798d02c4247 tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] [instance: a49d379e-3976-4d68-b6df-f572a922107c] Fetching instance by UUID {{(pid=72089) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:22:14 user devstack@n-api.service[72089]: DEBUG nova.policy [None req-4a8e310d-ba66-4e5b-94be-d798d02c4247 tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e95f55f8f9497592320a19f2ca7fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9f8ee2edca748e0bd03ace6f93be649', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72089) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:22:14 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [None req-4a8e310d-ba66-4e5b-94be-d798d02c4247 tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a49d379e-3976-4d68-b6df-f572a922107c" status: 200 len: 1226 microversion: 2.1 time: 0.069371 Apr 11 19:22:14 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 34/94] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 19:22:14 2023] GET /compute/v2.1/servers/a49d379e-3976-4d68-b6df-f572a922107c => generated 1226 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:22:14 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [None req-7f078375-7ee9-4891-890a-1d90d2db16d8 tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-998535947", "imageRef": "4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b", "flavorRef": "42", "networks": [{"uuid": "c4faff63-06aa-4a91-8681-e5d654e5da93"}], "security_groups": [{"name": "tempest-securitygroup--1048807034"}], "key_name": "tempest-keypair-837441637", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:22:14 user devstack@n-api.service[72090]: DEBUG nova.network.neutron [None req-7f078375-7ee9-4891-890a-1d90d2db16d8 tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] validate_networks() for [('c4faff63-06aa-4a91-8681-e5d654e5da93', None, None, None, None, None)] {{(pid=72090) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 11 19:22:15 user devstack@n-api.service[72088]: DEBUG dbcounter [-] [72088] Writing DB stats nova_cell1:SELECT=10 {{(pid=72088) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:22:15 user devstack@n-api.service[72090]: DEBUG nova.virt.hardware [None req-7f078375-7ee9-4891-890a-1d90d2db16d8 tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] Flavor limits 0:0:0 {{(pid=72090) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 19:22:15 user devstack@n-api.service[72090]: DEBUG nova.virt.hardware [None req-7f078375-7ee9-4891-890a-1d90d2db16d8 tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] Image limits 0:0:0 {{(pid=72090) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 19:22:15 user devstack@n-api.service[72090]: DEBUG nova.virt.hardware [None req-7f078375-7ee9-4891-890a-1d90d2db16d8 tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] Flavor pref 0:0:0 {{(pid=72090) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 19:22:15 user devstack@n-api.service[72090]: DEBUG nova.virt.hardware [None req-7f078375-7ee9-4891-890a-1d90d2db16d8 tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] Image pref 0:0:0 {{(pid=72090) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 19:22:15 user devstack@n-api.service[72090]: DEBUG nova.virt.hardware [None req-7f078375-7ee9-4891-890a-1d90d2db16d8 tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72090) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 19:22:15 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-7f078375-7ee9-4891-890a-1d90d2db16d8 tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:22:15 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-7f078375-7ee9-4891-890a-1d90d2db16d8 tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:22:15 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-7f078375-7ee9-4891-890a-1d90d2db16d8 tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:22:15 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-7f078375-7ee9-4891-890a-1d90d2db16d8 tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:22:15 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-7f078375-7ee9-4891-890a-1d90d2db16d8 tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:22:15 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-7f078375-7ee9-4891-890a-1d90d2db16d8 tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:22:15 user devstack@n-api.service[72090]: DEBUG nova.quota [None req-7f078375-7ee9-4891-890a-1d90d2db16d8 tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] Getting quotas for project f153e6b272924b8fa0ef28fb5f0970bb. Resources: {'ram', 'instances', 'cores'} {{(pid=72090) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 19:22:15 user devstack@n-api.service[72090]: DEBUG nova.quota [None req-7f078375-7ee9-4891-890a-1d90d2db16d8 tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] Getting quotas for user 54b4a383f04d4269a0099a738e14807e and project f153e6b272924b8fa0ef28fb5f0970bb. Resources: {'ram', 'instances', 'cores'} {{(pid=72090) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 19:22:15 user devstack@n-api.service[72090]: DEBUG nova.compute.api [None req-7f078375-7ee9-4891-890a-1d90d2db16d8 tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] Going to run 1 instances... {{(pid=72090) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 11 19:22:15 user devstack@n-api.service[72090]: DEBUG nova.compute.api [None req-7f078375-7ee9-4891-890a-1d90d2db16d8 tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] [instance: 9941d033-15c2-4069-b9a6-f80840e95a38] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=72090) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 11 19:22:15 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [None req-7f078375-7ee9-4891-890a-1d90d2db16d8 tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 1.003103 Apr 11 19:22:15 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 31/95] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 11 19:22:14 2023] POST /compute/v2.1/servers => generated 404 bytes in 1004 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 11 19:22:15 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [None req-53106763-2b14-4f22-a559-f71dce2496d5 tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] Calling method '>' {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:22:15 user devstack@n-api.service[72089]: DEBUG nova.compute.api [None req-53106763-2b14-4f22-a559-f71dce2496d5 tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] [instance: 9941d033-15c2-4069-b9a6-f80840e95a38] Fetching instance by UUID {{(pid=72089) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:22:15 user devstack@n-api.service[72089]: DEBUG nova.policy [None req-53106763-2b14-4f22-a559-f71dce2496d5 tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b4a383f04d4269a0099a738e14807e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f153e6b272924b8fa0ef28fb5f0970bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72089) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:22:15 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [None req-53106763-2b14-4f22-a559-f71dce2496d5 tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9941d033-15c2-4069-b9a6-f80840e95a38" status: 200 len: 1234 microversion: 2.1 time: 0.152538 Apr 11 19:22:15 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 35/96] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 19:22:15 2023] GET /compute/v2.1/servers/9941d033-15c2-4069-b9a6-f80840e95a38 => generated 1234 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:22:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [None req-550052ab-f7e6-4eba-9439-95afd6559901 tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-1612946736", "imageRef": "4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b", "flavorRef": "42", "config_drive": true, "networks": [{"uuid": "b8acbf9d-6e60-4540-9c11-751b6c4fac3a"}], "security_groups": [{"name": "tempest-securitygroup--512315595"}], "key_name": "tempest-keypair-1575443570", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:22:17 user devstack@n-api.service[72088]: DEBUG nova.virt.hardware [None req-7bd73526-96c4-4492-884f-f570f1651e09 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] Flavor limits 0:0:0 {{(pid=72088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 19:22:17 user devstack@n-api.service[72088]: DEBUG nova.virt.hardware [None req-7bd73526-96c4-4492-884f-f570f1651e09 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] Image limits 0:0:0 {{(pid=72088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 19:22:17 user devstack@n-api.service[72088]: DEBUG nova.virt.hardware [None req-7bd73526-96c4-4492-884f-f570f1651e09 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] Flavor pref 0:0:0 {{(pid=72088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 19:22:17 user devstack@n-api.service[72088]: DEBUG nova.virt.hardware [None req-7bd73526-96c4-4492-884f-f570f1651e09 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] Image pref 0:0:0 {{(pid=72088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 19:22:17 user devstack@n-api.service[72088]: DEBUG nova.virt.hardware [None req-7bd73526-96c4-4492-884f-f570f1651e09 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 19:22:17 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-7bd73526-96c4-4492-884f-f570f1651e09 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:22:17 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-7bd73526-96c4-4492-884f-f570f1651e09 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:22:17 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-7bd73526-96c4-4492-884f-f570f1651e09 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:22:17 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-7bd73526-96c4-4492-884f-f570f1651e09 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:22:17 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-7bd73526-96c4-4492-884f-f570f1651e09 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:22:17 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-7bd73526-96c4-4492-884f-f570f1651e09 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:22:17 user devstack@n-api.service[72088]: DEBUG nova.quota [None req-7bd73526-96c4-4492-884f-f570f1651e09 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] Getting quotas for project 1afa97b49ae647c899a05d54b7f0f16b. Resources: {'ram', 'instances', 'cores'} {{(pid=72088) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 19:22:17 user devstack@n-api.service[72088]: DEBUG nova.quota [None req-7bd73526-96c4-4492-884f-f570f1651e09 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] Getting quotas for user 2f44f0d0807342ba9b851e7530a82294 and project 1afa97b49ae647c899a05d54b7f0f16b. Resources: {'ram', 'instances', 'cores'} {{(pid=72088) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 19:22:17 user devstack@n-api.service[72090]: DEBUG nova.network.neutron [None req-550052ab-f7e6-4eba-9439-95afd6559901 tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] validate_networks() for [('b8acbf9d-6e60-4540-9c11-751b6c4fac3a', None, None, None, None, None)] {{(pid=72090) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 11 19:22:18 user devstack@n-api.service[72088]: DEBUG nova.compute.api [None req-7bd73526-96c4-4492-884f-f570f1651e09 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] Going to run 1 instances... {{(pid=72088) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 11 19:22:18 user devstack@n-api.service[72088]: DEBUG nova.compute.api [None req-7bd73526-96c4-4492-884f-f570f1651e09 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] [instance: dde6b4d2-9288-474c-b400-ce3b6f393b24] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='a38d7c75-168f-480e-8f42-0c2606086f09',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='125a0bcb-5bbf-4fa8-81f5-f9054a4a2235',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='0b6fb879-bd91-4f68-a952-095dadc5eaef',volume_size=None,volume_type=None)] {{(pid=72088) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 11 19:22:18 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [None req-7bd73526-96c4-4492-884f-f570f1651e09 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.42 time: 5.650710 Apr 11 19:22:18 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 31/97] 10.0.0.210 () {66 vars in 1266 bytes} [Tue Apr 11 19:22:12 2023] POST /compute/v2.1/servers => generated 403 bytes in 5652 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 11 19:22:18 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [None req-557e8e13-89bf-45a1-b403-0a740c94758e tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] Calling method '>' {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:22:18 user devstack@n-api.service[72089]: DEBUG nova.compute.api [None req-557e8e13-89bf-45a1-b403-0a740c94758e tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] [instance: dde6b4d2-9288-474c-b400-ce3b6f393b24] Fetching instance by UUID {{(pid=72089) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:22:18 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [req-3a52202f-e96b-4254-8645-5265f33f3953 req-f395341e-b9d3-4e74-ab35-fe52b3189d6e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a49d379e-3976-4d68-b6df-f572a922107c", "tag": "936e8263-dbb3-4e76-8f6d-0e3269dc6066"}]} {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:22:18 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-3a52202f-e96b-4254-8645-5265f33f3953 req-f395341e-b9d3-4e74-ab35-fe52b3189d6e service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:22:18 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-3a52202f-e96b-4254-8645-5265f33f3953 req-f395341e-b9d3-4e74-ab35-fe52b3189d6e service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:22:18 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-3a52202f-e96b-4254-8645-5265f33f3953 req-f395341e-b9d3-4e74-ab35-fe52b3189d6e service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:22:18 user devstack@n-api.service[72089]: DEBUG nova.policy [None req-557e8e13-89bf-45a1-b403-0a740c94758e tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f44f0d0807342ba9b851e7530a82294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1afa97b49ae647c899a05d54b7f0f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72089) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:22:18 user devstack@n-api.service[72088]: INFO nova.api.openstack.compute.server_external_events [req-3a52202f-e96b-4254-8645-5265f33f3953 req-f395341e-b9d3-4e74-ab35-fe52b3189d6e service nova] Creating event network-changed:936e8263-dbb3-4e76-8f6d-0e3269dc6066 for instance a49d379e-3976-4d68-b6df-f572a922107c on user Apr 11 19:22:18 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [req-3a52202f-e96b-4254-8645-5265f33f3953 req-f395341e-b9d3-4e74-ab35-fe52b3189d6e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038996 Apr 11 19:22:18 user devstack@n-api.service[72089]: DEBUG nova.policy [None req-557e8e13-89bf-45a1-b403-0a740c94758e tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f44f0d0807342ba9b851e7530a82294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1afa97b49ae647c899a05d54b7f0f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72089) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:22:18 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 32/98] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:22:18 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:22:18 user devstack@n-api.service[72089]: DEBUG nova.policy [None req-557e8e13-89bf-45a1-b403-0a740c94758e tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f44f0d0807342ba9b851e7530a82294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1afa97b49ae647c899a05d54b7f0f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72089) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:22:18 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [None req-557e8e13-89bf-45a1-b403-0a740c94758e tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] 10.0.0.210 "GET /compute/v2.1/servers/dde6b4d2-9288-474c-b400-ce3b6f393b24" status: 200 len: 1279 microversion: 2.42 time: 0.169971 Apr 11 19:22:18 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 36/99] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 19:22:18 2023] GET /compute/v2.1/servers/dde6b4d2-9288-474c-b400-ce3b6f393b24 => generated 1279 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 19:22:18 user devstack@n-api.service[72090]: DEBUG nova.virt.hardware [None req-550052ab-f7e6-4eba-9439-95afd6559901 tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] Flavor limits 0:0:0 {{(pid=72090) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 19:22:18 user devstack@n-api.service[72090]: DEBUG nova.virt.hardware [None req-550052ab-f7e6-4eba-9439-95afd6559901 tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] Image limits 0:0:0 {{(pid=72090) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 19:22:18 user devstack@n-api.service[72090]: DEBUG nova.virt.hardware [None req-550052ab-f7e6-4eba-9439-95afd6559901 tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] Flavor pref 0:0:0 {{(pid=72090) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 19:22:18 user devstack@n-api.service[72090]: DEBUG nova.virt.hardware [None req-550052ab-f7e6-4eba-9439-95afd6559901 tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] Image pref 0:0:0 {{(pid=72090) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 19:22:18 user devstack@n-api.service[72090]: DEBUG nova.virt.hardware [None req-550052ab-f7e6-4eba-9439-95afd6559901 tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72090) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 19:22:18 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-550052ab-f7e6-4eba-9439-95afd6559901 tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:22:18 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-550052ab-f7e6-4eba-9439-95afd6559901 tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:22:18 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-550052ab-f7e6-4eba-9439-95afd6559901 tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:22:18 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-550052ab-f7e6-4eba-9439-95afd6559901 tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:22:18 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-550052ab-f7e6-4eba-9439-95afd6559901 tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:22:18 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-550052ab-f7e6-4eba-9439-95afd6559901 tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:22:18 user devstack@n-api.service[72090]: DEBUG nova.quota [None req-550052ab-f7e6-4eba-9439-95afd6559901 tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] Getting quotas for project f39e7fdf571442b0a6f136020a99f7fb. Resources: {'ram', 'instances', 'cores'} {{(pid=72090) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 19:22:18 user devstack@n-api.service[72090]: DEBUG nova.quota [None req-550052ab-f7e6-4eba-9439-95afd6559901 tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] Getting quotas for user 2f84e7cbdf6a4e588753fea907beba0c and project f39e7fdf571442b0a6f136020a99f7fb. Resources: {'ram', 'instances', 'cores'} {{(pid=72090) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 19:22:18 user devstack@n-api.service[72090]: DEBUG nova.compute.api [None req-550052ab-f7e6-4eba-9439-95afd6559901 tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] Going to run 1 instances... {{(pid=72090) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 11 19:22:18 user devstack@n-api.service[72090]: DEBUG nova.compute.api [None req-550052ab-f7e6-4eba-9439-95afd6559901 tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] [instance: b71d95ed-728d-4386-b7c6-50b252718ca9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=72090) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 11 19:22:18 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [None req-550052ab-f7e6-4eba-9439-95afd6559901 tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.49 time: 1.368638 Apr 11 19:22:18 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 32/100] 10.0.0.210 () {66 vars in 1265 bytes} [Tue Apr 11 19:22:17 2023] POST /compute/v2.1/servers => generated 403 bytes in 1370 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 11 19:22:19 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [None req-db460534-df8c-4e32-95ca-5d7546308c89 tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] Calling method '>' {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:22:19 user devstack@n-api.service[72088]: DEBUG nova.compute.api [None req-db460534-df8c-4e32-95ca-5d7546308c89 tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] [instance: b71d95ed-728d-4386-b7c6-50b252718ca9] Fetching instance by UUID {{(pid=72088) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:22:19 user devstack@n-api.service[72088]: DEBUG nova.policy [None req-db460534-df8c-4e32-95ca-5d7546308c89 tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f84e7cbdf6a4e588753fea907beba0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f39e7fdf571442b0a6f136020a99f7fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72088) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:22:19 user devstack@n-api.service[72088]: DEBUG nova.policy [None req-db460534-df8c-4e32-95ca-5d7546308c89 tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f84e7cbdf6a4e588753fea907beba0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f39e7fdf571442b0a6f136020a99f7fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72088) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:22:19 user devstack@n-api.service[72088]: DEBUG nova.policy [None req-db460534-df8c-4e32-95ca-5d7546308c89 tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f84e7cbdf6a4e588753fea907beba0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f39e7fdf571442b0a6f136020a99f7fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72088) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:22:19 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [None req-db460534-df8c-4e32-95ca-5d7546308c89 tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b71d95ed-728d-4386-b7c6-50b252718ca9" status: 200 len: 1321 microversion: 2.49 time: 0.111473 Apr 11 19:22:19 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 33/101] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 19:22:18 2023] GET /compute/v2.1/servers/b71d95ed-728d-4386-b7c6-50b252718ca9 => generated 1321 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 19:22:19 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [None req-c73eee67-3d78-495e-b01b-3324d739783c tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] Action: 'create', calling method: .version_select at 0x7f119df03b50>, body: {"keypair": {"name": "tempest-keypair-1484668240", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIRhE1g6lN7kY56RsSP5k+npFDOjrrGWoXYy12kXywesT1HOw0wtNyAVpyPysT174sgKEO5wRnAMduz6jouZj0JXt1SzaUglpzCVV3eYqUcaSBM8ePS1PhgcYQcrLVnUcQ=="}} {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:22:19 user devstack@n-api.service[72089]: DEBUG nova.quota [None req-c73eee67-3d78-495e-b01b-3324d739783c tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] Getting quotas for project 5ac81630b23345679b841ea2c3fe28f6. Resources: {'key_pairs'} {{(pid=72089) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 19:22:19 user devstack@n-api.service[72089]: DEBUG nova.quota [None req-c73eee67-3d78-495e-b01b-3324d739783c tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] Getting quotas for user bb69b26bc5af47069cdd00b39db75375 and project 5ac81630b23345679b841ea2c3fe28f6. Resources: {'key_pairs'} {{(pid=72089) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 19:22:19 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [None req-c73eee67-3d78-495e-b01b-3324d739783c tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.32 time: 0.078566 Apr 11 19:22:19 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 37/102] 10.0.0.210 () {66 vars in 1277 bytes} [Tue Apr 11 19:22:19 2023] POST /compute/v2.1/os-keypairs => generated 401 bytes in 80 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Apr 11 19:22:20 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [req-0566eb87-f223-4aba-82fd-807313368960 req-cd559323-57a5-4aea-a86e-963408a8eb2a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1ded3918-3bae-465c-a53c-e88011914c50", "tag": "8f590426-373c-4a90-8829-a2ad1a61fcd7"}]} {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:22:20 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-0566eb87-f223-4aba-82fd-807313368960 req-cd559323-57a5-4aea-a86e-963408a8eb2a service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:22:20 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-0566eb87-f223-4aba-82fd-807313368960 req-cd559323-57a5-4aea-a86e-963408a8eb2a service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:22:20 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-0566eb87-f223-4aba-82fd-807313368960 req-cd559323-57a5-4aea-a86e-963408a8eb2a service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:22:20 user devstack@n-api.service[72090]: INFO nova.api.openstack.compute.server_external_events [req-0566eb87-f223-4aba-82fd-807313368960 req-cd559323-57a5-4aea-a86e-963408a8eb2a service nova] Creating event network-changed:8f590426-373c-4a90-8829-a2ad1a61fcd7 for instance 1ded3918-3bae-465c-a53c-e88011914c50 on user Apr 11 19:22:20 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [req-0566eb87-f223-4aba-82fd-807313368960 req-cd559323-57a5-4aea-a86e-963408a8eb2a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086755 Apr 11 19:22:20 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 33/103] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:22:20 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 11 19:22:21 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [req-540b170b-9943-4c67-a7d4-f5197d352f9e req-35224782-4082-4d9c-b0ad-dec3a8bb0f30 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9941d033-15c2-4069-b9a6-f80840e95a38", "tag": "031df3cc-5433-459d-ab9b-484629289e90"}]} {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:22:21 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-540b170b-9943-4c67-a7d4-f5197d352f9e req-35224782-4082-4d9c-b0ad-dec3a8bb0f30 service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:22:21 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-540b170b-9943-4c67-a7d4-f5197d352f9e req-35224782-4082-4d9c-b0ad-dec3a8bb0f30 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:22:21 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-540b170b-9943-4c67-a7d4-f5197d352f9e req-35224782-4082-4d9c-b0ad-dec3a8bb0f30 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:22:21 user devstack@n-api.service[72088]: INFO nova.api.openstack.compute.server_external_events [req-540b170b-9943-4c67-a7d4-f5197d352f9e req-35224782-4082-4d9c-b0ad-dec3a8bb0f30 service nova] Creating event network-changed:031df3cc-5433-459d-ab9b-484629289e90 for instance 9941d033-15c2-4069-b9a6-f80840e95a38 on user Apr 11 19:22:21 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [req-540b170b-9943-4c67-a7d4-f5197d352f9e req-35224782-4082-4d9c-b0ad-dec3a8bb0f30 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034970 Apr 11 19:22:21 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 34/104] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:22:21 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:22:22 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [req-b521eb3d-a201-4117-b11d-c720e138b16d req-d50e2a66-762f-4a8b-a0ac-6dd6f7515402 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a49d379e-3976-4d68-b6df-f572a922107c", "name": "network-vif-plugged", "status": "completed", "tag": "936e8263-dbb3-4e76-8f6d-0e3269dc6066"}]} {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:22:22 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-b521eb3d-a201-4117-b11d-c720e138b16d req-d50e2a66-762f-4a8b-a0ac-6dd6f7515402 service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:22:22 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-b521eb3d-a201-4117-b11d-c720e138b16d req-d50e2a66-762f-4a8b-a0ac-6dd6f7515402 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:22:22 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-b521eb3d-a201-4117-b11d-c720e138b16d req-d50e2a66-762f-4a8b-a0ac-6dd6f7515402 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:22:22 user devstack@n-api.service[72089]: INFO nova.api.openstack.compute.server_external_events [req-b521eb3d-a201-4117-b11d-c720e138b16d req-d50e2a66-762f-4a8b-a0ac-6dd6f7515402 service nova] Creating event network-vif-plugged:936e8263-dbb3-4e76-8f6d-0e3269dc6066 for instance a49d379e-3976-4d68-b6df-f572a922107c on user Apr 11 19:22:22 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [req-b521eb3d-a201-4117-b11d-c720e138b16d req-d50e2a66-762f-4a8b-a0ac-6dd6f7515402 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071710 Apr 11 19:22:22 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 38/105] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:22:22 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:22:22 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [None req-09b7b502-38e1-472d-acbf-cf8f56df8cb5 tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1077608511", "imageRef": "4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b", "flavorRef": "42", "networks": [{"uuid": "93340493-e74d-43fd-9b4c-ddd0217720be"}]}} {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:22:22 user devstack@n-api.service[72090]: DEBUG nova.network.neutron [None req-09b7b502-38e1-472d-acbf-cf8f56df8cb5 tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] validate_networks() for [('93340493-e74d-43fd-9b4c-ddd0217720be', None, None, None, None, None)] {{(pid=72090) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 11 19:22:23 user devstack@n-api.service[72090]: DEBUG nova.virt.hardware [None req-09b7b502-38e1-472d-acbf-cf8f56df8cb5 tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] Flavor limits 0:0:0 {{(pid=72090) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 19:22:23 user devstack@n-api.service[72090]: DEBUG nova.virt.hardware [None req-09b7b502-38e1-472d-acbf-cf8f56df8cb5 tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] Image limits 0:0:0 {{(pid=72090) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 19:22:23 user devstack@n-api.service[72090]: DEBUG nova.virt.hardware [None req-09b7b502-38e1-472d-acbf-cf8f56df8cb5 tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] Flavor pref 0:0:0 {{(pid=72090) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 19:22:23 user devstack@n-api.service[72090]: DEBUG nova.virt.hardware [None req-09b7b502-38e1-472d-acbf-cf8f56df8cb5 tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] Image pref 0:0:0 {{(pid=72090) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 19:22:23 user devstack@n-api.service[72090]: DEBUG nova.virt.hardware [None req-09b7b502-38e1-472d-acbf-cf8f56df8cb5 tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72090) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 19:22:23 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-09b7b502-38e1-472d-acbf-cf8f56df8cb5 tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:22:23 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-09b7b502-38e1-472d-acbf-cf8f56df8cb5 tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:22:23 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-09b7b502-38e1-472d-acbf-cf8f56df8cb5 tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:22:23 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-09b7b502-38e1-472d-acbf-cf8f56df8cb5 tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:22:23 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-09b7b502-38e1-472d-acbf-cf8f56df8cb5 tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:22:23 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-09b7b502-38e1-472d-acbf-cf8f56df8cb5 tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:22:23 user devstack@n-api.service[72090]: DEBUG nova.quota [None req-09b7b502-38e1-472d-acbf-cf8f56df8cb5 tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] Getting quotas for project 7543456a70d04d7f8c50f37e64b7ee9c. Resources: {'ram', 'instances', 'cores'} {{(pid=72090) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 19:22:23 user devstack@n-api.service[72090]: DEBUG nova.quota [None req-09b7b502-38e1-472d-acbf-cf8f56df8cb5 tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] Getting quotas for user 7c9641ceb17e4914b1cdf061c5bdc79f and project 7543456a70d04d7f8c50f37e64b7ee9c. Resources: {'ram', 'instances', 'cores'} {{(pid=72090) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 19:22:23 user devstack@n-api.service[72090]: DEBUG nova.compute.api [None req-09b7b502-38e1-472d-acbf-cf8f56df8cb5 tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] Going to run 1 instances... {{(pid=72090) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 11 19:22:23 user devstack@n-api.service[72090]: DEBUG nova.compute.api [None req-09b7b502-38e1-472d-acbf-cf8f56df8cb5 tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] [instance: 8e449d09-f632-4f57-b304-430734096596] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=72090) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 11 19:22:23 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [None req-09b7b502-38e1-472d-acbf-cf8f56df8cb5 tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.891886 Apr 11 19:22:23 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 34/106] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 11 19:22:22 2023] POST /compute/v2.1/servers => generated 378 bytes in 894 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 11 19:22:23 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [None req-af6e2b1f-0733-4b8f-84ff-e102d7b65f05 tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] Calling method '>' {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:22:23 user devstack@n-api.service[72088]: DEBUG nova.compute.api [None req-af6e2b1f-0733-4b8f-84ff-e102d7b65f05 tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] [instance: 8e449d09-f632-4f57-b304-430734096596] Fetching instance by UUID {{(pid=72088) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:22:23 user devstack@n-api.service[72088]: DEBUG nova.policy [None req-af6e2b1f-0733-4b8f-84ff-e102d7b65f05 tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c9641ceb17e4914b1cdf061c5bdc79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7543456a70d04d7f8c50f37e64b7ee9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72088) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:22:23 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [None req-af6e2b1f-0733-4b8f-84ff-e102d7b65f05 tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8e449d09-f632-4f57-b304-430734096596" status: 200 len: 1208 microversion: 2.1 time: 0.154969 Apr 11 19:22:23 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 35/107] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 19:22:23 2023] GET /compute/v2.1/servers/8e449d09-f632-4f57-b304-430734096596 => generated 1208 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 19:22:24 user devstack@n-api.service[72089]: DEBUG dbcounter [-] [72089] Writing DB stats nova_cell0:SELECT=2 {{(pid=72089) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:22:24 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [req-9d5eab42-fb9a-48c6-8956-bc15e5cae601 req-39fead22-a956-4490-9faa-e707e658eb79 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a49d379e-3976-4d68-b6df-f572a922107c", "name": "network-vif-plugged", "status": "completed", "tag": "936e8263-dbb3-4e76-8f6d-0e3269dc6066"}]} {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:22:24 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-9d5eab42-fb9a-48c6-8956-bc15e5cae601 req-39fead22-a956-4490-9faa-e707e658eb79 service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:22:24 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-9d5eab42-fb9a-48c6-8956-bc15e5cae601 req-39fead22-a956-4490-9faa-e707e658eb79 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:22:24 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-9d5eab42-fb9a-48c6-8956-bc15e5cae601 req-39fead22-a956-4490-9faa-e707e658eb79 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:22:24 user devstack@n-api.service[72089]: INFO nova.api.openstack.compute.server_external_events [req-9d5eab42-fb9a-48c6-8956-bc15e5cae601 req-39fead22-a956-4490-9faa-e707e658eb79 service nova] Creating event network-vif-plugged:936e8263-dbb3-4e76-8f6d-0e3269dc6066 for instance a49d379e-3976-4d68-b6df-f572a922107c on user Apr 11 19:22:24 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [req-9d5eab42-fb9a-48c6-8956-bc15e5cae601 req-39fead22-a956-4490-9faa-e707e658eb79 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057001 Apr 11 19:22:24 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 39/108] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:22:24 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:22:25 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [req-a1825abf-4597-4113-a4c2-588961c73992 req-d617e050-7e8d-4f26-837c-df361ddf717b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b71d95ed-728d-4386-b7c6-50b252718ca9", "tag": "64bd141d-04e6-46e6-bb46-e997d3234fa1"}]} {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:22:25 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-a1825abf-4597-4113-a4c2-588961c73992 req-d617e050-7e8d-4f26-837c-df361ddf717b service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:22:25 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-a1825abf-4597-4113-a4c2-588961c73992 req-d617e050-7e8d-4f26-837c-df361ddf717b service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:22:25 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-a1825abf-4597-4113-a4c2-588961c73992 req-d617e050-7e8d-4f26-837c-df361ddf717b service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:22:25 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [None req-6805afdb-ebe5-4f42-b05d-c74f67d33b06 tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-1561645398", "imageRef": "4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b", "flavorRef": "42", "config_drive": true, "networks": [{"uuid": "92d50449-1a92-4c36-9625-7b6d9326a1fa"}, {"port": "986b85fe-4d6d-4ac6-95c7-02e58e4073b2", "tag": "port-1"}, {"port": "f3db6cdb-4d7d-4c66-a809-d59e3feaea97", "tag": "port-2"}, {"uuid": "e93c3f6f-ef1d-4633-9c71-f2da746552cb", "tag": "net-1"}, {"uuid": "e93c3f6f-ef1d-4633-9c71-f2da746552cb"}, {"uuid": "7b57bb14-73f4-43f0-8934-cbf158c73cbf", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "7b57bb14-73f4-43f0-8934-cbf158c73cbf", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "6cd6076d-a423-48e8-a9a6-e77019975089", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "cc002f3d-0af6-486e-beea-3bcc54a9a101", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "14117830-bcbb-4cbc-966c-8d7f11cbc013", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--1883815051"}], "key_name": "tempest-keypair-1484668240", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:22:25 user devstack@n-api.service[72090]: INFO nova.api.openstack.compute.server_external_events [req-a1825abf-4597-4113-a4c2-588961c73992 req-d617e050-7e8d-4f26-837c-df361ddf717b service nova] Creating event network-changed:64bd141d-04e6-46e6-bb46-e997d3234fa1 for instance b71d95ed-728d-4386-b7c6-50b252718ca9 on user Apr 11 19:22:25 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [req-a1825abf-4597-4113-a4c2-588961c73992 req-d617e050-7e8d-4f26-837c-df361ddf717b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070179 Apr 11 19:22:25 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 35/109] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:22:25 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:22:25 user devstack@n-api.service[72088]: DEBUG nova.network.neutron [None req-6805afdb-ebe5-4f42-b05d-c74f67d33b06 tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] validate_networks() for [('92d50449-1a92-4c36-9625-7b6d9326a1fa', None, None, None, None, None), (None, None, '986b85fe-4d6d-4ac6-95c7-02e58e4073b2', None, None, None), (None, None, 'f3db6cdb-4d7d-4c66-a809-d59e3feaea97', None, None, None), ('e93c3f6f-ef1d-4633-9c71-f2da746552cb', None, None, None, None, None), ('e93c3f6f-ef1d-4633-9c71-f2da746552cb', None, None, None, None, None), ('7b57bb14-73f4-43f0-8934-cbf158c73cbf', '10.2.2.100', None, None, None, None), ('7b57bb14-73f4-43f0-8934-cbf158c73cbf', '10.2.2.200', None, None, None, None)] {{(pid=72088) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 11 19:22:26 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [req-3cd8447f-1482-4c2b-88e3-4f81e2f2b159 req-d2f6aa19-bd75-4e1e-afc5-50ea1ff73da0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ded3918-3bae-465c-a53c-e88011914c50", "name": "network-vif-plugged", "status": "completed", "tag": "8f590426-373c-4a90-8829-a2ad1a61fcd7"}, {"server_uuid": "1ded3918-3bae-465c-a53c-e88011914c50", "name": "network-vif-plugged", "status": "completed", "tag": "8f590426-373c-4a90-8829-a2ad1a61fcd7"}]} {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:22:26 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-3cd8447f-1482-4c2b-88e3-4f81e2f2b159 req-d2f6aa19-bd75-4e1e-afc5-50ea1ff73da0 service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:22:26 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-3cd8447f-1482-4c2b-88e3-4f81e2f2b159 req-d2f6aa19-bd75-4e1e-afc5-50ea1ff73da0 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:22:26 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-3cd8447f-1482-4c2b-88e3-4f81e2f2b159 req-d2f6aa19-bd75-4e1e-afc5-50ea1ff73da0 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:22:26 user devstack@n-api.service[72089]: INFO nova.api.openstack.compute.server_external_events [req-3cd8447f-1482-4c2b-88e3-4f81e2f2b159 req-d2f6aa19-bd75-4e1e-afc5-50ea1ff73da0 service nova] Creating event network-vif-plugged:8f590426-373c-4a90-8829-a2ad1a61fcd7 for instance 1ded3918-3bae-465c-a53c-e88011914c50 on user Apr 11 19:22:26 user devstack@n-api.service[72089]: INFO nova.api.openstack.compute.server_external_events [req-3cd8447f-1482-4c2b-88e3-4f81e2f2b159 req-d2f6aa19-bd75-4e1e-afc5-50ea1ff73da0 service nova] Creating event network-vif-plugged:8f590426-373c-4a90-8829-a2ad1a61fcd7 for instance 1ded3918-3bae-465c-a53c-e88011914c50 on user Apr 11 19:22:26 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [req-3cd8447f-1482-4c2b-88e3-4f81e2f2b159 req-d2f6aa19-bd75-4e1e-afc5-50ea1ff73da0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.069738 Apr 11 19:22:26 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 40/110] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:22:26 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:22:27 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [None req-a8c8b17d-f16c-43fe-aeae-4fe7f5d99dc1 tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] Calling method '>' {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:22:27 user devstack@n-api.service[72090]: DEBUG nova.compute.api [None req-a8c8b17d-f16c-43fe-aeae-4fe7f5d99dc1 tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] [instance: fc48e37f-8c00-4e48-bea3-f1c2e54d78b8] Fetching instance by UUID {{(pid=72090) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:22:27 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-a8c8b17d-f16c-43fe-aeae-4fe7f5d99dc1 tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:22:27 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-a8c8b17d-f16c-43fe-aeae-4fe7f5d99dc1 tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:22:27 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-a8c8b17d-f16c-43fe-aeae-4fe7f5d99dc1 tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:22:27 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-a8c8b17d-f16c-43fe-aeae-4fe7f5d99dc1 tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:22:27 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-a8c8b17d-f16c-43fe-aeae-4fe7f5d99dc1 tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:22:27 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-a8c8b17d-f16c-43fe-aeae-4fe7f5d99dc1 tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:22:27 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [req-97a38913-ada4-4c30-9df0-b3f1137996a2 req-8bfd66c7-ce72-4d7c-b2cd-960bcd14987e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9941d033-15c2-4069-b9a6-f80840e95a38", "name": "network-vif-plugged", "status": "completed", "tag": "031df3cc-5433-459d-ab9b-484629289e90"}]} {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:22:27 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-97a38913-ada4-4c30-9df0-b3f1137996a2 req-8bfd66c7-ce72-4d7c-b2cd-960bcd14987e service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:22:27 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-97a38913-ada4-4c30-9df0-b3f1137996a2 req-8bfd66c7-ce72-4d7c-b2cd-960bcd14987e service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:22:27 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-97a38913-ada4-4c30-9df0-b3f1137996a2 req-8bfd66c7-ce72-4d7c-b2cd-960bcd14987e service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:22:27 user devstack@n-api.service[72089]: INFO nova.api.openstack.compute.server_external_events [req-97a38913-ada4-4c30-9df0-b3f1137996a2 req-8bfd66c7-ce72-4d7c-b2cd-960bcd14987e service nova] Creating event network-vif-plugged:031df3cc-5433-459d-ab9b-484629289e90 for instance 9941d033-15c2-4069-b9a6-f80840e95a38 on user Apr 11 19:22:27 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [req-97a38913-ada4-4c30-9df0-b3f1137996a2 req-8bfd66c7-ce72-4d7c-b2cd-960bcd14987e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073040 Apr 11 19:22:27 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 41/111] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:22:27 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:22:27 user devstack@n-api.service[72090]: DEBUG nova.policy [None req-a8c8b17d-f16c-43fe-aeae-4fe7f5d99dc1 tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f44dfa2528b4540a81f4eb7c3f3f2f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5d7769df1e4974b295cb30407151dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72090) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:22:27 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [None req-a8c8b17d-f16c-43fe-aeae-4fe7f5d99dc1 tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fc48e37f-8c00-4e48-bea3-f1c2e54d78b8" status: 200 len: 1494 microversion: 2.1 time: 0.410585 Apr 11 19:22:27 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 36/112] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 19:22:27 2023] GET /compute/v2.1/servers/fc48e37f-8c00-4e48-bea3-f1c2e54d78b8 => generated 1494 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:22:27 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [None req-e7caf385-217c-48c5-aeee-5a85e7076f39 tempest-DeleteServersTestJSON-124461992 tempest-DeleteServersTestJSON-124461992-project-member] Calling method '>' {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:22:27 user devstack@n-api.service[72089]: DEBUG nova.compute.api [None req-e7caf385-217c-48c5-aeee-5a85e7076f39 tempest-DeleteServersTestJSON-124461992 tempest-DeleteServersTestJSON-124461992-project-member] [instance: efd7afec-d6d0-4e3f-a3b9-f672b3e711cf] Fetching instance by UUID {{(pid=72089) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:22:27 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-e7caf385-217c-48c5-aeee-5a85e7076f39 tempest-DeleteServersTestJSON-124461992 tempest-DeleteServersTestJSON-124461992-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:22:27 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-e7caf385-217c-48c5-aeee-5a85e7076f39 tempest-DeleteServersTestJSON-124461992 tempest-DeleteServersTestJSON-124461992-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:22:27 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-e7caf385-217c-48c5-aeee-5a85e7076f39 tempest-DeleteServersTestJSON-124461992 tempest-DeleteServersTestJSON-124461992-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:22:27 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-e7caf385-217c-48c5-aeee-5a85e7076f39 tempest-DeleteServersTestJSON-124461992 tempest-DeleteServersTestJSON-124461992-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:22:27 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-e7caf385-217c-48c5-aeee-5a85e7076f39 tempest-DeleteServersTestJSON-124461992 tempest-DeleteServersTestJSON-124461992-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:22:27 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-e7caf385-217c-48c5-aeee-5a85e7076f39 tempest-DeleteServersTestJSON-124461992 tempest-DeleteServersTestJSON-124461992-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:22:27 user devstack@n-api.service[72088]: DEBUG dbcounter [-] [72088] Writing DB stats nova_cell0:SELECT=2 {{(pid=72088) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:22:28 user devstack@n-api.service[72089]: DEBUG nova.policy [None req-e7caf385-217c-48c5-aeee-5a85e7076f39 tempest-DeleteServersTestJSON-124461992 tempest-DeleteServersTestJSON-124461992-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '502b859ece744cf680123cd4e9643938', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34322e02b2fc4c2c84fb77583faf4405', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72089) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:22:28 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [None req-e7caf385-217c-48c5-aeee-5a85e7076f39 tempest-DeleteServersTestJSON-124461992 tempest-DeleteServersTestJSON-124461992-project-member] 10.0.0.210 "GET /compute/v2.1/servers/efd7afec-d6d0-4e3f-a3b9-f672b3e711cf" status: 200 len: 1489 microversion: 2.1 time: 0.381379 Apr 11 19:22:28 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 42/113] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 19:22:27 2023] GET /compute/v2.1/servers/efd7afec-d6d0-4e3f-a3b9-f672b3e711cf => generated 1489 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:22:28 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [req-0ed94ec8-1624-4fd3-9d64-4fc9f57bbb09 req-0ae57640-2a5a-4762-829f-0f3f04583cb0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dde6b4d2-9288-474c-b400-ce3b6f393b24", "tag": "aeb74c01-d96e-4838-8d2c-c2499e3f8770"}]} {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:22:28 user devstack@n-api.service[72090]: DEBUG dbcounter [-] [72090] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=14 {{(pid=72090) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:22:28 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-0ed94ec8-1624-4fd3-9d64-4fc9f57bbb09 req-0ae57640-2a5a-4762-829f-0f3f04583cb0 service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:22:28 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-0ed94ec8-1624-4fd3-9d64-4fc9f57bbb09 req-0ae57640-2a5a-4762-829f-0f3f04583cb0 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:22:28 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-0ed94ec8-1624-4fd3-9d64-4fc9f57bbb09 req-0ae57640-2a5a-4762-829f-0f3f04583cb0 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:22:28 user devstack@n-api.service[72090]: INFO nova.api.openstack.compute.server_external_events [req-0ed94ec8-1624-4fd3-9d64-4fc9f57bbb09 req-0ae57640-2a5a-4762-829f-0f3f04583cb0 service nova] Creating event network-changed:aeb74c01-d96e-4838-8d2c-c2499e3f8770 for instance dde6b4d2-9288-474c-b400-ce3b6f393b24 on user Apr 11 19:22:28 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [req-0ed94ec8-1624-4fd3-9d64-4fc9f57bbb09 req-0ae57640-2a5a-4762-829f-0f3f04583cb0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062241 Apr 11 19:22:28 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 37/114] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:22:28 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:22:29 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [req-af67c7f5-49c1-449b-b216-cabb7b44b772 req-4bfc39b6-dbde-4a17-be9b-1b213101446d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9941d033-15c2-4069-b9a6-f80840e95a38", "name": "network-vif-plugged", "status": "completed", "tag": "031df3cc-5433-459d-ab9b-484629289e90"}, {"server_uuid": "b71d95ed-728d-4386-b7c6-50b252718ca9", "name": "network-vif-plugged", "status": "completed", "tag": "64bd141d-04e6-46e6-bb46-e997d3234fa1"}]} {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:22:29 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-af67c7f5-49c1-449b-b216-cabb7b44b772 req-4bfc39b6-dbde-4a17-be9b-1b213101446d service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:22:29 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-af67c7f5-49c1-449b-b216-cabb7b44b772 req-4bfc39b6-dbde-4a17-be9b-1b213101446d service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:22:29 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-af67c7f5-49c1-449b-b216-cabb7b44b772 req-4bfc39b6-dbde-4a17-be9b-1b213101446d service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:22:29 user devstack@n-api.service[72089]: INFO nova.api.openstack.compute.server_external_events [req-af67c7f5-49c1-449b-b216-cabb7b44b772 req-4bfc39b6-dbde-4a17-be9b-1b213101446d service nova] Creating event network-vif-plugged:031df3cc-5433-459d-ab9b-484629289e90 for instance 9941d033-15c2-4069-b9a6-f80840e95a38 on user Apr 11 19:22:29 user devstack@n-api.service[72089]: INFO nova.api.openstack.compute.server_external_events [req-af67c7f5-49c1-449b-b216-cabb7b44b772 req-4bfc39b6-dbde-4a17-be9b-1b213101446d service nova] Creating event network-vif-plugged:64bd141d-04e6-46e6-bb46-e997d3234fa1 for instance b71d95ed-728d-4386-b7c6-50b252718ca9 on user Apr 11 19:22:29 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [req-af67c7f5-49c1-449b-b216-cabb7b44b772 req-4bfc39b6-dbde-4a17-be9b-1b213101446d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.100846 Apr 11 19:22:29 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 43/115] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:22:29 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:22:30 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [req-e47d6b15-d02e-4904-9309-a9bd9ef666a7 req-03b06391-9551-4734-b9ad-4986052fb4c3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dde6b4d2-9288-474c-b400-ce3b6f393b24", "tag": "4768cc5b-e792-4c52-805a-7f288ed9fbe5"}]} {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:22:30 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-e47d6b15-d02e-4904-9309-a9bd9ef666a7 req-03b06391-9551-4734-b9ad-4986052fb4c3 service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:22:30 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-e47d6b15-d02e-4904-9309-a9bd9ef666a7 req-03b06391-9551-4734-b9ad-4986052fb4c3 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:22:30 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-e47d6b15-d02e-4904-9309-a9bd9ef666a7 req-03b06391-9551-4734-b9ad-4986052fb4c3 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:22:30 user devstack@n-api.service[72090]: INFO nova.api.openstack.compute.server_external_events [req-e47d6b15-d02e-4904-9309-a9bd9ef666a7 req-03b06391-9551-4734-b9ad-4986052fb4c3 service nova] Creating event network-changed:4768cc5b-e792-4c52-805a-7f288ed9fbe5 for instance dde6b4d2-9288-474c-b400-ce3b6f393b24 on user Apr 11 19:22:30 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [req-e47d6b15-d02e-4904-9309-a9bd9ef666a7 req-03b06391-9551-4734-b9ad-4986052fb4c3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043254 Apr 11 19:22:30 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 38/116] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:22:30 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:22:31 user devstack@n-api.service[72088]: DEBUG dbcounter [-] [72088] Writing DB stats nova_cell1:SELECT=6 {{(pid=72088) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:22:31 user devstack@n-api.service[72089]: DEBUG dbcounter [-] [72089] Writing DB stats nova_cell0:SELECT=22 {{(pid=72089) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:22:31 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [req-1cab330d-f3a7-4794-848a-1c4c6914891e req-55713116-dc4e-4c4e-8901-e1827a70cac2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b71d95ed-728d-4386-b7c6-50b252718ca9", "name": "network-vif-plugged", "status": "completed", "tag": "64bd141d-04e6-46e6-bb46-e997d3234fa1"}]} {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:22:31 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-1cab330d-f3a7-4794-848a-1c4c6914891e req-55713116-dc4e-4c4e-8901-e1827a70cac2 service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:22:31 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-1cab330d-f3a7-4794-848a-1c4c6914891e req-55713116-dc4e-4c4e-8901-e1827a70cac2 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:22:31 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-1cab330d-f3a7-4794-848a-1c4c6914891e req-55713116-dc4e-4c4e-8901-e1827a70cac2 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:22:31 user devstack@n-api.service[72089]: INFO nova.api.openstack.compute.server_external_events [req-1cab330d-f3a7-4794-848a-1c4c6914891e req-55713116-dc4e-4c4e-8901-e1827a70cac2 service nova] Creating event network-vif-plugged:64bd141d-04e6-46e6-bb46-e997d3234fa1 for instance b71d95ed-728d-4386-b7c6-50b252718ca9 on user Apr 11 19:22:31 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [req-1cab330d-f3a7-4794-848a-1c4c6914891e req-55713116-dc4e-4c4e-8901-e1827a70cac2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059314 Apr 11 19:22:31 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 44/117] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:22:31 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:22:32 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [req-d2aeaf3d-a04a-457d-8464-f4cefa6e975c req-f31b30e3-498c-4a9c-b51a-3ec4c47f8d50 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dde6b4d2-9288-474c-b400-ce3b6f393b24", "tag": "1d14016e-af6d-4ce8-bd51-8a9dba7c4261"}, {"name": "network-changed", "server_uuid": "dde6b4d2-9288-474c-b400-ce3b6f393b24", "tag": "576d5a47-cb3a-4794-bc1e-dcbb82e25352"}]} {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:22:32 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-d2aeaf3d-a04a-457d-8464-f4cefa6e975c req-f31b30e3-498c-4a9c-b51a-3ec4c47f8d50 service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:22:32 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-d2aeaf3d-a04a-457d-8464-f4cefa6e975c req-f31b30e3-498c-4a9c-b51a-3ec4c47f8d50 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:22:32 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-d2aeaf3d-a04a-457d-8464-f4cefa6e975c req-f31b30e3-498c-4a9c-b51a-3ec4c47f8d50 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:22:32 user devstack@n-api.service[72090]: INFO nova.api.openstack.compute.server_external_events [req-d2aeaf3d-a04a-457d-8464-f4cefa6e975c req-f31b30e3-498c-4a9c-b51a-3ec4c47f8d50 service nova] Creating event network-changed:1d14016e-af6d-4ce8-bd51-8a9dba7c4261 for instance dde6b4d2-9288-474c-b400-ce3b6f393b24 on user Apr 11 19:22:32 user devstack@n-api.service[72090]: INFO nova.api.openstack.compute.server_external_events [req-d2aeaf3d-a04a-457d-8464-f4cefa6e975c req-f31b30e3-498c-4a9c-b51a-3ec4c47f8d50 service nova] Creating event network-changed:576d5a47-cb3a-4794-bc1e-dcbb82e25352 for instance dde6b4d2-9288-474c-b400-ce3b6f393b24 on user Apr 11 19:22:32 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [req-d2aeaf3d-a04a-457d-8464-f4cefa6e975c req-f31b30e3-498c-4a9c-b51a-3ec4c47f8d50 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.056965 Apr 11 19:22:32 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 39/118] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:22:32 2023] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:22:33 user devstack@n-api.service[72088]: DEBUG nova.virt.hardware [None req-6805afdb-ebe5-4f42-b05d-c74f67d33b06 tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] Flavor limits 0:0:0 {{(pid=72088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 19:22:33 user devstack@n-api.service[72088]: DEBUG nova.virt.hardware [None req-6805afdb-ebe5-4f42-b05d-c74f67d33b06 tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] Image limits 0:0:0 {{(pid=72088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 19:22:33 user devstack@n-api.service[72088]: DEBUG nova.virt.hardware [None req-6805afdb-ebe5-4f42-b05d-c74f67d33b06 tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] Flavor pref 0:0:0 {{(pid=72088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 19:22:33 user devstack@n-api.service[72088]: DEBUG nova.virt.hardware [None req-6805afdb-ebe5-4f42-b05d-c74f67d33b06 tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] Image pref 0:0:0 {{(pid=72088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 19:22:33 user devstack@n-api.service[72088]: DEBUG nova.virt.hardware [None req-6805afdb-ebe5-4f42-b05d-c74f67d33b06 tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 19:22:33 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-6805afdb-ebe5-4f42-b05d-c74f67d33b06 tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:22:33 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-6805afdb-ebe5-4f42-b05d-c74f67d33b06 tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:22:33 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-6805afdb-ebe5-4f42-b05d-c74f67d33b06 tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:22:33 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-6805afdb-ebe5-4f42-b05d-c74f67d33b06 tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:22:33 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-6805afdb-ebe5-4f42-b05d-c74f67d33b06 tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:22:33 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-6805afdb-ebe5-4f42-b05d-c74f67d33b06 tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:22:33 user devstack@n-api.service[72088]: DEBUG nova.quota [None req-6805afdb-ebe5-4f42-b05d-c74f67d33b06 tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] Getting quotas for project 5ac81630b23345679b841ea2c3fe28f6. Resources: {'ram', 'instances', 'cores'} {{(pid=72088) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 19:22:33 user devstack@n-api.service[72088]: DEBUG nova.quota [None req-6805afdb-ebe5-4f42-b05d-c74f67d33b06 tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] Getting quotas for user bb69b26bc5af47069cdd00b39db75375 and project 5ac81630b23345679b841ea2c3fe28f6. Resources: {'ram', 'instances', 'cores'} {{(pid=72088) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 19:22:33 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [req-1bcdfd49-3415-472d-9cc0-5fece917cd4f req-bf301b48-0b41-4d34-855d-28e5c0f48f31 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8e449d09-f632-4f57-b304-430734096596", "tag": "5dea909b-eaed-4978-b239-4177f6cbdfdc"}]} {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:22:33 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-1bcdfd49-3415-472d-9cc0-5fece917cd4f req-bf301b48-0b41-4d34-855d-28e5c0f48f31 service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:22:33 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-1bcdfd49-3415-472d-9cc0-5fece917cd4f req-bf301b48-0b41-4d34-855d-28e5c0f48f31 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:22:33 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-1bcdfd49-3415-472d-9cc0-5fece917cd4f req-bf301b48-0b41-4d34-855d-28e5c0f48f31 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:22:33 user devstack@n-api.service[72089]: INFO nova.api.openstack.compute.server_external_events [req-1bcdfd49-3415-472d-9cc0-5fece917cd4f req-bf301b48-0b41-4d34-855d-28e5c0f48f31 service nova] Creating event network-changed:5dea909b-eaed-4978-b239-4177f6cbdfdc for instance 8e449d09-f632-4f57-b304-430734096596 on user Apr 11 19:22:33 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [req-1bcdfd49-3415-472d-9cc0-5fece917cd4f req-bf301b48-0b41-4d34-855d-28e5c0f48f31 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080276 Apr 11 19:22:33 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 45/119] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:22:33 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:22:34 user devstack@n-api.service[72088]: DEBUG nova.compute.api [None req-6805afdb-ebe5-4f42-b05d-c74f67d33b06 tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] Going to run 1 instances... {{(pid=72088) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 11 19:22:34 user devstack@n-api.service[72088]: DEBUG nova.compute.api [None req-6805afdb-ebe5-4f42-b05d-c74f67d33b06 tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] [instance: 75a4ef96-a6c3-4ccd-9503-bab0d4174b2b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='6cd6076d-a423-48e8-a9a6-e77019975089',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='cc002f3d-0af6-486e-beea-3bcc54a9a101',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='14117830-bcbb-4cbc-966c-8d7f11cbc013',volume_size=None,volume_type=None)] {{(pid=72088) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 11 19:22:34 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [None req-6805afdb-ebe5-4f42-b05d-c74f67d33b06 tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.32 time: 9.332397 Apr 11 19:22:34 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 36/120] 10.0.0.210 () {66 vars in 1266 bytes} [Tue Apr 11 19:22:25 2023] POST /compute/v2.1/servers => generated 404 bytes in 9335 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 11 19:22:34 user devstack@n-api.service[72090]: DEBUG dbcounter [-] [72090] Writing DB stats nova_cell0:SELECT=8 {{(pid=72090) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:22:34 user devstack@n-api.service[72090]: DEBUG dbcounter [-] [72090] Writing DB stats nova_cell0:SELECT=32 {{(pid=72090) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:22:34 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [None req-d94e5132-698f-42c4-be20-5885a8ab0da3 tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] Calling method '>' {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:22:34 user devstack@n-api.service[72090]: DEBUG nova.compute.api [None req-d94e5132-698f-42c4-be20-5885a8ab0da3 tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] [instance: 75a4ef96-a6c3-4ccd-9503-bab0d4174b2b] Fetching instance by UUID {{(pid=72090) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:22:34 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [None req-cacb57a5-aa69-43fe-948b-60a0743a4357 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Calling method '>' {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:22:34 user devstack@n-api.service[72089]: DEBUG nova.compute.api [None req-cacb57a5-aa69-43fe-948b-60a0743a4357 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] [instance: bed4001c-02c2-4c6b-84c8-61654df66d8b] Fetching instance by UUID {{(pid=72089) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:22:34 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-cacb57a5-aa69-43fe-948b-60a0743a4357 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:22:34 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-cacb57a5-aa69-43fe-948b-60a0743a4357 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:22:34 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-cacb57a5-aa69-43fe-948b-60a0743a4357 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:22:34 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-cacb57a5-aa69-43fe-948b-60a0743a4357 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:22:34 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-cacb57a5-aa69-43fe-948b-60a0743a4357 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:22:34 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-cacb57a5-aa69-43fe-948b-60a0743a4357 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:22:34 user devstack@n-api.service[72090]: DEBUG nova.policy [None req-d94e5132-698f-42c4-be20-5885a8ab0da3 tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb69b26bc5af47069cdd00b39db75375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ac81630b23345679b841ea2c3fe28f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72090) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:22:34 user devstack@n-api.service[72090]: DEBUG nova.policy [None req-d94e5132-698f-42c4-be20-5885a8ab0da3 tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb69b26bc5af47069cdd00b39db75375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ac81630b23345679b841ea2c3fe28f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72090) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:22:34 user devstack@n-api.service[72090]: DEBUG nova.policy [None req-d94e5132-698f-42c4-be20-5885a8ab0da3 tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb69b26bc5af47069cdd00b39db75375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ac81630b23345679b841ea2c3fe28f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72090) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:22:34 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [None req-d94e5132-698f-42c4-be20-5885a8ab0da3 tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] 10.0.0.210 "GET /compute/v2.1/servers/75a4ef96-a6c3-4ccd-9503-bab0d4174b2b" status: 200 len: 1280 microversion: 2.32 time: 0.209547 Apr 11 19:22:34 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 40/121] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 19:22:34 2023] GET /compute/v2.1/servers/75a4ef96-a6c3-4ccd-9503-bab0d4174b2b => generated 1280 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 19:22:34 user devstack@n-api.service[72089]: DEBUG nova.policy [None req-cacb57a5-aa69-43fe-948b-60a0743a4357 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5d405421ceb4d99967ef2e7f55e7809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06966e2f4d3a4dec92282c7ad348635d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72089) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:22:34 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [None req-cacb57a5-aa69-43fe-948b-60a0743a4357 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bed4001c-02c2-4c6b-84c8-61654df66d8b" status: 200 len: 1545 microversion: 2.1 time: 0.356010 Apr 11 19:22:34 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 46/122] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 19:22:34 2023] GET /compute/v2.1/servers/bed4001c-02c2-4c6b-84c8-61654df66d8b => generated 1545 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:22:34 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [req-762b84a3-16dc-4bf6-b74a-e98db0e2b361 req-a5aec127-6150-491b-a212-9a446d1f2836 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dde6b4d2-9288-474c-b400-ce3b6f393b24", "tag": "db299c0f-eae0-45ae-ba9c-037c50e06a3c"}]} {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:22:35 user devstack@n-api.service[72088]: DEBUG dbcounter [-] [72088] Writing DB stats nova_api:SELECT=66,nova_api:INSERT=8 {{(pid=72088) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:22:35 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-762b84a3-16dc-4bf6-b74a-e98db0e2b361 req-a5aec127-6150-491b-a212-9a446d1f2836 service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:22:35 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-762b84a3-16dc-4bf6-b74a-e98db0e2b361 req-a5aec127-6150-491b-a212-9a446d1f2836 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:22:35 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-762b84a3-16dc-4bf6-b74a-e98db0e2b361 req-a5aec127-6150-491b-a212-9a446d1f2836 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:22:35 user devstack@n-api.service[72088]: INFO nova.api.openstack.compute.server_external_events [req-762b84a3-16dc-4bf6-b74a-e98db0e2b361 req-a5aec127-6150-491b-a212-9a446d1f2836 service nova] Creating event network-changed:db299c0f-eae0-45ae-ba9c-037c50e06a3c for instance dde6b4d2-9288-474c-b400-ce3b6f393b24 on user Apr 11 19:22:35 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [req-762b84a3-16dc-4bf6-b74a-e98db0e2b361 req-a5aec127-6150-491b-a212-9a446d1f2836 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083637 Apr 11 19:22:35 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 37/123] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:22:34 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:22:35 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [req-0aba7f93-08a0-4c2d-bc03-30e29830a12a req-cf7fe974-f923-4c62-aed5-6ceab8e90c2f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e449d09-f632-4f57-b304-430734096596", "name": "network-vif-plugged", "status": "completed", "tag": "5dea909b-eaed-4978-b239-4177f6cbdfdc"}]} {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:22:35 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-0aba7f93-08a0-4c2d-bc03-30e29830a12a req-cf7fe974-f923-4c62-aed5-6ceab8e90c2f service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:22:35 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-0aba7f93-08a0-4c2d-bc03-30e29830a12a req-cf7fe974-f923-4c62-aed5-6ceab8e90c2f service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:22:35 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-0aba7f93-08a0-4c2d-bc03-30e29830a12a req-cf7fe974-f923-4c62-aed5-6ceab8e90c2f service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:22:35 user devstack@n-api.service[72090]: INFO nova.api.openstack.compute.server_external_events [req-0aba7f93-08a0-4c2d-bc03-30e29830a12a req-cf7fe974-f923-4c62-aed5-6ceab8e90c2f service nova] Creating event network-vif-plugged:5dea909b-eaed-4978-b239-4177f6cbdfdc for instance 8e449d09-f632-4f57-b304-430734096596 on user Apr 11 19:22:35 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [req-0aba7f93-08a0-4c2d-bc03-30e29830a12a req-cf7fe974-f923-4c62-aed5-6ceab8e90c2f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056909 Apr 11 19:22:35 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 41/124] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:22:35 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:22:37 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [req-bc8df6b8-7e5c-47e0-bff4-7535cb19edbd req-4d5ae1e9-9212-4bca-b54c-45b7e0a0b28a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dde6b4d2-9288-474c-b400-ce3b6f393b24", "tag": "66cd1e83-c736-444c-84c7-ecfc2c2b3802"}, {"name": "network-changed", "server_uuid": "dde6b4d2-9288-474c-b400-ce3b6f393b24", "tag": "7e8c8382-c878-4ac7-b626-01cf2bc2f349"}]} {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:22:37 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-bc8df6b8-7e5c-47e0-bff4-7535cb19edbd req-4d5ae1e9-9212-4bca-b54c-45b7e0a0b28a service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:22:37 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-bc8df6b8-7e5c-47e0-bff4-7535cb19edbd req-4d5ae1e9-9212-4bca-b54c-45b7e0a0b28a service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:22:37 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-bc8df6b8-7e5c-47e0-bff4-7535cb19edbd req-4d5ae1e9-9212-4bca-b54c-45b7e0a0b28a service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:22:37 user devstack@n-api.service[72089]: INFO nova.api.openstack.compute.server_external_events [req-bc8df6b8-7e5c-47e0-bff4-7535cb19edbd req-4d5ae1e9-9212-4bca-b54c-45b7e0a0b28a service nova] Creating event network-changed:66cd1e83-c736-444c-84c7-ecfc2c2b3802 for instance dde6b4d2-9288-474c-b400-ce3b6f393b24 on user Apr 11 19:22:37 user devstack@n-api.service[72089]: INFO nova.api.openstack.compute.server_external_events [req-bc8df6b8-7e5c-47e0-bff4-7535cb19edbd req-4d5ae1e9-9212-4bca-b54c-45b7e0a0b28a service nova] Creating event network-changed:7e8c8382-c878-4ac7-b626-01cf2bc2f349 for instance dde6b4d2-9288-474c-b400-ce3b6f393b24 on user Apr 11 19:22:37 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [req-bc8df6b8-7e5c-47e0-bff4-7535cb19edbd req-4d5ae1e9-9212-4bca-b54c-45b7e0a0b28a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.035403 Apr 11 19:22:37 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 47/125] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:22:37 2023] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:22:37 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [req-1dee66fb-4270-43c8-81bc-16014dff8e2d req-7d76800a-4a32-4b67-aed1-3845bb857db6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e449d09-f632-4f57-b304-430734096596", "name": "network-vif-plugged", "status": "completed", "tag": "5dea909b-eaed-4978-b239-4177f6cbdfdc"}]} {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:22:37 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-1dee66fb-4270-43c8-81bc-16014dff8e2d req-7d76800a-4a32-4b67-aed1-3845bb857db6 service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:22:37 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-1dee66fb-4270-43c8-81bc-16014dff8e2d req-7d76800a-4a32-4b67-aed1-3845bb857db6 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:22:37 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-1dee66fb-4270-43c8-81bc-16014dff8e2d req-7d76800a-4a32-4b67-aed1-3845bb857db6 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:22:37 user devstack@n-api.service[72088]: INFO nova.api.openstack.compute.server_external_events [req-1dee66fb-4270-43c8-81bc-16014dff8e2d req-7d76800a-4a32-4b67-aed1-3845bb857db6 service nova] Creating event network-vif-plugged:5dea909b-eaed-4978-b239-4177f6cbdfdc for instance 8e449d09-f632-4f57-b304-430734096596 on user Apr 11 19:22:38 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [req-1dee66fb-4270-43c8-81bc-16014dff8e2d req-7d76800a-4a32-4b67-aed1-3845bb857db6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086442 Apr 11 19:22:38 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 38/126] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:22:37 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:22:41 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [None req-4af49a08-9060-4e67-803b-d4829de4a0fc tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] Calling method '>' {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:22:41 user devstack@n-api.service[72090]: DEBUG nova.compute.api [None req-4af49a08-9060-4e67-803b-d4829de4a0fc tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] [instance: aa0bb9aa-a93d-45bc-9f90-46eeb6416365] Fetching instance by UUID {{(pid=72090) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:22:41 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-4af49a08-9060-4e67-803b-d4829de4a0fc tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:22:41 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-4af49a08-9060-4e67-803b-d4829de4a0fc tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:22:41 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-4af49a08-9060-4e67-803b-d4829de4a0fc tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:22:41 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-4af49a08-9060-4e67-803b-d4829de4a0fc tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:22:41 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-4af49a08-9060-4e67-803b-d4829de4a0fc tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:22:41 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-4af49a08-9060-4e67-803b-d4829de4a0fc tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:22:41 user devstack@n-api.service[72090]: DEBUG dbcounter [-] [72090] Writing DB stats nova_cell1:SELECT=27 {{(pid=72090) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:22:41 user devstack@n-api.service[72090]: DEBUG nova.policy [None req-4af49a08-9060-4e67-803b-d4829de4a0fc tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26f091a1508b4d2689005b660f6a1380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ee7c68b277420ba524c2a99cd444ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72090) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:22:41 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [None req-4af49a08-9060-4e67-803b-d4829de4a0fc tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] 10.0.0.210 "GET /compute/v2.1/servers/aa0bb9aa-a93d-45bc-9f90-46eeb6416365" status: 200 len: 1552 microversion: 2.1 time: 0.248362 Apr 11 19:22:41 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 42/127] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 19:22:41 2023] GET /compute/v2.1/servers/aa0bb9aa-a93d-45bc-9f90-46eeb6416365 => generated 1552 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:22:45 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [None req-dd690744-97e4-4077-b3a0-23ff8e313240 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Action: 'create', calling method: .version_select at 0x7f119df88160>, body: {"keypair": {"name": "tempest-TestStampPattern-1385471309", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBk/F931FMuqnj9QLMI+pGBS0j8hrERQZ0hcpFPwqT+C/Srrx02ZenEuPQP/CTs/VLAlwECMwCuedYJB3t1d4C9VnWF3rrxqO6dqYPkLQMKZthDnoCY8H8zWO0Un/+Ismw=="}} {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:22:45 user devstack@n-api.service[72089]: DEBUG dbcounter [-] [72089] Writing DB stats nova_api:SELECT=75,nova_api:INSERT=5 {{(pid=72089) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:22:45 user devstack@n-api.service[72089]: DEBUG nova.quota [None req-dd690744-97e4-4077-b3a0-23ff8e313240 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Getting quotas for project bceca6e3506e43f68f9cf8d0b56d141b. Resources: {'key_pairs'} {{(pid=72089) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 19:22:45 user devstack@n-api.service[72089]: DEBUG nova.quota [None req-dd690744-97e4-4077-b3a0-23ff8e313240 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Getting quotas for user 3a32a5d0547141a180f655e98567ed9a and project bceca6e3506e43f68f9cf8d0b56d141b. Resources: {'key_pairs'} {{(pid=72089) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 19:22:45 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [None req-dd690744-97e4-4077-b3a0-23ff8e313240 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 395 microversion: 2.1 time: 0.274295 Apr 11 19:22:45 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 48/128] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Apr 11 19:22:45 2023] POST /compute/v2.1/os-keypairs => generated 395 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:22:46 user devstack@n-api.service[72088]: DEBUG dbcounter [-] [72088] Writing DB stats nova_cell0:SELECT=2 {{(pid=72088) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:22:46 user devstack@n-api.service[72088]: DEBUG dbcounter [-] [72088] Writing DB stats nova_cell0:SELECT=24 {{(pid=72088) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:22:46 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [req-60553b95-e633-4966-87d5-dfb32379a0ed req-10b7e88b-5396-405b-a837-656113cb635e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "75a4ef96-a6c3-4ccd-9503-bab0d4174b2b", "tag": "59314c6a-6d9a-4586-a8de-27a566e58eb4"}]} {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:22:46 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-60553b95-e633-4966-87d5-dfb32379a0ed req-10b7e88b-5396-405b-a837-656113cb635e service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:22:46 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-60553b95-e633-4966-87d5-dfb32379a0ed req-10b7e88b-5396-405b-a837-656113cb635e service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:22:46 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-60553b95-e633-4966-87d5-dfb32379a0ed req-10b7e88b-5396-405b-a837-656113cb635e service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:22:46 user devstack@n-api.service[72088]: INFO nova.api.openstack.compute.server_external_events [req-60553b95-e633-4966-87d5-dfb32379a0ed req-10b7e88b-5396-405b-a837-656113cb635e service nova] Creating event network-changed:59314c6a-6d9a-4586-a8de-27a566e58eb4 for instance 75a4ef96-a6c3-4ccd-9503-bab0d4174b2b on user Apr 11 19:22:46 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [req-60553b95-e633-4966-87d5-dfb32379a0ed req-10b7e88b-5396-405b-a837-656113cb635e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041617 Apr 11 19:22:46 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 39/129] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:22:46 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:22:48 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [req-de666ca0-acce-4e34-a6d1-2d7a3186037f req-cc5b58b8-96c7-489e-b033-2d6a95615112 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "75a4ef96-a6c3-4ccd-9503-bab0d4174b2b", "tag": "986b85fe-4d6d-4ac6-95c7-02e58e4073b2"}, {"name": "network-changed", "server_uuid": "75a4ef96-a6c3-4ccd-9503-bab0d4174b2b", "tag": "f3db6cdb-4d7d-4c66-a809-d59e3feaea97"}]} {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:22:48 user devstack@n-api.service[72090]: DEBUG dbcounter [-] [72090] Writing DB stats nova_cell0:SELECT=2 {{(pid=72090) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:22:48 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-de666ca0-acce-4e34-a6d1-2d7a3186037f req-cc5b58b8-96c7-489e-b033-2d6a95615112 service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:22:48 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-de666ca0-acce-4e34-a6d1-2d7a3186037f req-cc5b58b8-96c7-489e-b033-2d6a95615112 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:22:48 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-de666ca0-acce-4e34-a6d1-2d7a3186037f req-cc5b58b8-96c7-489e-b033-2d6a95615112 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:22:48 user devstack@n-api.service[72090]: INFO nova.api.openstack.compute.server_external_events [req-de666ca0-acce-4e34-a6d1-2d7a3186037f req-cc5b58b8-96c7-489e-b033-2d6a95615112 service nova] Creating event network-changed:986b85fe-4d6d-4ac6-95c7-02e58e4073b2 for instance 75a4ef96-a6c3-4ccd-9503-bab0d4174b2b on user Apr 11 19:22:48 user devstack@n-api.service[72090]: INFO nova.api.openstack.compute.server_external_events [req-de666ca0-acce-4e34-a6d1-2d7a3186037f req-cc5b58b8-96c7-489e-b033-2d6a95615112 service nova] Creating event network-changed:f3db6cdb-4d7d-4c66-a809-d59e3feaea97 for instance 75a4ef96-a6c3-4ccd-9503-bab0d4174b2b on user Apr 11 19:22:48 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [req-de666ca0-acce-4e34-a6d1-2d7a3186037f req-cc5b58b8-96c7-489e-b033-2d6a95615112 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.040812 Apr 11 19:22:48 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 43/130] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:22:48 2023] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:22:49 user devstack@n-api.service[72089]: DEBUG dbcounter [-] [72089] Writing DB stats nova_cell1:SELECT=29 {{(pid=72089) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:22:49 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [None req-4a077faa-c9a8-453a-a876-43af5971bfa9 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestStampPattern-server-1153080058", "imageRef": "4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b", "flavorRef": "42", "key_name": "tempest-TestStampPattern-1385471309", "security_groups": [{"name": "tempest-secgroup-smoke-1850724180"}], "networks": [{"uuid": "1fb5e332-872b-4b2a-864b-eca71e3fb7cb"}]}} {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:22:49 user devstack@n-api.service[72089]: DEBUG nova.network.neutron [None req-4a077faa-c9a8-453a-a876-43af5971bfa9 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] validate_networks() for [('1fb5e332-872b-4b2a-864b-eca71e3fb7cb', None, None, None, None, None)] {{(pid=72089) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 11 19:22:50 user devstack@n-api.service[72089]: DEBUG nova.virt.hardware [None req-4a077faa-c9a8-453a-a876-43af5971bfa9 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Flavor limits 0:0:0 {{(pid=72089) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 19:22:50 user devstack@n-api.service[72089]: DEBUG nova.virt.hardware [None req-4a077faa-c9a8-453a-a876-43af5971bfa9 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Image limits 0:0:0 {{(pid=72089) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 19:22:50 user devstack@n-api.service[72089]: DEBUG nova.virt.hardware [None req-4a077faa-c9a8-453a-a876-43af5971bfa9 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Flavor pref 0:0:0 {{(pid=72089) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 19:22:50 user devstack@n-api.service[72089]: DEBUG nova.virt.hardware [None req-4a077faa-c9a8-453a-a876-43af5971bfa9 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Image pref 0:0:0 {{(pid=72089) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 19:22:50 user devstack@n-api.service[72089]: DEBUG nova.virt.hardware [None req-4a077faa-c9a8-453a-a876-43af5971bfa9 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72089) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 19:22:50 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-4a077faa-c9a8-453a-a876-43af5971bfa9 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:22:50 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-4a077faa-c9a8-453a-a876-43af5971bfa9 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:22:50 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-4a077faa-c9a8-453a-a876-43af5971bfa9 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:22:50 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-4a077faa-c9a8-453a-a876-43af5971bfa9 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:22:50 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-4a077faa-c9a8-453a-a876-43af5971bfa9 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:22:50 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-4a077faa-c9a8-453a-a876-43af5971bfa9 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:22:50 user devstack@n-api.service[72089]: DEBUG nova.quota [None req-4a077faa-c9a8-453a-a876-43af5971bfa9 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Getting quotas for project bceca6e3506e43f68f9cf8d0b56d141b. Resources: {'ram', 'instances', 'cores'} {{(pid=72089) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 19:22:50 user devstack@n-api.service[72089]: DEBUG nova.quota [None req-4a077faa-c9a8-453a-a876-43af5971bfa9 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Getting quotas for user 3a32a5d0547141a180f655e98567ed9a and project bceca6e3506e43f68f9cf8d0b56d141b. Resources: {'ram', 'instances', 'cores'} {{(pid=72089) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 19:22:50 user devstack@n-api.service[72089]: DEBUG nova.compute.api [None req-4a077faa-c9a8-453a-a876-43af5971bfa9 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Going to run 1 instances... {{(pid=72089) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 11 19:22:50 user devstack@n-api.service[72089]: DEBUG nova.compute.api [None req-4a077faa-c9a8-453a-a876-43af5971bfa9 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] [instance: d424f88d-5f82-4cac-aa0f-4f99624bd3e7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=72089) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 11 19:22:50 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [None req-4a077faa-c9a8-453a-a876-43af5971bfa9 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.743341 Apr 11 19:22:50 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 49/131] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 11 19:22:49 2023] POST /compute/v2.1/servers => generated 404 bytes in 745 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 11 19:22:50 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [None req-3f299f93-cff5-4f01-94d9-2f41b32aec1a tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Calling method '>' {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:22:50 user devstack@n-api.service[72088]: DEBUG nova.compute.api [None req-3f299f93-cff5-4f01-94d9-2f41b32aec1a tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] [instance: d424f88d-5f82-4cac-aa0f-4f99624bd3e7] Fetching instance by UUID {{(pid=72088) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:22:50 user devstack@n-api.service[72088]: DEBUG nova.policy [None req-3f299f93-cff5-4f01-94d9-2f41b32aec1a tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a32a5d0547141a180f655e98567ed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bceca6e3506e43f68f9cf8d0b56d141b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72088) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:22:50 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [None req-3f299f93-cff5-4f01-94d9-2f41b32aec1a tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d424f88d-5f82-4cac-aa0f-4f99624bd3e7" status: 200 len: 1237 microversion: 2.1 time: 0.086620 Apr 11 19:22:50 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 40/132] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 19:22:50 2023] GET /compute/v2.1/servers/d424f88d-5f82-4cac-aa0f-4f99624bd3e7 => generated 1237 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:22:50 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [req-37b80ca5-271b-48b4-bbb0-445618f09848 req-ae122dce-87a1-4b1b-901d-583fcf378cc7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "75a4ef96-a6c3-4ccd-9503-bab0d4174b2b", "tag": "cde1df21-a053-49fd-a275-51926ac238e5"}, {"name": "network-changed", "server_uuid": "75a4ef96-a6c3-4ccd-9503-bab0d4174b2b", "tag": "8b7ae73d-744e-48fa-af96-b17e7dba1d58"}, {"name": "network-changed", "server_uuid": "75a4ef96-a6c3-4ccd-9503-bab0d4174b2b", "tag": "1f5ae163-b670-4418-b5d3-1f0b70fdd991"}]} {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:22:50 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-37b80ca5-271b-48b4-bbb0-445618f09848 req-ae122dce-87a1-4b1b-901d-583fcf378cc7 service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:22:50 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-37b80ca5-271b-48b4-bbb0-445618f09848 req-ae122dce-87a1-4b1b-901d-583fcf378cc7 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:22:50 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-37b80ca5-271b-48b4-bbb0-445618f09848 req-ae122dce-87a1-4b1b-901d-583fcf378cc7 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:22:50 user devstack@n-api.service[72090]: INFO nova.api.openstack.compute.server_external_events [req-37b80ca5-271b-48b4-bbb0-445618f09848 req-ae122dce-87a1-4b1b-901d-583fcf378cc7 service nova] Creating event network-changed:cde1df21-a053-49fd-a275-51926ac238e5 for instance 75a4ef96-a6c3-4ccd-9503-bab0d4174b2b on user Apr 11 19:22:50 user devstack@n-api.service[72090]: INFO nova.api.openstack.compute.server_external_events [req-37b80ca5-271b-48b4-bbb0-445618f09848 req-ae122dce-87a1-4b1b-901d-583fcf378cc7 service nova] Creating event network-changed:8b7ae73d-744e-48fa-af96-b17e7dba1d58 for instance 75a4ef96-a6c3-4ccd-9503-bab0d4174b2b on user Apr 11 19:22:50 user devstack@n-api.service[72090]: INFO nova.api.openstack.compute.server_external_events [req-37b80ca5-271b-48b4-bbb0-445618f09848 req-ae122dce-87a1-4b1b-901d-583fcf378cc7 service nova] Creating event network-changed:1f5ae163-b670-4418-b5d3-1f0b70fdd991 for instance 75a4ef96-a6c3-4ccd-9503-bab0d4174b2b on user Apr 11 19:22:50 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [req-37b80ca5-271b-48b4-bbb0-445618f09848 req-ae122dce-87a1-4b1b-901d-583fcf378cc7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 513 microversion: 2.1 time: 0.050766 Apr 11 19:22:50 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 44/133] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:22:50 2023] POST /compute/v2.1/os-server-external-events => generated 513 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:22:52 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [req-41184605-0b30-445b-b61b-00bc5b333d83 req-2dd9a906-01a7-46a7-9fbb-8b53e002d350 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dde6b4d2-9288-474c-b400-ce3b6f393b24", "name": "network-vif-plugged", "status": "completed", "tag": "aeb74c01-d96e-4838-8d2c-c2499e3f8770"}]} {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:22:52 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-41184605-0b30-445b-b61b-00bc5b333d83 req-2dd9a906-01a7-46a7-9fbb-8b53e002d350 service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:22:52 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-41184605-0b30-445b-b61b-00bc5b333d83 req-2dd9a906-01a7-46a7-9fbb-8b53e002d350 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:22:52 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-41184605-0b30-445b-b61b-00bc5b333d83 req-2dd9a906-01a7-46a7-9fbb-8b53e002d350 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:22:52 user devstack@n-api.service[72089]: INFO nova.api.openstack.compute.server_external_events [req-41184605-0b30-445b-b61b-00bc5b333d83 req-2dd9a906-01a7-46a7-9fbb-8b53e002d350 service nova] Creating event network-vif-plugged:aeb74c01-d96e-4838-8d2c-c2499e3f8770 for instance dde6b4d2-9288-474c-b400-ce3b6f393b24 on user Apr 11 19:22:52 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [req-41184605-0b30-445b-b61b-00bc5b333d83 req-2dd9a906-01a7-46a7-9fbb-8b53e002d350 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057833 Apr 11 19:22:52 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 50/134] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:22:52 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:22:52 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [req-df654e27-5626-4046-8b1e-63717541735a req-295c6ee9-a62e-4a4e-849e-5c0c3c9f7ca6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "75a4ef96-a6c3-4ccd-9503-bab0d4174b2b", "tag": "6503fe71-75d3-4388-9368-0de318a6d614"}, {"server_uuid": "dde6b4d2-9288-474c-b400-ce3b6f393b24", "name": "network-vif-plugged", "status": "completed", "tag": "4768cc5b-e792-4c52-805a-7f288ed9fbe5"}]} {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:22:52 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-df654e27-5626-4046-8b1e-63717541735a req-295c6ee9-a62e-4a4e-849e-5c0c3c9f7ca6 service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:22:52 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-df654e27-5626-4046-8b1e-63717541735a req-295c6ee9-a62e-4a4e-849e-5c0c3c9f7ca6 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:22:52 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-df654e27-5626-4046-8b1e-63717541735a req-295c6ee9-a62e-4a4e-849e-5c0c3c9f7ca6 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:22:52 user devstack@n-api.service[72088]: INFO nova.api.openstack.compute.server_external_events [req-df654e27-5626-4046-8b1e-63717541735a req-295c6ee9-a62e-4a4e-849e-5c0c3c9f7ca6 service nova] Creating event network-changed:6503fe71-75d3-4388-9368-0de318a6d614 for instance 75a4ef96-a6c3-4ccd-9503-bab0d4174b2b on user Apr 11 19:22:52 user devstack@n-api.service[72088]: INFO nova.api.openstack.compute.server_external_events [req-df654e27-5626-4046-8b1e-63717541735a req-295c6ee9-a62e-4a4e-849e-5c0c3c9f7ca6 service nova] Creating event network-vif-plugged:4768cc5b-e792-4c52-805a-7f288ed9fbe5 for instance dde6b4d2-9288-474c-b400-ce3b6f393b24 on user Apr 11 19:22:52 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [req-df654e27-5626-4046-8b1e-63717541735a req-295c6ee9-a62e-4a4e-849e-5c0c3c9f7ca6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.063545 Apr 11 19:22:52 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 41/135] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:22:52 2023] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:22:54 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [req-ddce300e-a0ff-4b8f-a475-3fe831eeee26 req-49f0f98f-b568-4444-aea5-4b06ee2b3118 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dde6b4d2-9288-474c-b400-ce3b6f393b24", "name": "network-vif-plugged", "status": "completed", "tag": "aeb74c01-d96e-4838-8d2c-c2499e3f8770"}, {"server_uuid": "dde6b4d2-9288-474c-b400-ce3b6f393b24", "name": "network-vif-plugged", "status": "completed", "tag": "66cd1e83-c736-444c-84c7-ecfc2c2b3802"}]} {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:22:54 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-ddce300e-a0ff-4b8f-a475-3fe831eeee26 req-49f0f98f-b568-4444-aea5-4b06ee2b3118 service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:22:54 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-ddce300e-a0ff-4b8f-a475-3fe831eeee26 req-49f0f98f-b568-4444-aea5-4b06ee2b3118 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:22:54 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-ddce300e-a0ff-4b8f-a475-3fe831eeee26 req-49f0f98f-b568-4444-aea5-4b06ee2b3118 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:22:54 user devstack@n-api.service[72090]: INFO nova.api.openstack.compute.server_external_events [req-ddce300e-a0ff-4b8f-a475-3fe831eeee26 req-49f0f98f-b568-4444-aea5-4b06ee2b3118 service nova] Creating event network-vif-plugged:aeb74c01-d96e-4838-8d2c-c2499e3f8770 for instance dde6b4d2-9288-474c-b400-ce3b6f393b24 on user Apr 11 19:22:54 user devstack@n-api.service[72090]: INFO nova.api.openstack.compute.server_external_events [req-ddce300e-a0ff-4b8f-a475-3fe831eeee26 req-49f0f98f-b568-4444-aea5-4b06ee2b3118 service nova] Creating event network-vif-plugged:66cd1e83-c736-444c-84c7-ecfc2c2b3802 for instance dde6b4d2-9288-474c-b400-ce3b6f393b24 on user Apr 11 19:22:54 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [req-ddce300e-a0ff-4b8f-a475-3fe831eeee26 req-49f0f98f-b568-4444-aea5-4b06ee2b3118 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.047340 Apr 11 19:22:54 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 45/136] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:22:54 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:22:55 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [req-5fe10e84-0e6e-4123-b935-8f586d957171 req-9edb750b-e959-459d-8fab-b45dbb1a727d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dde6b4d2-9288-474c-b400-ce3b6f393b24", "name": "network-vif-plugged", "status": "completed", "tag": "4768cc5b-e792-4c52-805a-7f288ed9fbe5"}, {"server_uuid": "dde6b4d2-9288-474c-b400-ce3b6f393b24", "name": "network-vif-plugged", "status": "completed", "tag": "1d14016e-af6d-4ce8-bd51-8a9dba7c4261"}, {"server_uuid": "dde6b4d2-9288-474c-b400-ce3b6f393b24", "name": "network-vif-plugged", "status": "completed", "tag": "1d14016e-af6d-4ce8-bd51-8a9dba7c4261"}, {"server_uuid": "dde6b4d2-9288-474c-b400-ce3b6f393b24", "name": "network-vif-plugged", "status": "completed", "tag": "576d5a47-cb3a-4794-bc1e-dcbb82e25352"}, {"server_uuid": "dde6b4d2-9288-474c-b400-ce3b6f393b24", "name": "network-vif-plugged", "status": "completed", "tag": "576d5a47-cb3a-4794-bc1e-dcbb82e25352"}, {"server_uuid": "dde6b4d2-9288-474c-b400-ce3b6f393b24", "name": "network-vif-plugged", "status": "completed", "tag": "db299c0f-eae0-45ae-ba9c-037c50e06a3c"}]} {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:22:55 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-5fe10e84-0e6e-4123-b935-8f586d957171 req-9edb750b-e959-459d-8fab-b45dbb1a727d service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:22:55 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-5fe10e84-0e6e-4123-b935-8f586d957171 req-9edb750b-e959-459d-8fab-b45dbb1a727d service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:22:55 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-5fe10e84-0e6e-4123-b935-8f586d957171 req-9edb750b-e959-459d-8fab-b45dbb1a727d service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:22:55 user devstack@n-api.service[72089]: INFO nova.api.openstack.compute.server_external_events [req-5fe10e84-0e6e-4123-b935-8f586d957171 req-9edb750b-e959-459d-8fab-b45dbb1a727d service nova] Creating event network-vif-plugged:4768cc5b-e792-4c52-805a-7f288ed9fbe5 for instance dde6b4d2-9288-474c-b400-ce3b6f393b24 on user Apr 11 19:22:55 user devstack@n-api.service[72089]: INFO nova.api.openstack.compute.server_external_events [req-5fe10e84-0e6e-4123-b935-8f586d957171 req-9edb750b-e959-459d-8fab-b45dbb1a727d service nova] Creating event network-vif-plugged:1d14016e-af6d-4ce8-bd51-8a9dba7c4261 for instance dde6b4d2-9288-474c-b400-ce3b6f393b24 on user Apr 11 19:22:55 user devstack@n-api.service[72089]: INFO nova.api.openstack.compute.server_external_events [req-5fe10e84-0e6e-4123-b935-8f586d957171 req-9edb750b-e959-459d-8fab-b45dbb1a727d service nova] Creating event network-vif-plugged:1d14016e-af6d-4ce8-bd51-8a9dba7c4261 for instance dde6b4d2-9288-474c-b400-ce3b6f393b24 on user Apr 11 19:22:55 user devstack@n-api.service[72089]: INFO nova.api.openstack.compute.server_external_events [req-5fe10e84-0e6e-4123-b935-8f586d957171 req-9edb750b-e959-459d-8fab-b45dbb1a727d service nova] Creating event network-vif-plugged:576d5a47-cb3a-4794-bc1e-dcbb82e25352 for instance dde6b4d2-9288-474c-b400-ce3b6f393b24 on user Apr 11 19:22:55 user devstack@n-api.service[72089]: INFO nova.api.openstack.compute.server_external_events [req-5fe10e84-0e6e-4123-b935-8f586d957171 req-9edb750b-e959-459d-8fab-b45dbb1a727d service nova] Creating event network-vif-plugged:576d5a47-cb3a-4794-bc1e-dcbb82e25352 for instance dde6b4d2-9288-474c-b400-ce3b6f393b24 on user Apr 11 19:22:55 user devstack@n-api.service[72089]: INFO nova.api.openstack.compute.server_external_events [req-5fe10e84-0e6e-4123-b935-8f586d957171 req-9edb750b-e959-459d-8fab-b45dbb1a727d service nova] Creating event network-vif-plugged:db299c0f-eae0-45ae-ba9c-037c50e06a3c for instance dde6b4d2-9288-474c-b400-ce3b6f393b24 on user Apr 11 19:22:55 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [req-5fe10e84-0e6e-4123-b935-8f586d957171 req-9edb750b-e959-459d-8fab-b45dbb1a727d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 1038 microversion: 2.1 time: 0.039807 Apr 11 19:22:55 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 51/137] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:22:55 2023] POST /compute/v2.1/os-server-external-events => generated 1038 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:22:56 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [req-dc7a9d56-07ee-4478-aaff-c353504c55a4 req-4920a599-a958-4e83-a0bc-c9d2e781e5e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dde6b4d2-9288-474c-b400-ce3b6f393b24", "name": "network-vif-plugged", "status": "completed", "tag": "66cd1e83-c736-444c-84c7-ecfc2c2b3802"}]} {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:22:56 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-dc7a9d56-07ee-4478-aaff-c353504c55a4 req-4920a599-a958-4e83-a0bc-c9d2e781e5e0 service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:22:56 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-dc7a9d56-07ee-4478-aaff-c353504c55a4 req-4920a599-a958-4e83-a0bc-c9d2e781e5e0 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:22:56 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-dc7a9d56-07ee-4478-aaff-c353504c55a4 req-4920a599-a958-4e83-a0bc-c9d2e781e5e0 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:22:56 user devstack@n-api.service[72088]: INFO nova.api.openstack.compute.server_external_events [req-dc7a9d56-07ee-4478-aaff-c353504c55a4 req-4920a599-a958-4e83-a0bc-c9d2e781e5e0 service nova] Creating event network-vif-plugged:66cd1e83-c736-444c-84c7-ecfc2c2b3802 for instance dde6b4d2-9288-474c-b400-ce3b6f393b24 on user Apr 11 19:22:56 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [req-dc7a9d56-07ee-4478-aaff-c353504c55a4 req-4920a599-a958-4e83-a0bc-c9d2e781e5e0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032005 Apr 11 19:22:56 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 42/138] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:22:56 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:22:57 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [req-dfd9b4c7-7443-478f-b613-6d104069e820 req-06599f2f-ad81-4dd7-955d-2fdfd96dce64 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dde6b4d2-9288-474c-b400-ce3b6f393b24", "name": "network-vif-plugged", "status": "completed", "tag": "db299c0f-eae0-45ae-ba9c-037c50e06a3c"}, {"name": "network-changed", "server_uuid": "d424f88d-5f82-4cac-aa0f-4f99624bd3e7", "tag": "93054605-985d-4168-9809-21feb31c1346"}, {"server_uuid": "dde6b4d2-9288-474c-b400-ce3b6f393b24", "name": "network-vif-plugged", "status": "completed", "tag": "7e8c8382-c878-4ac7-b626-01cf2bc2f349"}, {"server_uuid": "dde6b4d2-9288-474c-b400-ce3b6f393b24", "name": "network-vif-plugged", "status": "completed", "tag": "7e8c8382-c878-4ac7-b626-01cf2bc2f349"}]} {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:22:57 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-dfd9b4c7-7443-478f-b613-6d104069e820 req-06599f2f-ad81-4dd7-955d-2fdfd96dce64 service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:22:57 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-dfd9b4c7-7443-478f-b613-6d104069e820 req-06599f2f-ad81-4dd7-955d-2fdfd96dce64 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:22:57 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-dfd9b4c7-7443-478f-b613-6d104069e820 req-06599f2f-ad81-4dd7-955d-2fdfd96dce64 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:22:57 user devstack@n-api.service[72090]: INFO nova.api.openstack.compute.server_external_events [req-dfd9b4c7-7443-478f-b613-6d104069e820 req-06599f2f-ad81-4dd7-955d-2fdfd96dce64 service nova] Creating event network-vif-plugged:db299c0f-eae0-45ae-ba9c-037c50e06a3c for instance dde6b4d2-9288-474c-b400-ce3b6f393b24 on user Apr 11 19:22:57 user devstack@n-api.service[72090]: INFO nova.api.openstack.compute.server_external_events [req-dfd9b4c7-7443-478f-b613-6d104069e820 req-06599f2f-ad81-4dd7-955d-2fdfd96dce64 service nova] Creating event network-changed:93054605-985d-4168-9809-21feb31c1346 for instance d424f88d-5f82-4cac-aa0f-4f99624bd3e7 on user Apr 11 19:22:57 user devstack@n-api.service[72090]: INFO nova.api.openstack.compute.server_external_events [req-dfd9b4c7-7443-478f-b613-6d104069e820 req-06599f2f-ad81-4dd7-955d-2fdfd96dce64 service nova] Creating event network-vif-plugged:7e8c8382-c878-4ac7-b626-01cf2bc2f349 for instance dde6b4d2-9288-474c-b400-ce3b6f393b24 on user Apr 11 19:22:57 user devstack@n-api.service[72090]: INFO nova.api.openstack.compute.server_external_events [req-dfd9b4c7-7443-478f-b613-6d104069e820 req-06599f2f-ad81-4dd7-955d-2fdfd96dce64 service nova] Creating event network-vif-plugged:7e8c8382-c878-4ac7-b626-01cf2bc2f349 for instance dde6b4d2-9288-474c-b400-ce3b6f393b24 on user Apr 11 19:22:57 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [req-dfd9b4c7-7443-478f-b613-6d104069e820 req-06599f2f-ad81-4dd7-955d-2fdfd96dce64 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 692 microversion: 2.1 time: 0.035917 Apr 11 19:22:57 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 46/139] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:22:57 2023] POST /compute/v2.1/os-server-external-events => generated 692 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:22:59 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [req-a3573a88-9f18-45de-9f6d-b5efae3833e6 req-1eedb2b7-281c-4aad-91d2-a08064e4dbcd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d424f88d-5f82-4cac-aa0f-4f99624bd3e7", "name": "network-vif-plugged", "status": "completed", "tag": "93054605-985d-4168-9809-21feb31c1346"}, {"server_uuid": "d424f88d-5f82-4cac-aa0f-4f99624bd3e7", "name": "network-vif-plugged", "status": "completed", "tag": "93054605-985d-4168-9809-21feb31c1346"}]} {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:22:59 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-a3573a88-9f18-45de-9f6d-b5efae3833e6 req-1eedb2b7-281c-4aad-91d2-a08064e4dbcd service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:22:59 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-a3573a88-9f18-45de-9f6d-b5efae3833e6 req-1eedb2b7-281c-4aad-91d2-a08064e4dbcd service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:22:59 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-a3573a88-9f18-45de-9f6d-b5efae3833e6 req-1eedb2b7-281c-4aad-91d2-a08064e4dbcd service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:22:59 user devstack@n-api.service[72089]: INFO nova.api.openstack.compute.server_external_events [req-a3573a88-9f18-45de-9f6d-b5efae3833e6 req-1eedb2b7-281c-4aad-91d2-a08064e4dbcd service nova] Creating event network-vif-plugged:93054605-985d-4168-9809-21feb31c1346 for instance d424f88d-5f82-4cac-aa0f-4f99624bd3e7 on user Apr 11 19:22:59 user devstack@n-api.service[72089]: INFO nova.api.openstack.compute.server_external_events [req-a3573a88-9f18-45de-9f6d-b5efae3833e6 req-1eedb2b7-281c-4aad-91d2-a08064e4dbcd service nova] Creating event network-vif-plugged:93054605-985d-4168-9809-21feb31c1346 for instance d424f88d-5f82-4cac-aa0f-4f99624bd3e7 on user Apr 11 19:22:59 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [req-a3573a88-9f18-45de-9f6d-b5efae3833e6 req-1eedb2b7-281c-4aad-91d2-a08064e4dbcd service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.030316 Apr 11 19:22:59 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 52/140] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:22:59 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:23:01 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [req-8937b631-bdd9-4f91-a6cb-53e09916d59a req-2528f8f6-6089-437f-bc14-bc8d36ea2bdd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75a4ef96-a6c3-4ccd-9503-bab0d4174b2b", "name": "network-vif-plugged", "status": "completed", "tag": "59314c6a-6d9a-4586-a8de-27a566e58eb4"}]} {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:23:01 user devstack@n-api.service[72088]: DEBUG dbcounter [-] [72088] Writing DB stats nova_cell0:SELECT=2 {{(pid=72088) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:23:01 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-8937b631-bdd9-4f91-a6cb-53e09916d59a req-2528f8f6-6089-437f-bc14-bc8d36ea2bdd service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:23:01 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-8937b631-bdd9-4f91-a6cb-53e09916d59a req-2528f8f6-6089-437f-bc14-bc8d36ea2bdd service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:23:01 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-8937b631-bdd9-4f91-a6cb-53e09916d59a req-2528f8f6-6089-437f-bc14-bc8d36ea2bdd service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:23:01 user devstack@n-api.service[72088]: DEBUG dbcounter [-] [72088] Writing DB stats nova_cell1:SELECT=13 {{(pid=72088) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:23:01 user devstack@n-api.service[72088]: INFO nova.api.openstack.compute.server_external_events [req-8937b631-bdd9-4f91-a6cb-53e09916d59a req-2528f8f6-6089-437f-bc14-bc8d36ea2bdd service nova] Creating event network-vif-plugged:59314c6a-6d9a-4586-a8de-27a566e58eb4 for instance 75a4ef96-a6c3-4ccd-9503-bab0d4174b2b on user Apr 11 19:23:01 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [req-8937b631-bdd9-4f91-a6cb-53e09916d59a req-2528f8f6-6089-437f-bc14-bc8d36ea2bdd service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040582 Apr 11 19:23:01 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 43/141] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:23:01 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:23:02 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [req-31371170-fcfb-434a-97a4-ada65984a1f6 req-a84963d9-bfd4-4e0a-b648-7d261c8c8bc3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75a4ef96-a6c3-4ccd-9503-bab0d4174b2b", "name": "network-vif-plugged", "status": "completed", "tag": "986b85fe-4d6d-4ac6-95c7-02e58e4073b2"}]} {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:23:02 user devstack@n-api.service[72090]: DEBUG dbcounter [-] [72090] Writing DB stats nova_api:SELECT=22 {{(pid=72090) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:23:02 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-31371170-fcfb-434a-97a4-ada65984a1f6 req-a84963d9-bfd4-4e0a-b648-7d261c8c8bc3 service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:23:02 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-31371170-fcfb-434a-97a4-ada65984a1f6 req-a84963d9-bfd4-4e0a-b648-7d261c8c8bc3 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:23:02 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-31371170-fcfb-434a-97a4-ada65984a1f6 req-a84963d9-bfd4-4e0a-b648-7d261c8c8bc3 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:23:02 user devstack@n-api.service[72090]: INFO nova.api.openstack.compute.server_external_events [req-31371170-fcfb-434a-97a4-ada65984a1f6 req-a84963d9-bfd4-4e0a-b648-7d261c8c8bc3 service nova] Creating event network-vif-plugged:986b85fe-4d6d-4ac6-95c7-02e58e4073b2 for instance 75a4ef96-a6c3-4ccd-9503-bab0d4174b2b on user Apr 11 19:23:02 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [req-31371170-fcfb-434a-97a4-ada65984a1f6 req-a84963d9-bfd4-4e0a-b648-7d261c8c8bc3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050740 Apr 11 19:23:02 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 47/142] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:23:02 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:23:03 user devstack@n-api.service[72089]: DEBUG dbcounter [-] [72089] Writing DB stats nova_cell0:SELECT=2 {{(pid=72089) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:23:03 user devstack@n-api.service[72089]: DEBUG dbcounter [-] [72089] Writing DB stats nova_cell0:SELECT=10 {{(pid=72089) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:23:03 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [None req-393a6164-4c2b-4cb1-bdc2-b5cc6a2d8528 tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] Calling method '>' {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:23:03 user devstack@n-api.service[72089]: DEBUG nova.compute.api [None req-393a6164-4c2b-4cb1-bdc2-b5cc6a2d8528 tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] [instance: 1ded3918-3bae-465c-a53c-e88011914c50] Fetching instance by UUID {{(pid=72089) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:23:03 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-393a6164-4c2b-4cb1-bdc2-b5cc6a2d8528 tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:23:03 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-393a6164-4c2b-4cb1-bdc2-b5cc6a2d8528 tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:23:03 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-393a6164-4c2b-4cb1-bdc2-b5cc6a2d8528 tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:23:03 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-393a6164-4c2b-4cb1-bdc2-b5cc6a2d8528 tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:23:03 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-393a6164-4c2b-4cb1-bdc2-b5cc6a2d8528 tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:23:03 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-393a6164-4c2b-4cb1-bdc2-b5cc6a2d8528 tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:23:03 user devstack@n-api.service[72089]: DEBUG nova.policy [None req-393a6164-4c2b-4cb1-bdc2-b5cc6a2d8528 tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26555f273c374f9ba0ed151d2f1cbaef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4c6f64ecc104480a149bcfd0610dfef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72089) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:23:03 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [None req-393a6164-4c2b-4cb1-bdc2-b5cc6a2d8528 tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1ded3918-3bae-465c-a53c-e88011914c50" status: 200 len: 1550 microversion: 2.1 time: 0.388355 Apr 11 19:23:03 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 53/143] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 19:23:03 2023] GET /compute/v2.1/servers/1ded3918-3bae-465c-a53c-e88011914c50 => generated 1550 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:23:04 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [req-b2732c92-c89a-41f5-a637-c1808c6f8670 req-b90558c1-6a43-4706-905e-674227bfa56b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75a4ef96-a6c3-4ccd-9503-bab0d4174b2b", "name": "network-vif-plugged", "status": "completed", "tag": "59314c6a-6d9a-4586-a8de-27a566e58eb4"}, {"server_uuid": "75a4ef96-a6c3-4ccd-9503-bab0d4174b2b", "name": "network-vif-plugged", "status": "completed", "tag": "f3db6cdb-4d7d-4c66-a809-d59e3feaea97"}, {"server_uuid": "75a4ef96-a6c3-4ccd-9503-bab0d4174b2b", "name": "network-vif-plugged", "status": "completed", "tag": "f3db6cdb-4d7d-4c66-a809-d59e3feaea97"}, {"server_uuid": "75a4ef96-a6c3-4ccd-9503-bab0d4174b2b", "name": "network-vif-plugged", "status": "completed", "tag": "cde1df21-a053-49fd-a275-51926ac238e5"}, {"server_uuid": "75a4ef96-a6c3-4ccd-9503-bab0d4174b2b", "name": "network-vif-plugged", "status": "completed", "tag": "cde1df21-a053-49fd-a275-51926ac238e5"}, {"server_uuid": "75a4ef96-a6c3-4ccd-9503-bab0d4174b2b", "name": "network-vif-plugged", "status": "completed", "tag": "8b7ae73d-744e-48fa-af96-b17e7dba1d58"}, {"server_uuid": "75a4ef96-a6c3-4ccd-9503-bab0d4174b2b", "name": "network-vif-plugged", "status": "completed", "tag": "8b7ae73d-744e-48fa-af96-b17e7dba1d58"}]} {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:23:04 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-b2732c92-c89a-41f5-a637-c1808c6f8670 req-b90558c1-6a43-4706-905e-674227bfa56b service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:23:04 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-b2732c92-c89a-41f5-a637-c1808c6f8670 req-b90558c1-6a43-4706-905e-674227bfa56b service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:23:04 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-b2732c92-c89a-41f5-a637-c1808c6f8670 req-b90558c1-6a43-4706-905e-674227bfa56b service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:23:04 user devstack@n-api.service[72088]: INFO nova.api.openstack.compute.server_external_events [req-b2732c92-c89a-41f5-a637-c1808c6f8670 req-b90558c1-6a43-4706-905e-674227bfa56b service nova] Creating event network-vif-plugged:59314c6a-6d9a-4586-a8de-27a566e58eb4 for instance 75a4ef96-a6c3-4ccd-9503-bab0d4174b2b on user Apr 11 19:23:04 user devstack@n-api.service[72088]: INFO nova.api.openstack.compute.server_external_events [req-b2732c92-c89a-41f5-a637-c1808c6f8670 req-b90558c1-6a43-4706-905e-674227bfa56b service nova] Creating event network-vif-plugged:f3db6cdb-4d7d-4c66-a809-d59e3feaea97 for instance 75a4ef96-a6c3-4ccd-9503-bab0d4174b2b on user Apr 11 19:23:04 user devstack@n-api.service[72088]: INFO nova.api.openstack.compute.server_external_events [req-b2732c92-c89a-41f5-a637-c1808c6f8670 req-b90558c1-6a43-4706-905e-674227bfa56b service nova] Creating event network-vif-plugged:f3db6cdb-4d7d-4c66-a809-d59e3feaea97 for instance 75a4ef96-a6c3-4ccd-9503-bab0d4174b2b on user Apr 11 19:23:04 user devstack@n-api.service[72088]: INFO nova.api.openstack.compute.server_external_events [req-b2732c92-c89a-41f5-a637-c1808c6f8670 req-b90558c1-6a43-4706-905e-674227bfa56b service nova] Creating event network-vif-plugged:cde1df21-a053-49fd-a275-51926ac238e5 for instance 75a4ef96-a6c3-4ccd-9503-bab0d4174b2b on user Apr 11 19:23:04 user devstack@n-api.service[72088]: INFO nova.api.openstack.compute.server_external_events [req-b2732c92-c89a-41f5-a637-c1808c6f8670 req-b90558c1-6a43-4706-905e-674227bfa56b service nova] Creating event network-vif-plugged:cde1df21-a053-49fd-a275-51926ac238e5 for instance 75a4ef96-a6c3-4ccd-9503-bab0d4174b2b on user Apr 11 19:23:04 user devstack@n-api.service[72088]: INFO nova.api.openstack.compute.server_external_events [req-b2732c92-c89a-41f5-a637-c1808c6f8670 req-b90558c1-6a43-4706-905e-674227bfa56b service nova] Creating event network-vif-plugged:8b7ae73d-744e-48fa-af96-b17e7dba1d58 for instance 75a4ef96-a6c3-4ccd-9503-bab0d4174b2b on user Apr 11 19:23:04 user devstack@n-api.service[72088]: INFO nova.api.openstack.compute.server_external_events [req-b2732c92-c89a-41f5-a637-c1808c6f8670 req-b90558c1-6a43-4706-905e-674227bfa56b service nova] Creating event network-vif-plugged:8b7ae73d-744e-48fa-af96-b17e7dba1d58 for instance 75a4ef96-a6c3-4ccd-9503-bab0d4174b2b on user Apr 11 19:23:04 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [req-b2732c92-c89a-41f5-a637-c1808c6f8670 req-b90558c1-6a43-4706-905e-674227bfa56b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 1209 microversion: 2.1 time: 0.085851 Apr 11 19:23:04 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 44/144] 10.0.0.210 () {68 vars in 1395 bytes} [Tue Apr 11 19:23:04 2023] POST /compute/v2.1/os-server-external-events => generated 1209 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:23:04 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [req-89fe84cd-7dfe-4373-9a76-3c9dba616950 req-e6623d22-6794-46e8-8c4a-d67ea8ffc14d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75a4ef96-a6c3-4ccd-9503-bab0d4174b2b", "name": "network-vif-plugged", "status": "completed", "tag": "986b85fe-4d6d-4ac6-95c7-02e58e4073b2"}, {"server_uuid": "75a4ef96-a6c3-4ccd-9503-bab0d4174b2b", "name": "network-vif-plugged", "status": "completed", "tag": "1f5ae163-b670-4418-b5d3-1f0b70fdd991"}, {"server_uuid": "75a4ef96-a6c3-4ccd-9503-bab0d4174b2b", "name": "network-vif-plugged", "status": "completed", "tag": "1f5ae163-b670-4418-b5d3-1f0b70fdd991"}]} {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:23:04 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [None req-7f770591-4e29-4969-b7eb-2a8432306a1a tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] Calling method '>' {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:23:04 user devstack@n-api.service[72090]: DEBUG nova.compute.api [None req-7f770591-4e29-4969-b7eb-2a8432306a1a tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] [instance: a49d379e-3976-4d68-b6df-f572a922107c] Fetching instance by UUID {{(pid=72090) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:23:04 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-7f770591-4e29-4969-b7eb-2a8432306a1a tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:23:04 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-7f770591-4e29-4969-b7eb-2a8432306a1a tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:23:04 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-7f770591-4e29-4969-b7eb-2a8432306a1a tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:23:04 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-7f770591-4e29-4969-b7eb-2a8432306a1a tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:23:04 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-7f770591-4e29-4969-b7eb-2a8432306a1a tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:23:04 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-7f770591-4e29-4969-b7eb-2a8432306a1a tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:23:04 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-89fe84cd-7dfe-4373-9a76-3c9dba616950 req-e6623d22-6794-46e8-8c4a-d67ea8ffc14d service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:23:04 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-89fe84cd-7dfe-4373-9a76-3c9dba616950 req-e6623d22-6794-46e8-8c4a-d67ea8ffc14d service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:23:04 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-89fe84cd-7dfe-4373-9a76-3c9dba616950 req-e6623d22-6794-46e8-8c4a-d67ea8ffc14d service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:23:04 user devstack@n-api.service[72089]: INFO nova.api.openstack.compute.server_external_events [req-89fe84cd-7dfe-4373-9a76-3c9dba616950 req-e6623d22-6794-46e8-8c4a-d67ea8ffc14d service nova] Creating event network-vif-plugged:986b85fe-4d6d-4ac6-95c7-02e58e4073b2 for instance 75a4ef96-a6c3-4ccd-9503-bab0d4174b2b on user Apr 11 19:23:04 user devstack@n-api.service[72089]: INFO nova.api.openstack.compute.server_external_events [req-89fe84cd-7dfe-4373-9a76-3c9dba616950 req-e6623d22-6794-46e8-8c4a-d67ea8ffc14d service nova] Creating event network-vif-plugged:1f5ae163-b670-4418-b5d3-1f0b70fdd991 for instance 75a4ef96-a6c3-4ccd-9503-bab0d4174b2b on user Apr 11 19:23:04 user devstack@n-api.service[72089]: INFO nova.api.openstack.compute.server_external_events [req-89fe84cd-7dfe-4373-9a76-3c9dba616950 req-e6623d22-6794-46e8-8c4a-d67ea8ffc14d service nova] Creating event network-vif-plugged:1f5ae163-b670-4418-b5d3-1f0b70fdd991 for instance 75a4ef96-a6c3-4ccd-9503-bab0d4174b2b on user Apr 11 19:23:04 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [req-89fe84cd-7dfe-4373-9a76-3c9dba616950 req-e6623d22-6794-46e8-8c4a-d67ea8ffc14d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.044136 Apr 11 19:23:04 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 54/145] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:23:04 2023] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:23:04 user devstack@n-api.service[72090]: DEBUG nova.policy [None req-7f770591-4e29-4969-b7eb-2a8432306a1a tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e95f55f8f9497592320a19f2ca7fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9f8ee2edca748e0bd03ace6f93be649', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72090) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:23:04 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [None req-7f770591-4e29-4969-b7eb-2a8432306a1a tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a49d379e-3976-4d68-b6df-f572a922107c" status: 200 len: 1526 microversion: 2.1 time: 0.184587 Apr 11 19:23:04 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 48/146] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 19:23:04 2023] GET /compute/v2.1/servers/a49d379e-3976-4d68-b6df-f572a922107c => generated 1526 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:23:05 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [None req-9900f330-f9a0-4955-9c68-69da17201def tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] Calling method '>' {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:23:05 user devstack@n-api.service[72088]: DEBUG nova.compute.api [None req-9900f330-f9a0-4955-9c68-69da17201def tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] [instance: 9941d033-15c2-4069-b9a6-f80840e95a38] Fetching instance by UUID {{(pid=72088) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:23:05 user devstack@n-api.service[72088]: DEBUG dbcounter [-] [72088] Writing DB stats nova_api:SELECT=18 {{(pid=72088) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:23:05 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-9900f330-f9a0-4955-9c68-69da17201def tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:23:05 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-9900f330-f9a0-4955-9c68-69da17201def tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:23:05 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-9900f330-f9a0-4955-9c68-69da17201def tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:23:05 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-9900f330-f9a0-4955-9c68-69da17201def tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:23:05 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-9900f330-f9a0-4955-9c68-69da17201def tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:23:05 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-9900f330-f9a0-4955-9c68-69da17201def tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:23:06 user devstack@n-api.service[72088]: DEBUG nova.policy [None req-9900f330-f9a0-4955-9c68-69da17201def tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b4a383f04d4269a0099a738e14807e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f153e6b272924b8fa0ef28fb5f0970bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72088) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:23:06 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [None req-9900f330-f9a0-4955-9c68-69da17201def tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9941d033-15c2-4069-b9a6-f80840e95a38" status: 200 len: 1542 microversion: 2.1 time: 0.242845 Apr 11 19:23:06 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 45/147] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 19:23:05 2023] GET /compute/v2.1/servers/9941d033-15c2-4069-b9a6-f80840e95a38 => generated 1542 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:23:06 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [req-2be813db-5b9a-4537-ae97-e68346204210 req-5ae47cb3-8c90-402b-97ca-2939981ce3d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75a4ef96-a6c3-4ccd-9503-bab0d4174b2b", "name": "network-vif-plugged", "status": "completed", "tag": "6503fe71-75d3-4388-9368-0de318a6d614"}, {"server_uuid": "75a4ef96-a6c3-4ccd-9503-bab0d4174b2b", "name": "network-vif-plugged", "status": "completed", "tag": "6503fe71-75d3-4388-9368-0de318a6d614"}]} {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:23:06 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-2be813db-5b9a-4537-ae97-e68346204210 req-5ae47cb3-8c90-402b-97ca-2939981ce3d1 service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:23:06 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-2be813db-5b9a-4537-ae97-e68346204210 req-5ae47cb3-8c90-402b-97ca-2939981ce3d1 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:23:06 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-2be813db-5b9a-4537-ae97-e68346204210 req-5ae47cb3-8c90-402b-97ca-2939981ce3d1 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:23:06 user devstack@n-api.service[72089]: INFO nova.api.openstack.compute.server_external_events [req-2be813db-5b9a-4537-ae97-e68346204210 req-5ae47cb3-8c90-402b-97ca-2939981ce3d1 service nova] Creating event network-vif-plugged:6503fe71-75d3-4388-9368-0de318a6d614 for instance 75a4ef96-a6c3-4ccd-9503-bab0d4174b2b on user Apr 11 19:23:06 user devstack@n-api.service[72089]: INFO nova.api.openstack.compute.server_external_events [req-2be813db-5b9a-4537-ae97-e68346204210 req-5ae47cb3-8c90-402b-97ca-2939981ce3d1 service nova] Creating event network-vif-plugged:6503fe71-75d3-4388-9368-0de318a6d614 for instance 75a4ef96-a6c3-4ccd-9503-bab0d4174b2b on user Apr 11 19:23:06 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [req-2be813db-5b9a-4537-ae97-e68346204210 req-5ae47cb3-8c90-402b-97ca-2939981ce3d1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.033725 Apr 11 19:23:06 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 55/148] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:23:06 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:23:08 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [None req-af500dab-a6a7-4158-b7b5-deeb268bf06d tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] Calling method '>' {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:23:08 user devstack@n-api.service[72090]: DEBUG nova.compute.api [None req-af500dab-a6a7-4158-b7b5-deeb268bf06d tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] [instance: dde6b4d2-9288-474c-b400-ce3b6f393b24] Fetching instance by UUID {{(pid=72090) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:23:08 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-af500dab-a6a7-4158-b7b5-deeb268bf06d tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:23:08 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-af500dab-a6a7-4158-b7b5-deeb268bf06d tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:23:08 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-af500dab-a6a7-4158-b7b5-deeb268bf06d tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:23:08 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-af500dab-a6a7-4158-b7b5-deeb268bf06d tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:23:08 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-af500dab-a6a7-4158-b7b5-deeb268bf06d tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:23:08 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-af500dab-a6a7-4158-b7b5-deeb268bf06d tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:23:09 user devstack@n-api.service[72090]: DEBUG nova.policy [None req-af500dab-a6a7-4158-b7b5-deeb268bf06d tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f44f0d0807342ba9b851e7530a82294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1afa97b49ae647c899a05d54b7f0f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72090) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:23:09 user devstack@n-api.service[72090]: DEBUG nova.policy [None req-af500dab-a6a7-4158-b7b5-deeb268bf06d tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f44f0d0807342ba9b851e7530a82294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1afa97b49ae647c899a05d54b7f0f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72090) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:23:09 user devstack@n-api.service[72090]: DEBUG nova.policy [None req-af500dab-a6a7-4158-b7b5-deeb268bf06d tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f44f0d0807342ba9b851e7530a82294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1afa97b49ae647c899a05d54b7f0f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72090) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:23:09 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [None req-af500dab-a6a7-4158-b7b5-deeb268bf06d tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] 10.0.0.210 "GET /compute/v2.1/servers/dde6b4d2-9288-474c-b400-ce3b6f393b24" status: 200 len: 2824 microversion: 2.42 time: 0.327031 Apr 11 19:23:09 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 49/149] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 19:23:08 2023] GET /compute/v2.1/servers/dde6b4d2-9288-474c-b400-ce3b6f393b24 => generated 2824 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 19:23:09 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [None req-09e9b37d-b089-45be-b866-baab9bbeb1d5 tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] Calling method '>' {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:23:09 user devstack@n-api.service[72088]: DEBUG nova.compute.api [None req-09e9b37d-b089-45be-b866-baab9bbeb1d5 tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] [instance: b71d95ed-728d-4386-b7c6-50b252718ca9] Fetching instance by UUID {{(pid=72088) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:23:09 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-09e9b37d-b089-45be-b866-baab9bbeb1d5 tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:23:09 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-09e9b37d-b089-45be-b866-baab9bbeb1d5 tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:23:09 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-09e9b37d-b089-45be-b866-baab9bbeb1d5 tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:23:09 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-09e9b37d-b089-45be-b866-baab9bbeb1d5 tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:23:09 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-09e9b37d-b089-45be-b866-baab9bbeb1d5 tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:23:09 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-09e9b37d-b089-45be-b866-baab9bbeb1d5 tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:23:09 user devstack@n-api.service[72088]: DEBUG nova.policy [None req-09e9b37d-b089-45be-b866-baab9bbeb1d5 tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f84e7cbdf6a4e588753fea907beba0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f39e7fdf571442b0a6f136020a99f7fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72088) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:23:09 user devstack@n-api.service[72088]: DEBUG nova.policy [None req-09e9b37d-b089-45be-b866-baab9bbeb1d5 tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f84e7cbdf6a4e588753fea907beba0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f39e7fdf571442b0a6f136020a99f7fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72088) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:23:09 user devstack@n-api.service[72088]: DEBUG nova.policy [None req-09e9b37d-b089-45be-b866-baab9bbeb1d5 tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f84e7cbdf6a4e588753fea907beba0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f39e7fdf571442b0a6f136020a99f7fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72088) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:23:09 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [None req-09e9b37d-b089-45be-b866-baab9bbeb1d5 tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b71d95ed-728d-4386-b7c6-50b252718ca9" status: 200 len: 1627 microversion: 2.49 time: 0.216823 Apr 11 19:23:09 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 46/150] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 19:23:09 2023] GET /compute/v2.1/servers/b71d95ed-728d-4386-b7c6-50b252718ca9 => generated 1627 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 19:23:13 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [None req-62fb1083-9b34-453a-aa6b-2a6094329a0e tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] Calling method '>' {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:23:13 user devstack@n-api.service[72089]: DEBUG nova.compute.api [None req-62fb1083-9b34-453a-aa6b-2a6094329a0e tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] [instance: 8e449d09-f632-4f57-b304-430734096596] Fetching instance by UUID {{(pid=72089) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:23:13 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-62fb1083-9b34-453a-aa6b-2a6094329a0e tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:23:13 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-62fb1083-9b34-453a-aa6b-2a6094329a0e tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:23:13 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-62fb1083-9b34-453a-aa6b-2a6094329a0e tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:23:13 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-62fb1083-9b34-453a-aa6b-2a6094329a0e tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:23:13 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-62fb1083-9b34-453a-aa6b-2a6094329a0e tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:23:13 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-62fb1083-9b34-453a-aa6b-2a6094329a0e tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:23:13 user devstack@n-api.service[72089]: DEBUG nova.policy [None req-62fb1083-9b34-453a-aa6b-2a6094329a0e tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c9641ceb17e4914b1cdf061c5bdc79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7543456a70d04d7f8c50f37e64b7ee9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72089) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:23:13 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [None req-62fb1083-9b34-453a-aa6b-2a6094329a0e tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8e449d09-f632-4f57-b304-430734096596" status: 200 len: 1485 microversion: 2.1 time: 0.147261 Apr 11 19:23:13 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 56/151] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 19:23:13 2023] GET /compute/v2.1/servers/8e449d09-f632-4f57-b304-430734096596 => generated 1485 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:23:24 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [None req-b0956f5d-f083-4783-9bf7-770492bd1bed tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] Calling method '>' {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:23:24 user devstack@n-api.service[72090]: DEBUG nova.compute.api [None req-b0956f5d-f083-4783-9bf7-770492bd1bed tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] [instance: 75a4ef96-a6c3-4ccd-9503-bab0d4174b2b] Fetching instance by UUID {{(pid=72090) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:23:24 user devstack@n-api.service[72090]: DEBUG dbcounter [-] [72090] Writing DB stats nova_api:SELECT=5 {{(pid=72090) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:23:24 user devstack@n-api.service[72090]: DEBUG dbcounter [-] [72090] Writing DB stats nova_cell1:SELECT=27 {{(pid=72090) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:23:25 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-b0956f5d-f083-4783-9bf7-770492bd1bed tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:23:25 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-b0956f5d-f083-4783-9bf7-770492bd1bed tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:23:25 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-b0956f5d-f083-4783-9bf7-770492bd1bed tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:23:25 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-b0956f5d-f083-4783-9bf7-770492bd1bed tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:23:25 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-b0956f5d-f083-4783-9bf7-770492bd1bed tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:23:25 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-b0956f5d-f083-4783-9bf7-770492bd1bed tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:23:25 user devstack@n-api.service[72090]: DEBUG nova.policy [None req-b0956f5d-f083-4783-9bf7-770492bd1bed tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb69b26bc5af47069cdd00b39db75375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ac81630b23345679b841ea2c3fe28f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72090) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:23:25 user devstack@n-api.service[72090]: DEBUG nova.policy [None req-b0956f5d-f083-4783-9bf7-770492bd1bed tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb69b26bc5af47069cdd00b39db75375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ac81630b23345679b841ea2c3fe28f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72090) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:23:25 user devstack@n-api.service[72090]: DEBUG nova.policy [None req-b0956f5d-f083-4783-9bf7-770492bd1bed tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb69b26bc5af47069cdd00b39db75375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ac81630b23345679b841ea2c3fe28f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72090) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:23:25 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [None req-b0956f5d-f083-4783-9bf7-770492bd1bed tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] 10.0.0.210 "GET /compute/v2.1/servers/75a4ef96-a6c3-4ccd-9503-bab0d4174b2b" status: 200 len: 2822 microversion: 2.32 time: 0.580619 Apr 11 19:23:25 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 50/152] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 19:23:24 2023] GET /compute/v2.1/servers/75a4ef96-a6c3-4ccd-9503-bab0d4174b2b => generated 2822 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 19:23:27 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [None req-76b1b874-4358-4979-a5f3-93ca5317e21c tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-246020648", "imageRef": "4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b", "flavorRef": "42", "networks": [{"uuid": "b29e55eb-c801-47f0-8cb7-be11e1471261"}]}} {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:23:27 user devstack@n-api.service[72088]: DEBUG dbcounter [-] [72088] Writing DB stats nova_api:SELECT=3 {{(pid=72088) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:23:27 user devstack@n-api.service[72088]: DEBUG dbcounter [-] [72088] Writing DB stats nova_cell1:SELECT=15 {{(pid=72088) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:23:27 user devstack@n-api.service[72088]: DEBUG nova.network.neutron [None req-76b1b874-4358-4979-a5f3-93ca5317e21c tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] validate_networks() for [('b29e55eb-c801-47f0-8cb7-be11e1471261', None, None, None, None, None)] {{(pid=72088) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 11 19:23:28 user devstack@n-api.service[72088]: DEBUG nova.virt.hardware [None req-76b1b874-4358-4979-a5f3-93ca5317e21c tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] Flavor limits 0:0:0 {{(pid=72088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 19:23:28 user devstack@n-api.service[72088]: DEBUG nova.virt.hardware [None req-76b1b874-4358-4979-a5f3-93ca5317e21c tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] Image limits 0:0:0 {{(pid=72088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 19:23:28 user devstack@n-api.service[72088]: DEBUG nova.virt.hardware [None req-76b1b874-4358-4979-a5f3-93ca5317e21c tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] Flavor pref 0:0:0 {{(pid=72088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 19:23:28 user devstack@n-api.service[72088]: DEBUG nova.virt.hardware [None req-76b1b874-4358-4979-a5f3-93ca5317e21c tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] Image pref 0:0:0 {{(pid=72088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 19:23:28 user devstack@n-api.service[72088]: DEBUG nova.virt.hardware [None req-76b1b874-4358-4979-a5f3-93ca5317e21c tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 19:23:28 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-76b1b874-4358-4979-a5f3-93ca5317e21c tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:23:28 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-76b1b874-4358-4979-a5f3-93ca5317e21c tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:23:28 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-76b1b874-4358-4979-a5f3-93ca5317e21c tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:23:28 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-76b1b874-4358-4979-a5f3-93ca5317e21c tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:23:28 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-76b1b874-4358-4979-a5f3-93ca5317e21c tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:23:28 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-76b1b874-4358-4979-a5f3-93ca5317e21c tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:23:28 user devstack@n-api.service[72088]: DEBUG nova.quota [None req-76b1b874-4358-4979-a5f3-93ca5317e21c tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] Getting quotas for project 0d5d7769df1e4974b295cb30407151dd. Resources: {'ram', 'instances', 'cores'} {{(pid=72088) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 19:23:28 user devstack@n-api.service[72088]: DEBUG nova.quota [None req-76b1b874-4358-4979-a5f3-93ca5317e21c tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] Getting quotas for user 2f44dfa2528b4540a81f4eb7c3f3f2f5 and project 0d5d7769df1e4974b295cb30407151dd. Resources: {'ram', 'instances', 'cores'} {{(pid=72088) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 19:23:28 user devstack@n-api.service[72088]: DEBUG nova.compute.api [None req-76b1b874-4358-4979-a5f3-93ca5317e21c tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] Going to run 1 instances... {{(pid=72088) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 11 19:23:28 user devstack@n-api.service[72088]: DEBUG nova.compute.api [None req-76b1b874-4358-4979-a5f3-93ca5317e21c tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] [instance: e84ad0e4-a65b-404c-adbf-c49d5f0b3cca] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=72088) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 11 19:23:28 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [None req-76b1b874-4358-4979-a5f3-93ca5317e21c tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.597903 Apr 11 19:23:28 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 47/153] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 11 19:23:27 2023] POST /compute/v2.1/servers => generated 378 bytes in 599 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 11 19:23:28 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [None req-a0bb77f8-8574-4740-a096-4d4ff1651357 tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] Calling method '>' {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:23:28 user devstack@n-api.service[72089]: DEBUG nova.compute.api [None req-a0bb77f8-8574-4740-a096-4d4ff1651357 tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] [instance: e84ad0e4-a65b-404c-adbf-c49d5f0b3cca] Fetching instance by UUID {{(pid=72089) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:23:28 user devstack@n-api.service[72089]: DEBUG dbcounter [-] [72089] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=4 {{(pid=72089) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:23:28 user devstack@n-api.service[72089]: DEBUG dbcounter [-] [72089] Writing DB stats nova_cell1:SELECT=24 {{(pid=72089) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:23:28 user devstack@n-api.service[72089]: DEBUG nova.policy [None req-a0bb77f8-8574-4740-a096-4d4ff1651357 tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f44dfa2528b4540a81f4eb7c3f3f2f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5d7769df1e4974b295cb30407151dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72089) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:23:28 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [None req-a0bb77f8-8574-4740-a096-4d4ff1651357 tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e84ad0e4-a65b-404c-adbf-c49d5f0b3cca" status: 200 len: 1210 microversion: 2.1 time: 0.087414 Apr 11 19:23:28 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 57/154] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 19:23:28 2023] GET /compute/v2.1/servers/e84ad0e4-a65b-404c-adbf-c49d5f0b3cca => generated 1210 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:23:29 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [None req-f68d161b-b519-42a3-b783-3623c67aba0f tempest-DeleteServersTestJSON-124461992 tempest-DeleteServersTestJSON-124461992-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0616446d-3e4d-4ae8-8ed2-d95b5082eeca"}} {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:23:29 user devstack@n-api.service[72090]: DEBUG nova.compute.api [None req-f68d161b-b519-42a3-b783-3623c67aba0f tempest-DeleteServersTestJSON-124461992 tempest-DeleteServersTestJSON-124461992-project-member] [instance: efd7afec-d6d0-4e3f-a3b9-f672b3e711cf] Fetching instance by UUID {{(pid=72090) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:23:29 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-f68d161b-b519-42a3-b783-3623c67aba0f tempest-DeleteServersTestJSON-124461992 tempest-DeleteServersTestJSON-124461992-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:23:29 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-f68d161b-b519-42a3-b783-3623c67aba0f tempest-DeleteServersTestJSON-124461992 tempest-DeleteServersTestJSON-124461992-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:23:29 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-f68d161b-b519-42a3-b783-3623c67aba0f tempest-DeleteServersTestJSON-124461992 tempest-DeleteServersTestJSON-124461992-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:23:29 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-f68d161b-b519-42a3-b783-3623c67aba0f tempest-DeleteServersTestJSON-124461992 tempest-DeleteServersTestJSON-124461992-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:23:29 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-f68d161b-b519-42a3-b783-3623c67aba0f tempest-DeleteServersTestJSON-124461992 tempest-DeleteServersTestJSON-124461992-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:23:29 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-f68d161b-b519-42a3-b783-3623c67aba0f tempest-DeleteServersTestJSON-124461992 tempest-DeleteServersTestJSON-124461992-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:23:30 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [None req-f68d161b-b519-42a3-b783-3623c67aba0f tempest-DeleteServersTestJSON-124461992 tempest-DeleteServersTestJSON-124461992-project-member] 10.0.0.210 "POST /compute/v2.1/servers/efd7afec-d6d0-4e3f-a3b9-f672b3e711cf/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.441800 Apr 11 19:23:30 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 51/155] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Apr 11 19:23:29 2023] POST /compute/v2.1/servers/efd7afec-d6d0-4e3f-a3b9-f672b3e711cf/os-volume_attachments => generated 194 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:23:30 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [req-8ee547bd-7430-465f-a808-46c3e1152713 req-e55f5184-759f-46ad-8a96-bd26b304a37f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e84ad0e4-a65b-404c-adbf-c49d5f0b3cca", "tag": "27172120-33d2-4fbe-9af2-e8376499f9bc"}]} {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:23:30 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-8ee547bd-7430-465f-a808-46c3e1152713 req-e55f5184-759f-46ad-8a96-bd26b304a37f service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:23:30 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-8ee547bd-7430-465f-a808-46c3e1152713 req-e55f5184-759f-46ad-8a96-bd26b304a37f service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:23:30 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-8ee547bd-7430-465f-a808-46c3e1152713 req-e55f5184-759f-46ad-8a96-bd26b304a37f service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:23:30 user devstack@n-api.service[72088]: INFO nova.api.openstack.compute.server_external_events [req-8ee547bd-7430-465f-a808-46c3e1152713 req-e55f5184-759f-46ad-8a96-bd26b304a37f service nova] Creating event network-changed:27172120-33d2-4fbe-9af2-e8376499f9bc for instance e84ad0e4-a65b-404c-adbf-c49d5f0b3cca on user Apr 11 19:23:30 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [req-8ee547bd-7430-465f-a808-46c3e1152713 req-e55f5184-759f-46ad-8a96-bd26b304a37f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030469 Apr 11 19:23:30 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 48/156] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:23:30 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:23:32 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [req-cc7e1288-1e97-4f38-b68a-381e4fa15a58 req-6c02fcd3-1ed3-4188-93b9-62230241b863 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e84ad0e4-a65b-404c-adbf-c49d5f0b3cca", "name": "network-vif-plugged", "status": "completed", "tag": "27172120-33d2-4fbe-9af2-e8376499f9bc"}]} {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:23:32 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-cc7e1288-1e97-4f38-b68a-381e4fa15a58 req-6c02fcd3-1ed3-4188-93b9-62230241b863 service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:23:32 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-cc7e1288-1e97-4f38-b68a-381e4fa15a58 req-6c02fcd3-1ed3-4188-93b9-62230241b863 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:23:32 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-cc7e1288-1e97-4f38-b68a-381e4fa15a58 req-6c02fcd3-1ed3-4188-93b9-62230241b863 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:23:32 user devstack@n-api.service[72089]: INFO nova.api.openstack.compute.server_external_events [req-cc7e1288-1e97-4f38-b68a-381e4fa15a58 req-6c02fcd3-1ed3-4188-93b9-62230241b863 service nova] Creating event network-vif-plugged:27172120-33d2-4fbe-9af2-e8376499f9bc for instance e84ad0e4-a65b-404c-adbf-c49d5f0b3cca on user Apr 11 19:23:32 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [req-cc7e1288-1e97-4f38-b68a-381e4fa15a58 req-6c02fcd3-1ed3-4188-93b9-62230241b863 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030272 Apr 11 19:23:32 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 58/157] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:23:32 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:23:34 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [req-ab55e306-7997-41df-b614-3242713f7851 req-c25a723c-a7b6-4f91-b22e-983f763513c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e84ad0e4-a65b-404c-adbf-c49d5f0b3cca", "name": "network-vif-plugged", "status": "completed", "tag": "27172120-33d2-4fbe-9af2-e8376499f9bc"}]} {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:23:35 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-ab55e306-7997-41df-b614-3242713f7851 req-c25a723c-a7b6-4f91-b22e-983f763513c0 service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:23:35 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-ab55e306-7997-41df-b614-3242713f7851 req-c25a723c-a7b6-4f91-b22e-983f763513c0 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:23:35 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-ab55e306-7997-41df-b614-3242713f7851 req-c25a723c-a7b6-4f91-b22e-983f763513c0 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:23:35 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [None req-bf5adeff-7240-47b6-b9bd-2875cb5d9c66 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Calling method '>' {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:23:35 user devstack@n-api.service[72088]: DEBUG nova.compute.api [None req-bf5adeff-7240-47b6-b9bd-2875cb5d9c66 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] [instance: bed4001c-02c2-4c6b-84c8-61654df66d8b] Fetching instance by UUID {{(pid=72088) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:23:35 user devstack@n-api.service[72090]: INFO nova.api.openstack.compute.server_external_events [req-ab55e306-7997-41df-b614-3242713f7851 req-c25a723c-a7b6-4f91-b22e-983f763513c0 service nova] Creating event network-vif-plugged:27172120-33d2-4fbe-9af2-e8376499f9bc for instance e84ad0e4-a65b-404c-adbf-c49d5f0b3cca on user Apr 11 19:23:35 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-bf5adeff-7240-47b6-b9bd-2875cb5d9c66 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:23:35 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-bf5adeff-7240-47b6-b9bd-2875cb5d9c66 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:23:35 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-bf5adeff-7240-47b6-b9bd-2875cb5d9c66 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:23:35 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-bf5adeff-7240-47b6-b9bd-2875cb5d9c66 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:23:35 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-bf5adeff-7240-47b6-b9bd-2875cb5d9c66 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:23:35 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-bf5adeff-7240-47b6-b9bd-2875cb5d9c66 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:23:35 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [req-ab55e306-7997-41df-b614-3242713f7851 req-c25a723c-a7b6-4f91-b22e-983f763513c0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050610 Apr 11 19:23:35 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 52/158] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:23:34 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:23:35 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [None req-bf5adeff-7240-47b6-b9bd-2875cb5d9c66 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bed4001c-02c2-4c6b-84c8-61654df66d8b/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.328107 Apr 11 19:23:35 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 49/159] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Apr 11 19:23:34 2023] GET /compute/v2.1/servers/bed4001c-02c2-4c6b-84c8-61654df66d8b/os-interface => generated 283 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:23:36 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [None req-d9dd6e75-32c8-4a78-a08f-abae20b40218 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Calling method '>' {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:23:36 user devstack@n-api.service[72089]: DEBUG nova.compute.api [None req-d9dd6e75-32c8-4a78-a08f-abae20b40218 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] [instance: bed4001c-02c2-4c6b-84c8-61654df66d8b] Fetching instance by UUID {{(pid=72089) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:23:36 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-d9dd6e75-32c8-4a78-a08f-abae20b40218 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:23:36 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-d9dd6e75-32c8-4a78-a08f-abae20b40218 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:23:36 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-d9dd6e75-32c8-4a78-a08f-abae20b40218 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:23:36 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-d9dd6e75-32c8-4a78-a08f-abae20b40218 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:23:36 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-d9dd6e75-32c8-4a78-a08f-abae20b40218 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:23:36 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-d9dd6e75-32c8-4a78-a08f-abae20b40218 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:23:36 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [None req-d9dd6e75-32c8-4a78-a08f-abae20b40218 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bed4001c-02c2-4c6b-84c8-61654df66d8b/ips" status: 200 len: 108 microversion: 2.1 time: 0.071890 Apr 11 19:23:36 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 59/160] 10.0.0.210 () {62 vars in 1325 bytes} [Tue Apr 11 19:23:36 2023] GET /compute/v2.1/servers/bed4001c-02c2-4c6b-84c8-61654df66d8b/ips => generated 108 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:23:37 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [req-e316c09b-5e04-4b6f-a413-4e94ef8b186f req-6a4823f6-d614-4df2-a1c7-60a21298ec4d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bed4001c-02c2-4c6b-84c8-61654df66d8b", "tag": "b644e09b-afb0-43e7-9773-0df435010320"}]} {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:23:37 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-e316c09b-5e04-4b6f-a413-4e94ef8b186f req-6a4823f6-d614-4df2-a1c7-60a21298ec4d service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:23:37 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-e316c09b-5e04-4b6f-a413-4e94ef8b186f req-6a4823f6-d614-4df2-a1c7-60a21298ec4d service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:23:37 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-e316c09b-5e04-4b6f-a413-4e94ef8b186f req-6a4823f6-d614-4df2-a1c7-60a21298ec4d service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:23:37 user devstack@n-api.service[72090]: INFO nova.api.openstack.compute.server_external_events [req-e316c09b-5e04-4b6f-a413-4e94ef8b186f req-6a4823f6-d614-4df2-a1c7-60a21298ec4d service nova] Creating event network-changed:b644e09b-afb0-43e7-9773-0df435010320 for instance bed4001c-02c2-4c6b-84c8-61654df66d8b on user Apr 11 19:23:37 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [req-e316c09b-5e04-4b6f-a413-4e94ef8b186f req-6a4823f6-d614-4df2-a1c7-60a21298ec4d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029274 Apr 11 19:23:37 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 53/161] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:23:37 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:23:37 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [None req-b259b826-0379-483e-8c36-c0391c16e925 tempest-DeleteServersTestJSON-124461992 tempest-DeleteServersTestJSON-124461992-project-member] Calling method '>' {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:23:37 user devstack@n-api.service[72088]: DEBUG nova.compute.api [None req-b259b826-0379-483e-8c36-c0391c16e925 tempest-DeleteServersTestJSON-124461992 tempest-DeleteServersTestJSON-124461992-project-member] [instance: efd7afec-d6d0-4e3f-a3b9-f672b3e711cf] Fetching instance by UUID {{(pid=72088) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:23:37 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-b259b826-0379-483e-8c36-c0391c16e925 tempest-DeleteServersTestJSON-124461992 tempest-DeleteServersTestJSON-124461992-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:23:37 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-b259b826-0379-483e-8c36-c0391c16e925 tempest-DeleteServersTestJSON-124461992 tempest-DeleteServersTestJSON-124461992-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:23:37 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-b259b826-0379-483e-8c36-c0391c16e925 tempest-DeleteServersTestJSON-124461992 tempest-DeleteServersTestJSON-124461992-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:23:37 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-b259b826-0379-483e-8c36-c0391c16e925 tempest-DeleteServersTestJSON-124461992 tempest-DeleteServersTestJSON-124461992-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:23:37 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-b259b826-0379-483e-8c36-c0391c16e925 tempest-DeleteServersTestJSON-124461992 tempest-DeleteServersTestJSON-124461992-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:23:37 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-b259b826-0379-483e-8c36-c0391c16e925 tempest-DeleteServersTestJSON-124461992 tempest-DeleteServersTestJSON-124461992-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:23:37 user devstack@n-api.service[72088]: DEBUG nova.compute.api [None req-b259b826-0379-483e-8c36-c0391c16e925 tempest-DeleteServersTestJSON-124461992 tempest-DeleteServersTestJSON-124461992-project-member] [instance: efd7afec-d6d0-4e3f-a3b9-f672b3e711cf] Going to try to terminate instance {{(pid=72088) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 11 19:23:37 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [None req-b259b826-0379-483e-8c36-c0391c16e925 tempest-DeleteServersTestJSON-124461992 tempest-DeleteServersTestJSON-124461992-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/efd7afec-d6d0-4e3f-a3b9-f672b3e711cf" status: 204 len: 0 microversion: 2.1 time: 0.142159 Apr 11 19:23:37 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 50/162] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 19:23:37 2023] DELETE /compute/v2.1/servers/efd7afec-d6d0-4e3f-a3b9-f672b3e711cf => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 11 19:23:37 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [None req-cf4248cc-3b40-4fcf-95cb-bb18d517507f tempest-DeleteServersTestJSON-124461992 tempest-DeleteServersTestJSON-124461992-project-member] Calling method '>' {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:23:37 user devstack@n-api.service[72089]: DEBUG nova.compute.api [None req-cf4248cc-3b40-4fcf-95cb-bb18d517507f tempest-DeleteServersTestJSON-124461992 tempest-DeleteServersTestJSON-124461992-project-member] [instance: efd7afec-d6d0-4e3f-a3b9-f672b3e711cf] Fetching instance by UUID {{(pid=72089) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:23:37 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-cf4248cc-3b40-4fcf-95cb-bb18d517507f tempest-DeleteServersTestJSON-124461992 tempest-DeleteServersTestJSON-124461992-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:23:37 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-cf4248cc-3b40-4fcf-95cb-bb18d517507f tempest-DeleteServersTestJSON-124461992 tempest-DeleteServersTestJSON-124461992-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:23:37 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-cf4248cc-3b40-4fcf-95cb-bb18d517507f tempest-DeleteServersTestJSON-124461992 tempest-DeleteServersTestJSON-124461992-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:23:37 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-cf4248cc-3b40-4fcf-95cb-bb18d517507f tempest-DeleteServersTestJSON-124461992 tempest-DeleteServersTestJSON-124461992-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:23:37 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-cf4248cc-3b40-4fcf-95cb-bb18d517507f tempest-DeleteServersTestJSON-124461992 tempest-DeleteServersTestJSON-124461992-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:23:37 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-cf4248cc-3b40-4fcf-95cb-bb18d517507f tempest-DeleteServersTestJSON-124461992 tempest-DeleteServersTestJSON-124461992-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:23:37 user devstack@n-api.service[72089]: DEBUG nova.policy [None req-cf4248cc-3b40-4fcf-95cb-bb18d517507f tempest-DeleteServersTestJSON-124461992 tempest-DeleteServersTestJSON-124461992-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '502b859ece744cf680123cd4e9643938', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34322e02b2fc4c2c84fb77583faf4405', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72089) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:23:38 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [None req-cf4248cc-3b40-4fcf-95cb-bb18d517507f tempest-DeleteServersTestJSON-124461992 tempest-DeleteServersTestJSON-124461992-project-member] 10.0.0.210 "GET /compute/v2.1/servers/efd7afec-d6d0-4e3f-a3b9-f672b3e711cf" status: 200 len: 1541 microversion: 2.1 time: 0.181582 Apr 11 19:23:38 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 60/163] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 19:23:37 2023] GET /compute/v2.1/servers/efd7afec-d6d0-4e3f-a3b9-f672b3e711cf => generated 1541 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:23:38 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [req-2dd73dde-5c1b-49e5-82fb-072230e6f223 req-8a8aa386-3e4c-401c-a7e5-542b9843c80d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "efd7afec-d6d0-4e3f-a3b9-f672b3e711cf", "name": "network-vif-unplugged", "status": "completed", "tag": "096d6451-049b-4ff5-9eaf-8ee3884c8715"}]} {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:23:38 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-2dd73dde-5c1b-49e5-82fb-072230e6f223 req-8a8aa386-3e4c-401c-a7e5-542b9843c80d service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:23:38 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-2dd73dde-5c1b-49e5-82fb-072230e6f223 req-8a8aa386-3e4c-401c-a7e5-542b9843c80d service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:23:38 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-2dd73dde-5c1b-49e5-82fb-072230e6f223 req-8a8aa386-3e4c-401c-a7e5-542b9843c80d service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:23:38 user devstack@n-api.service[72090]: INFO nova.api.openstack.compute.server_external_events [req-2dd73dde-5c1b-49e5-82fb-072230e6f223 req-8a8aa386-3e4c-401c-a7e5-542b9843c80d service nova] Creating event network-vif-unplugged:096d6451-049b-4ff5-9eaf-8ee3884c8715 for instance efd7afec-d6d0-4e3f-a3b9-f672b3e711cf on user Apr 11 19:23:38 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [req-2dd73dde-5c1b-49e5-82fb-072230e6f223 req-8a8aa386-3e4c-401c-a7e5-542b9843c80d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044451 Apr 11 19:23:38 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 54/164] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:23:38 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:23:38 user devstack@n-api.service[72088]: DEBUG dbcounter [-] [72088] Writing DB stats nova_cell0:SELECT=2 {{(pid=72088) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:23:38 user devstack@n-api.service[72088]: DEBUG dbcounter [-] [72088] Writing DB stats nova_cell0:SELECT=6 {{(pid=72088) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:23:38 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [None req-273f849c-675e-4b9a-9e0a-1dda1636bf7a tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4940d74f-b60a-49aa-bf74-4e000efa8dc5"}} {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:23:38 user devstack@n-api.service[72088]: DEBUG nova.compute.api [None req-273f849c-675e-4b9a-9e0a-1dda1636bf7a tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] [instance: bed4001c-02c2-4c6b-84c8-61654df66d8b] Fetching instance by UUID {{(pid=72088) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:23:38 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-273f849c-675e-4b9a-9e0a-1dda1636bf7a tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:23:38 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-273f849c-675e-4b9a-9e0a-1dda1636bf7a tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:23:38 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-273f849c-675e-4b9a-9e0a-1dda1636bf7a tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:23:38 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-273f849c-675e-4b9a-9e0a-1dda1636bf7a tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:23:38 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-273f849c-675e-4b9a-9e0a-1dda1636bf7a tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:23:38 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-273f849c-675e-4b9a-9e0a-1dda1636bf7a tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:23:38 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [None req-273f849c-675e-4b9a-9e0a-1dda1636bf7a tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] 10.0.0.210 "POST /compute/v2.1/servers/bed4001c-02c2-4c6b-84c8-61654df66d8b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.479378 Apr 11 19:23:38 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 51/165] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Apr 11 19:23:38 2023] POST /compute/v2.1/servers/bed4001c-02c2-4c6b-84c8-61654df66d8b/os-volume_attachments => generated 194 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:23:40 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [req-f0f6d6b9-45a0-4dc2-8b2a-586b74cf8c6b req-2e98269b-b08b-489b-babb-0ea3f0f8dca4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "efd7afec-d6d0-4e3f-a3b9-f672b3e711cf", "name": "network-vif-plugged", "status": "completed", "tag": "096d6451-049b-4ff5-9eaf-8ee3884c8715"}]} {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:23:40 user devstack@n-api.service[72089]: DEBUG dbcounter [-] [72089] Writing DB stats nova_cell0:SELECT=2 {{(pid=72089) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:23:40 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-f0f6d6b9-45a0-4dc2-8b2a-586b74cf8c6b req-2e98269b-b08b-489b-babb-0ea3f0f8dca4 service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:23:40 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-f0f6d6b9-45a0-4dc2-8b2a-586b74cf8c6b req-2e98269b-b08b-489b-babb-0ea3f0f8dca4 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:23:40 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-f0f6d6b9-45a0-4dc2-8b2a-586b74cf8c6b req-2e98269b-b08b-489b-babb-0ea3f0f8dca4 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:23:40 user devstack@n-api.service[72089]: INFO nova.api.openstack.compute.server_external_events [req-f0f6d6b9-45a0-4dc2-8b2a-586b74cf8c6b req-2e98269b-b08b-489b-babb-0ea3f0f8dca4 service nova] Creating event network-vif-plugged:096d6451-049b-4ff5-9eaf-8ee3884c8715 for instance efd7afec-d6d0-4e3f-a3b9-f672b3e711cf on user Apr 11 19:23:40 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [req-f0f6d6b9-45a0-4dc2-8b2a-586b74cf8c6b req-2e98269b-b08b-489b-babb-0ea3f0f8dca4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.257610 Apr 11 19:23:40 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 61/166] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:23:40 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:23:40 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [None req-ca102894-61e9-4b35-a1a2-429eb8f23b03 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Calling method '>' {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:23:40 user devstack@n-api.service[72090]: DEBUG nova.compute.api [None req-ca102894-61e9-4b35-a1a2-429eb8f23b03 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] [instance: d424f88d-5f82-4cac-aa0f-4f99624bd3e7] Fetching instance by UUID {{(pid=72090) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:23:40 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-ca102894-61e9-4b35-a1a2-429eb8f23b03 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:23:40 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-ca102894-61e9-4b35-a1a2-429eb8f23b03 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:23:40 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-ca102894-61e9-4b35-a1a2-429eb8f23b03 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:23:40 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-ca102894-61e9-4b35-a1a2-429eb8f23b03 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:23:40 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-ca102894-61e9-4b35-a1a2-429eb8f23b03 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:23:40 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-ca102894-61e9-4b35-a1a2-429eb8f23b03 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:23:40 user devstack@n-api.service[72090]: DEBUG nova.policy [None req-ca102894-61e9-4b35-a1a2-429eb8f23b03 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a32a5d0547141a180f655e98567ed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bceca6e3506e43f68f9cf8d0b56d141b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72090) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:23:40 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [None req-ca102894-61e9-4b35-a1a2-429eb8f23b03 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d424f88d-5f82-4cac-aa0f-4f99624bd3e7" status: 200 len: 1538 microversion: 2.1 time: 0.161998 Apr 11 19:23:40 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 55/167] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 19:23:40 2023] GET /compute/v2.1/servers/d424f88d-5f82-4cac-aa0f-4f99624bd3e7 => generated 1538 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:23:41 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [None req-f9447e5b-a60e-4b73-8cd2-b2ff67859d2a tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] Calling method '>' {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:23:41 user devstack@n-api.service[72088]: DEBUG nova.compute.api [None req-f9447e5b-a60e-4b73-8cd2-b2ff67859d2a tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] [instance: aa0bb9aa-a93d-45bc-9f90-46eeb6416365] Fetching instance by UUID {{(pid=72088) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:23:41 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-f9447e5b-a60e-4b73-8cd2-b2ff67859d2a tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:23:41 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-f9447e5b-a60e-4b73-8cd2-b2ff67859d2a tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:23:41 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-f9447e5b-a60e-4b73-8cd2-b2ff67859d2a tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:23:41 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-f9447e5b-a60e-4b73-8cd2-b2ff67859d2a tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:23:41 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-f9447e5b-a60e-4b73-8cd2-b2ff67859d2a tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:23:41 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-f9447e5b-a60e-4b73-8cd2-b2ff67859d2a tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:23:41 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [None req-f9447e5b-a60e-4b73-8cd2-b2ff67859d2a tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] 10.0.0.210 "GET /compute/v2.1/servers/aa0bb9aa-a93d-45bc-9f90-46eeb6416365/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.108619 Apr 11 19:23:41 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 52/168] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Apr 11 19:23:41 2023] GET /compute/v2.1/servers/aa0bb9aa-a93d-45bc-9f90-46eeb6416365/os-interface => generated 282 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:23:42 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [req-3b00c87b-2211-4252-8f09-603ffebf29e3 req-5af33c0f-d961-4040-9b22-9e6b5a5e0e55 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aa0bb9aa-a93d-45bc-9f90-46eeb6416365", "tag": "5a15e207-1839-4be5-80b2-fc995098dbbf"}]} {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:23:42 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-3b00c87b-2211-4252-8f09-603ffebf29e3 req-5af33c0f-d961-4040-9b22-9e6b5a5e0e55 service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:23:42 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-3b00c87b-2211-4252-8f09-603ffebf29e3 req-5af33c0f-d961-4040-9b22-9e6b5a5e0e55 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:23:42 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-3b00c87b-2211-4252-8f09-603ffebf29e3 req-5af33c0f-d961-4040-9b22-9e6b5a5e0e55 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:23:42 user devstack@n-api.service[72089]: INFO nova.api.openstack.compute.server_external_events [req-3b00c87b-2211-4252-8f09-603ffebf29e3 req-5af33c0f-d961-4040-9b22-9e6b5a5e0e55 service nova] Creating event network-changed:5a15e207-1839-4be5-80b2-fc995098dbbf for instance aa0bb9aa-a93d-45bc-9f90-46eeb6416365 on user Apr 11 19:23:42 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [req-3b00c87b-2211-4252-8f09-603ffebf29e3 req-5af33c0f-d961-4040-9b22-9e6b5a5e0e55 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032455 Apr 11 19:23:42 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 62/169] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:23:42 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:23:42 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [None req-bb2ec0e0-d089-4450-82a3-4f6f0c4c62a5 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ServerStableDeviceRescueTest-image-165147137"}} {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:23:42 user devstack@n-api.service[72090]: DEBUG nova.compute.api [None req-bb2ec0e0-d089-4450-82a3-4f6f0c4c62a5 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] [instance: aa0bb9aa-a93d-45bc-9f90-46eeb6416365] Fetching instance by UUID {{(pid=72090) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:23:42 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-bb2ec0e0-d089-4450-82a3-4f6f0c4c62a5 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:23:42 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-bb2ec0e0-d089-4450-82a3-4f6f0c4c62a5 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:23:42 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-bb2ec0e0-d089-4450-82a3-4f6f0c4c62a5 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:23:42 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-bb2ec0e0-d089-4450-82a3-4f6f0c4c62a5 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:23:42 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-bb2ec0e0-d089-4450-82a3-4f6f0c4c62a5 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:23:42 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-bb2ec0e0-d089-4450-82a3-4f6f0c4c62a5 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:23:42 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [req-5801e098-0a15-466f-b22d-5b293cefaf3f req-05c72e9e-2228-4859-8ed3-9af3237b9cde service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "efd7afec-d6d0-4e3f-a3b9-f672b3e711cf", "name": "network-vif-deleted", "tag": "096d6451-049b-4ff5-9eaf-8ee3884c8715"}]} {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:23:42 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-5801e098-0a15-466f-b22d-5b293cefaf3f req-05c72e9e-2228-4859-8ed3-9af3237b9cde service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:23:42 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-5801e098-0a15-466f-b22d-5b293cefaf3f req-05c72e9e-2228-4859-8ed3-9af3237b9cde service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:23:42 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-5801e098-0a15-466f-b22d-5b293cefaf3f req-05c72e9e-2228-4859-8ed3-9af3237b9cde service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:23:42 user devstack@n-api.service[72088]: INFO nova.api.openstack.compute.server_external_events [req-5801e098-0a15-466f-b22d-5b293cefaf3f req-05c72e9e-2228-4859-8ed3-9af3237b9cde service nova] Creating event network-vif-deleted:096d6451-049b-4ff5-9eaf-8ee3884c8715 for instance efd7afec-d6d0-4e3f-a3b9-f672b3e711cf on user Apr 11 19:23:42 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [req-5801e098-0a15-466f-b22d-5b293cefaf3f req-05c72e9e-2228-4859-8ed3-9af3237b9cde service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063608 Apr 11 19:23:42 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 53/170] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:23:42 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:23:43 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [None req-bb2ec0e0-d089-4450-82a3-4f6f0c4c62a5 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] 10.0.0.210 "POST /compute/v2.1/servers/aa0bb9aa-a93d-45bc-9f90-46eeb6416365/action" status: 202 len: 0 microversion: 2.1 time: 0.924315 Apr 11 19:23:43 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 56/171] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Apr 11 19:23:42 2023] POST /compute/v2.1/servers/aa0bb9aa-a93d-45bc-9f90-46eeb6416365/action => generated 0 bytes in 926 msecs (HTTP/1.1 202) 10 headers in 449 bytes (1 switches on core 0) Apr 11 19:23:43 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [None req-14a64777-1dd7-406b-ae9b-028fa603525d tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] Calling method '.version_select at 0x7f119df02b90>' {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:23:43 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [None req-14a64777-1dd7-406b-ae9b-028fa603525d tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] 10.0.0.210 "GET /compute/v2.1/images/6a269858-cd4f-452f-ae3e-e35cf198749c" status: 200 len: 1608 microversion: 2.1 time: 0.050906 Apr 11 19:23:43 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 63/172] 10.0.0.210 () {62 vars in 1310 bytes} [Tue Apr 11 19:23:43 2023] GET /compute/v2.1/images/6a269858-cd4f-452f-ae3e-e35cf198749c => generated 1608 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 19:23:47 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [None req-a067b5ab-9b23-431c-a152-4ae2229e1cdf tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Action: 'create', calling method: .version_select at 0x7f119de24040>, body: {"keypair": {"name": "tempest-keypair-985453267", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDMHXuZwHHLTnbwoXHlgW9zf8bL7zVpVkgemb7OvTI/oU7VrYb4dENt1Gx29wnClpENAL4bXzn2wWqsFi41+TNpH3ExAk1aECdr1t7t6sLObcWObhGaOVQ3v0wbmGz14ZA=="}} {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:23:47 user devstack@n-api.service[72088]: DEBUG nova.quota [None req-a067b5ab-9b23-431c-a152-4ae2229e1cdf tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Getting quotas for project 06966e2f4d3a4dec92282c7ad348635d. Resources: {'key_pairs'} {{(pid=72088) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 19:23:47 user devstack@n-api.service[72088]: DEBUG nova.quota [None req-a067b5ab-9b23-431c-a152-4ae2229e1cdf tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Getting quotas for user d5d405421ceb4d99967ef2e7f55e7809 and project 06966e2f4d3a4dec92282c7ad348635d. Resources: {'key_pairs'} {{(pid=72088) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 19:23:47 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [None req-a067b5ab-9b23-431c-a152-4ae2229e1cdf tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.049855 Apr 11 19:23:47 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 54/173] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Apr 11 19:23:47 2023] POST /compute/v2.1/os-keypairs => generated 385 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:23:49 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [None req-99ebef90-3713-4e46-8627-912aa99b2023 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-953463719", "imageRef": "4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "fb39619b-a298-4b28-9280-3fc309c5a229"}], "security_groups": [{"name": "tempest-securitygroup--1379103073"}], "key_name": "tempest-keypair-985453267", "user_data": "}} {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:23:49 user devstack@n-api.service[72090]: DEBUG nova.network.neutron [None req-99ebef90-3713-4e46-8627-912aa99b2023 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] validate_networks() for [('fb39619b-a298-4b28-9280-3fc309c5a229', None, None, None, None, None)] {{(pid=72090) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 11 19:23:49 user devstack@n-api.service[72090]: DEBUG nova.virt.hardware [None req-99ebef90-3713-4e46-8627-912aa99b2023 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Flavor limits 0:0:0 {{(pid=72090) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 19:23:49 user devstack@n-api.service[72090]: DEBUG nova.virt.hardware [None req-99ebef90-3713-4e46-8627-912aa99b2023 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Image limits 0:0:0 {{(pid=72090) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 19:23:49 user devstack@n-api.service[72090]: DEBUG nova.virt.hardware [None req-99ebef90-3713-4e46-8627-912aa99b2023 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Flavor pref 0:0:0 {{(pid=72090) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 19:23:49 user devstack@n-api.service[72090]: DEBUG nova.virt.hardware [None req-99ebef90-3713-4e46-8627-912aa99b2023 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Image pref 0:0:0 {{(pid=72090) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 19:23:49 user devstack@n-api.service[72090]: DEBUG nova.virt.hardware [None req-99ebef90-3713-4e46-8627-912aa99b2023 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72090) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 19:23:49 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-99ebef90-3713-4e46-8627-912aa99b2023 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:23:49 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-99ebef90-3713-4e46-8627-912aa99b2023 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:23:49 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-99ebef90-3713-4e46-8627-912aa99b2023 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:23:49 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-99ebef90-3713-4e46-8627-912aa99b2023 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:23:49 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-99ebef90-3713-4e46-8627-912aa99b2023 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:23:49 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-99ebef90-3713-4e46-8627-912aa99b2023 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:23:49 user devstack@n-api.service[72090]: DEBUG nova.quota [None req-99ebef90-3713-4e46-8627-912aa99b2023 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Getting quotas for project 06966e2f4d3a4dec92282c7ad348635d. Resources: {'ram', 'instances', 'cores'} {{(pid=72090) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 19:23:49 user devstack@n-api.service[72090]: DEBUG nova.quota [None req-99ebef90-3713-4e46-8627-912aa99b2023 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Getting quotas for user d5d405421ceb4d99967ef2e7f55e7809 and project 06966e2f4d3a4dec92282c7ad348635d. Resources: {'ram', 'instances', 'cores'} {{(pid=72090) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 19:23:49 user devstack@n-api.service[72090]: DEBUG nova.compute.api [None req-99ebef90-3713-4e46-8627-912aa99b2023 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Going to run 1 instances... {{(pid=72090) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 11 19:23:49 user devstack@n-api.service[72090]: DEBUG nova.compute.api [None req-99ebef90-3713-4e46-8627-912aa99b2023 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] [instance: 53ccc829-6323-48ec-b63f-9de9bc607456] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=72090) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 11 19:23:49 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [None req-99ebef90-3713-4e46-8627-912aa99b2023 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 0.579095 Apr 11 19:23:49 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 57/174] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 11 19:23:49 2023] POST /compute/v2.1/servers => generated 400 bytes in 581 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 11 19:23:49 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [None req-cec0f3e1-e60c-4f2e-b608-d32715d591eb tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Calling method '>' {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:23:49 user devstack@n-api.service[72089]: DEBUG nova.compute.api [None req-cec0f3e1-e60c-4f2e-b608-d32715d591eb tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] [instance: 53ccc829-6323-48ec-b63f-9de9bc607456] Fetching instance by UUID {{(pid=72089) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:23:49 user devstack@n-api.service[72089]: DEBUG nova.policy [None req-cec0f3e1-e60c-4f2e-b608-d32715d591eb tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5d405421ceb4d99967ef2e7f55e7809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06966e2f4d3a4dec92282c7ad348635d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72089) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:23:49 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [None req-cec0f3e1-e60c-4f2e-b608-d32715d591eb tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] 10.0.0.210 "GET /compute/v2.1/servers/53ccc829-6323-48ec-b63f-9de9bc607456" status: 200 len: 1234 microversion: 2.1 time: 0.069595 Apr 11 19:23:49 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 64/175] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 19:23:49 2023] GET /compute/v2.1/servers/53ccc829-6323-48ec-b63f-9de9bc607456 => generated 1234 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:23:52 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [req-cecc6141-11c0-4c81-9566-35866c826053 req-bc8c6874-c52d-4dcb-b7b2-efd46224d807 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "53ccc829-6323-48ec-b63f-9de9bc607456", "tag": "dfba7f5a-ea64-4504-8547-47f354d6a6ef"}]} {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:23:52 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-cecc6141-11c0-4c81-9566-35866c826053 req-bc8c6874-c52d-4dcb-b7b2-efd46224d807 service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:23:52 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-cecc6141-11c0-4c81-9566-35866c826053 req-bc8c6874-c52d-4dcb-b7b2-efd46224d807 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:23:52 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-cecc6141-11c0-4c81-9566-35866c826053 req-bc8c6874-c52d-4dcb-b7b2-efd46224d807 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:23:52 user devstack@n-api.service[72088]: INFO nova.api.openstack.compute.server_external_events [req-cecc6141-11c0-4c81-9566-35866c826053 req-bc8c6874-c52d-4dcb-b7b2-efd46224d807 service nova] Creating event network-changed:dfba7f5a-ea64-4504-8547-47f354d6a6ef for instance 53ccc829-6323-48ec-b63f-9de9bc607456 on user Apr 11 19:23:52 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [req-cecc6141-11c0-4c81-9566-35866c826053 req-bc8c6874-c52d-4dcb-b7b2-efd46224d807 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029160 Apr 11 19:23:52 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 55/176] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:23:52 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 11 19:23:54 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [req-af8a9c1e-bbc2-4c13-a67b-394c204dcdf1 req-ba7dbd10-2f9b-4edb-b58f-e4d639ee35cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "53ccc829-6323-48ec-b63f-9de9bc607456", "name": "network-vif-plugged", "status": "completed", "tag": "dfba7f5a-ea64-4504-8547-47f354d6a6ef"}]} {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:23:54 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-af8a9c1e-bbc2-4c13-a67b-394c204dcdf1 req-ba7dbd10-2f9b-4edb-b58f-e4d639ee35cb service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:23:54 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-af8a9c1e-bbc2-4c13-a67b-394c204dcdf1 req-ba7dbd10-2f9b-4edb-b58f-e4d639ee35cb service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:23:54 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-af8a9c1e-bbc2-4c13-a67b-394c204dcdf1 req-ba7dbd10-2f9b-4edb-b58f-e4d639ee35cb service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:23:54 user devstack@n-api.service[72090]: INFO nova.api.openstack.compute.server_external_events [req-af8a9c1e-bbc2-4c13-a67b-394c204dcdf1 req-ba7dbd10-2f9b-4edb-b58f-e4d639ee35cb service nova] Creating event network-vif-plugged:dfba7f5a-ea64-4504-8547-47f354d6a6ef for instance 53ccc829-6323-48ec-b63f-9de9bc607456 on user Apr 11 19:23:54 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [req-af8a9c1e-bbc2-4c13-a67b-394c204dcdf1 req-ba7dbd10-2f9b-4edb-b58f-e4d639ee35cb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034332 Apr 11 19:23:54 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 58/177] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:23:54 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:23:56 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [req-3e1c06e9-b8c7-4579-9d42-6547eb66c5da req-ce88be34-751d-4922-9d66-3db3d4e34b31 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "53ccc829-6323-48ec-b63f-9de9bc607456", "name": "network-vif-plugged", "status": "completed", "tag": "dfba7f5a-ea64-4504-8547-47f354d6a6ef"}]} {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:23:56 user devstack@n-api.service[72089]: DEBUG dbcounter [-] [72089] Writing DB stats nova_cell1:SELECT=16 {{(pid=72089) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:23:56 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-3e1c06e9-b8c7-4579-9d42-6547eb66c5da req-ce88be34-751d-4922-9d66-3db3d4e34b31 service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:23:56 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-3e1c06e9-b8c7-4579-9d42-6547eb66c5da req-ce88be34-751d-4922-9d66-3db3d4e34b31 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:23:56 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-3e1c06e9-b8c7-4579-9d42-6547eb66c5da req-ce88be34-751d-4922-9d66-3db3d4e34b31 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:23:56 user devstack@n-api.service[72089]: INFO nova.api.openstack.compute.server_external_events [req-3e1c06e9-b8c7-4579-9d42-6547eb66c5da req-ce88be34-751d-4922-9d66-3db3d4e34b31 service nova] Creating event network-vif-plugged:dfba7f5a-ea64-4504-8547-47f354d6a6ef for instance 53ccc829-6323-48ec-b63f-9de9bc607456 on user Apr 11 19:23:56 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [req-3e1c06e9-b8c7-4579-9d42-6547eb66c5da req-ce88be34-751d-4922-9d66-3db3d4e34b31 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032313 Apr 11 19:23:56 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 65/178] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:23:56 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:24:03 user devstack@n-api.service[72088]: DEBUG dbcounter [-] [72088] Writing DB stats nova_cell0:SELECT=4 {{(pid=72088) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:24:03 user devstack@n-api.service[72088]: DEBUG dbcounter [-] [72088] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=72088) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:24:03 user devstack@n-api.service[72088]: DEBUG dbcounter [-] [72088] Writing DB stats nova_cell1:SELECT=42,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=72088) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:24:03 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [None req-7d376f31-7a40-4787-9ecf-e08e63ab1d30 tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] Calling method '>' {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:24:03 user devstack@n-api.service[72088]: DEBUG nova.compute.api [None req-7d376f31-7a40-4787-9ecf-e08e63ab1d30 tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] [instance: 1ded3918-3bae-465c-a53c-e88011914c50] Fetching instance by UUID {{(pid=72088) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:24:03 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-7d376f31-7a40-4787-9ecf-e08e63ab1d30 tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:24:03 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-7d376f31-7a40-4787-9ecf-e08e63ab1d30 tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:24:03 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-7d376f31-7a40-4787-9ecf-e08e63ab1d30 tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:24:03 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-7d376f31-7a40-4787-9ecf-e08e63ab1d30 tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:24:03 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-7d376f31-7a40-4787-9ecf-e08e63ab1d30 tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:24:03 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-7d376f31-7a40-4787-9ecf-e08e63ab1d30 tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:24:03 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [None req-7d376f31-7a40-4787-9ecf-e08e63ab1d30 tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1ded3918-3bae-465c-a53c-e88011914c50/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.159292 Apr 11 19:24:03 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 56/179] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Apr 11 19:24:03 2023] GET /compute/v2.1/servers/1ded3918-3bae-465c-a53c-e88011914c50/os-interface => generated 282 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:24:04 user devstack@n-api.service[72090]: DEBUG dbcounter [-] [72090] Writing DB stats nova_cell0:SELECT=2 {{(pid=72090) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:24:04 user devstack@n-api.service[72090]: DEBUG dbcounter [-] [72090] Writing DB stats nova_cell0:SELECT=6 {{(pid=72090) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:24:04 user devstack@n-api.service[72090]: DEBUG dbcounter [-] [72090] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=3 {{(pid=72090) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:24:04 user devstack@n-api.service[72090]: DEBUG dbcounter [-] [72090] Writing DB stats nova_cell1:SELECT=46,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=72090) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:24:04 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [None req-d32c7c71-7d17-4c97-8a1c-a5acfb204c03 tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] Calling method '>' {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:24:04 user devstack@n-api.service[72090]: DEBUG nova.compute.api [None req-d32c7c71-7d17-4c97-8a1c-a5acfb204c03 tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] [instance: a49d379e-3976-4d68-b6df-f572a922107c] Fetching instance by UUID {{(pid=72090) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:24:04 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-d32c7c71-7d17-4c97-8a1c-a5acfb204c03 tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:24:04 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-d32c7c71-7d17-4c97-8a1c-a5acfb204c03 tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:24:04 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-d32c7c71-7d17-4c97-8a1c-a5acfb204c03 tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:24:04 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-d32c7c71-7d17-4c97-8a1c-a5acfb204c03 tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:24:04 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-d32c7c71-7d17-4c97-8a1c-a5acfb204c03 tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:24:04 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-d32c7c71-7d17-4c97-8a1c-a5acfb204c03 tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:24:04 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [None req-d32c7c71-7d17-4c97-8a1c-a5acfb204c03 tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a49d379e-3976-4d68-b6df-f572a922107c/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.119708 Apr 11 19:24:04 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 59/180] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Apr 11 19:24:04 2023] GET /compute/v2.1/servers/a49d379e-3976-4d68-b6df-f572a922107c/os-interface => generated 283 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:24:04 user devstack@n-api.service[72089]: DEBUG dbcounter [-] [72089] Writing DB stats nova_cell0:SELECT=2 {{(pid=72089) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:24:04 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [req-f57dce0f-c8fe-49d9-b473-b0dd94103bb8 req-ac16e513-ca86-48f9-8ccf-e3f9c2076d31 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1ded3918-3bae-465c-a53c-e88011914c50", "tag": "8f590426-373c-4a90-8829-a2ad1a61fcd7"}]} {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:24:04 user devstack@n-api.service[72089]: DEBUG dbcounter [-] [72089] Writing DB stats nova_api:SELECT=21 {{(pid=72089) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:24:04 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-f57dce0f-c8fe-49d9-b473-b0dd94103bb8 req-ac16e513-ca86-48f9-8ccf-e3f9c2076d31 service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:24:04 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-f57dce0f-c8fe-49d9-b473-b0dd94103bb8 req-ac16e513-ca86-48f9-8ccf-e3f9c2076d31 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:24:04 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-f57dce0f-c8fe-49d9-b473-b0dd94103bb8 req-ac16e513-ca86-48f9-8ccf-e3f9c2076d31 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:24:04 user devstack@n-api.service[72089]: INFO nova.api.openstack.compute.server_external_events [req-f57dce0f-c8fe-49d9-b473-b0dd94103bb8 req-ac16e513-ca86-48f9-8ccf-e3f9c2076d31 service nova] Creating event network-changed:8f590426-373c-4a90-8829-a2ad1a61fcd7 for instance 1ded3918-3bae-465c-a53c-e88011914c50 on user Apr 11 19:24:05 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [req-f57dce0f-c8fe-49d9-b473-b0dd94103bb8 req-ac16e513-ca86-48f9-8ccf-e3f9c2076d31 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041214 Apr 11 19:24:05 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 66/181] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:24:04 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:24:06 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [None req-43a6bcab-dd6e-4b8f-877d-fd528c2f1a1f tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] Calling method '>' {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:24:06 user devstack@n-api.service[72088]: DEBUG nova.compute.api [None req-43a6bcab-dd6e-4b8f-877d-fd528c2f1a1f tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] [instance: 9941d033-15c2-4069-b9a6-f80840e95a38] Fetching instance by UUID {{(pid=72088) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:24:06 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-43a6bcab-dd6e-4b8f-877d-fd528c2f1a1f tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:24:06 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-43a6bcab-dd6e-4b8f-877d-fd528c2f1a1f tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:24:06 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-43a6bcab-dd6e-4b8f-877d-fd528c2f1a1f tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:24:06 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-43a6bcab-dd6e-4b8f-877d-fd528c2f1a1f tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:24:06 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-43a6bcab-dd6e-4b8f-877d-fd528c2f1a1f tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:24:06 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-43a6bcab-dd6e-4b8f-877d-fd528c2f1a1f tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:24:06 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [None req-43a6bcab-dd6e-4b8f-877d-fd528c2f1a1f tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9941d033-15c2-4069-b9a6-f80840e95a38/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.129096 Apr 11 19:24:06 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 57/182] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Apr 11 19:24:06 2023] GET /compute/v2.1/servers/9941d033-15c2-4069-b9a6-f80840e95a38/os-interface => generated 282 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:24:06 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [req-e5eb1b83-a98e-4ffb-b84d-4fa761061bbe req-8449595d-f76f-4d80-9621-3a161dd602fa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a49d379e-3976-4d68-b6df-f572a922107c", "tag": "936e8263-dbb3-4e76-8f6d-0e3269dc6066"}]} {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:24:06 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-e5eb1b83-a98e-4ffb-b84d-4fa761061bbe req-8449595d-f76f-4d80-9621-3a161dd602fa service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:24:06 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-e5eb1b83-a98e-4ffb-b84d-4fa761061bbe req-8449595d-f76f-4d80-9621-3a161dd602fa service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:24:06 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-e5eb1b83-a98e-4ffb-b84d-4fa761061bbe req-8449595d-f76f-4d80-9621-3a161dd602fa service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:24:06 user devstack@n-api.service[72090]: INFO nova.api.openstack.compute.server_external_events [req-e5eb1b83-a98e-4ffb-b84d-4fa761061bbe req-8449595d-f76f-4d80-9621-3a161dd602fa service nova] Creating event network-changed:936e8263-dbb3-4e76-8f6d-0e3269dc6066 for instance a49d379e-3976-4d68-b6df-f572a922107c on user Apr 11 19:24:06 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [req-e5eb1b83-a98e-4ffb-b84d-4fa761061bbe req-8449595d-f76f-4d80-9621-3a161dd602fa service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031341 Apr 11 19:24:06 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 60/183] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:24:06 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:24:06 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [None req-8a02dffa-2c07-4db4-9bbb-fd93a368dede tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "51e97579-56cc-414f-9a25-3a7c7d045694"}} {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:24:06 user devstack@n-api.service[72089]: DEBUG nova.compute.api [None req-8a02dffa-2c07-4db4-9bbb-fd93a368dede tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] [instance: a49d379e-3976-4d68-b6df-f572a922107c] Fetching instance by UUID {{(pid=72089) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:24:06 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-8a02dffa-2c07-4db4-9bbb-fd93a368dede tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:24:06 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-8a02dffa-2c07-4db4-9bbb-fd93a368dede tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:24:06 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-8a02dffa-2c07-4db4-9bbb-fd93a368dede tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:24:06 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-8a02dffa-2c07-4db4-9bbb-fd93a368dede tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:24:06 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-8a02dffa-2c07-4db4-9bbb-fd93a368dede tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:24:06 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-8a02dffa-2c07-4db4-9bbb-fd93a368dede tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:24:06 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [None req-aeebc2db-b9e9-439e-8c9f-5ce86e0b933c tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d7bac8da-a912-4a54-b7d8-a012f3ff9c79"}} {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:24:06 user devstack@n-api.service[72088]: DEBUG nova.compute.api [None req-aeebc2db-b9e9-439e-8c9f-5ce86e0b933c tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] [instance: 1ded3918-3bae-465c-a53c-e88011914c50] Fetching instance by UUID {{(pid=72088) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:24:06 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-aeebc2db-b9e9-439e-8c9f-5ce86e0b933c tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:24:06 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-aeebc2db-b9e9-439e-8c9f-5ce86e0b933c tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:24:06 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-aeebc2db-b9e9-439e-8c9f-5ce86e0b933c tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:24:06 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-aeebc2db-b9e9-439e-8c9f-5ce86e0b933c tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:24:06 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-aeebc2db-b9e9-439e-8c9f-5ce86e0b933c tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:24:06 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-aeebc2db-b9e9-439e-8c9f-5ce86e0b933c tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:24:06 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [None req-8a02dffa-2c07-4db4-9bbb-fd93a368dede tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] 10.0.0.210 "POST /compute/v2.1/servers/a49d379e-3976-4d68-b6df-f572a922107c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.341604 Apr 11 19:24:06 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 67/184] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Apr 11 19:24:06 2023] POST /compute/v2.1/servers/a49d379e-3976-4d68-b6df-f572a922107c/os-volume_attachments => generated 194 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:24:06 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [None req-aeebc2db-b9e9-439e-8c9f-5ce86e0b933c tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] 10.0.0.210 "POST /compute/v2.1/servers/1ded3918-3bae-465c-a53c-e88011914c50/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.297825 Apr 11 19:24:06 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 58/185] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Apr 11 19:24:06 2023] POST /compute/v2.1/servers/1ded3918-3bae-465c-a53c-e88011914c50/os-volume_attachments => generated 194 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:24:07 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [req-6ef8e0c5-ee2d-46fe-b9b9-f5f547c33bd4 req-b5630e9d-035b-4fa0-9869-fa8d6a08c3dc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9941d033-15c2-4069-b9a6-f80840e95a38", "tag": "031df3cc-5433-459d-ab9b-484629289e90"}]} {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:24:07 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-6ef8e0c5-ee2d-46fe-b9b9-f5f547c33bd4 req-b5630e9d-035b-4fa0-9869-fa8d6a08c3dc service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:24:07 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-6ef8e0c5-ee2d-46fe-b9b9-f5f547c33bd4 req-b5630e9d-035b-4fa0-9869-fa8d6a08c3dc service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:24:07 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-6ef8e0c5-ee2d-46fe-b9b9-f5f547c33bd4 req-b5630e9d-035b-4fa0-9869-fa8d6a08c3dc service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:24:07 user devstack@n-api.service[72090]: INFO nova.api.openstack.compute.server_external_events [req-6ef8e0c5-ee2d-46fe-b9b9-f5f547c33bd4 req-b5630e9d-035b-4fa0-9869-fa8d6a08c3dc service nova] Creating event network-changed:031df3cc-5433-459d-ab9b-484629289e90 for instance 9941d033-15c2-4069-b9a6-f80840e95a38 on user Apr 11 19:24:07 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [req-6ef8e0c5-ee2d-46fe-b9b9-f5f547c33bd4 req-b5630e9d-035b-4fa0-9869-fa8d6a08c3dc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036628 Apr 11 19:24:07 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 61/186] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:24:07 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:24:08 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [None req-7d7ee8c8-1fd2-4400-81c3-89a221679f69 tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "447d1208-42c3-46ec-b882-104ae99ab8fe"}} {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:24:08 user devstack@n-api.service[72089]: DEBUG nova.compute.api [None req-7d7ee8c8-1fd2-4400-81c3-89a221679f69 tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] [instance: 9941d033-15c2-4069-b9a6-f80840e95a38] Fetching instance by UUID {{(pid=72089) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:24:08 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-7d7ee8c8-1fd2-4400-81c3-89a221679f69 tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:24:08 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-7d7ee8c8-1fd2-4400-81c3-89a221679f69 tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:24:08 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-7d7ee8c8-1fd2-4400-81c3-89a221679f69 tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:24:08 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-7d7ee8c8-1fd2-4400-81c3-89a221679f69 tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:24:08 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-7d7ee8c8-1fd2-4400-81c3-89a221679f69 tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:24:08 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-7d7ee8c8-1fd2-4400-81c3-89a221679f69 tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:24:09 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [None req-7d7ee8c8-1fd2-4400-81c3-89a221679f69 tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] 10.0.0.210 "POST /compute/v2.1/servers/9941d033-15c2-4069-b9a6-f80840e95a38/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.333909 Apr 11 19:24:09 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 68/187] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Apr 11 19:24:08 2023] POST /compute/v2.1/servers/9941d033-15c2-4069-b9a6-f80840e95a38/os-volume_attachments => generated 194 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:24:09 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [None req-87e7c873-b206-4bc4-9198-1ec370345594 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] Calling method '>' {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:24:09 user devstack@n-api.service[72088]: DEBUG nova.compute.api [None req-87e7c873-b206-4bc4-9198-1ec370345594 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] [instance: dde6b4d2-9288-474c-b400-ce3b6f393b24] Fetching instance by UUID {{(pid=72088) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:24:09 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-87e7c873-b206-4bc4-9198-1ec370345594 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:24:09 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-87e7c873-b206-4bc4-9198-1ec370345594 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:24:09 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-87e7c873-b206-4bc4-9198-1ec370345594 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:24:09 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-87e7c873-b206-4bc4-9198-1ec370345594 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:24:09 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-87e7c873-b206-4bc4-9198-1ec370345594 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:24:09 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-87e7c873-b206-4bc4-9198-1ec370345594 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:24:09 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [None req-87e7c873-b206-4bc4-9198-1ec370345594 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] 10.0.0.210 "GET /compute/v2.1/servers/dde6b4d2-9288-474c-b400-ce3b6f393b24/os-interface" status: 200 len: 1829 microversion: 2.42 time: 0.140227 Apr 11 19:24:09 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 59/188] 10.0.0.210 () {64 vars in 1393 bytes} [Tue Apr 11 19:24:09 2023] GET /compute/v2.1/servers/dde6b4d2-9288-474c-b400-ce3b6f393b24/os-interface => generated 1829 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 19:24:09 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [None req-1f4bbd98-3a47-4f5c-a7e4-7769191f451c tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] Calling method '>' {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:24:09 user devstack@n-api.service[72090]: DEBUG nova.compute.api [None req-1f4bbd98-3a47-4f5c-a7e4-7769191f451c tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] [instance: b71d95ed-728d-4386-b7c6-50b252718ca9] Fetching instance by UUID {{(pid=72090) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:24:09 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-1f4bbd98-3a47-4f5c-a7e4-7769191f451c tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:24:09 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-1f4bbd98-3a47-4f5c-a7e4-7769191f451c tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:24:09 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-1f4bbd98-3a47-4f5c-a7e4-7769191f451c tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:24:09 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-1f4bbd98-3a47-4f5c-a7e4-7769191f451c tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:24:09 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-1f4bbd98-3a47-4f5c-a7e4-7769191f451c tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:24:09 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-1f4bbd98-3a47-4f5c-a7e4-7769191f451c tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:24:10 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [None req-1f4bbd98-3a47-4f5c-a7e4-7769191f451c tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b71d95ed-728d-4386-b7c6-50b252718ca9/os-interface" status: 200 len: 283 microversion: 2.49 time: 0.661705 Apr 11 19:24:10 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 62/189] 10.0.0.210 () {64 vars in 1393 bytes} [Tue Apr 11 19:24:09 2023] GET /compute/v2.1/servers/b71d95ed-728d-4386-b7c6-50b252718ca9/os-interface => generated 283 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:24:10 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [req-1e1ccd08-5631-41f9-98b1-1cdd05c4a769 req-37b37669-3d34-4141-890c-e54410c4a539 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dde6b4d2-9288-474c-b400-ce3b6f393b24", "tag": "aeb74c01-d96e-4838-8d2c-c2499e3f8770"}]} {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:24:10 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-1e1ccd08-5631-41f9-98b1-1cdd05c4a769 req-37b37669-3d34-4141-890c-e54410c4a539 service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:24:10 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-1e1ccd08-5631-41f9-98b1-1cdd05c4a769 req-37b37669-3d34-4141-890c-e54410c4a539 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:24:10 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-1e1ccd08-5631-41f9-98b1-1cdd05c4a769 req-37b37669-3d34-4141-890c-e54410c4a539 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:24:10 user devstack@n-api.service[72089]: INFO nova.api.openstack.compute.server_external_events [req-1e1ccd08-5631-41f9-98b1-1cdd05c4a769 req-37b37669-3d34-4141-890c-e54410c4a539 service nova] Creating event network-changed:aeb74c01-d96e-4838-8d2c-c2499e3f8770 for instance dde6b4d2-9288-474c-b400-ce3b6f393b24 on user Apr 11 19:24:10 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [req-1e1ccd08-5631-41f9-98b1-1cdd05c4a769 req-37b37669-3d34-4141-890c-e54410c4a539 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061999 Apr 11 19:24:10 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 69/190] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:24:10 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:24:10 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [None req-84e89ad7-dc99-481c-a2b5-aa081ac8a8f8 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] Calling method '>' {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:24:10 user devstack@n-api.service[72088]: DEBUG nova.compute.api [None req-84e89ad7-dc99-481c-a2b5-aa081ac8a8f8 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] [instance: dde6b4d2-9288-474c-b400-ce3b6f393b24] Fetching instance by UUID {{(pid=72088) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:24:10 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-84e89ad7-dc99-481c-a2b5-aa081ac8a8f8 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:24:10 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-84e89ad7-dc99-481c-a2b5-aa081ac8a8f8 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:24:10 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-84e89ad7-dc99-481c-a2b5-aa081ac8a8f8 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:24:10 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-84e89ad7-dc99-481c-a2b5-aa081ac8a8f8 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:24:10 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-84e89ad7-dc99-481c-a2b5-aa081ac8a8f8 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:24:10 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-84e89ad7-dc99-481c-a2b5-aa081ac8a8f8 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:24:10 user devstack@n-api.service[72088]: DEBUG nova.policy [None req-84e89ad7-dc99-481c-a2b5-aa081ac8a8f8 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f44f0d0807342ba9b851e7530a82294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1afa97b49ae647c899a05d54b7f0f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72088) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:24:10 user devstack@n-api.service[72088]: DEBUG nova.policy [None req-84e89ad7-dc99-481c-a2b5-aa081ac8a8f8 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f44f0d0807342ba9b851e7530a82294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1afa97b49ae647c899a05d54b7f0f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72088) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:24:10 user devstack@n-api.service[72088]: DEBUG nova.policy [None req-84e89ad7-dc99-481c-a2b5-aa081ac8a8f8 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f44f0d0807342ba9b851e7530a82294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1afa97b49ae647c899a05d54b7f0f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72088) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:24:10 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [None req-84e89ad7-dc99-481c-a2b5-aa081ac8a8f8 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] 10.0.0.210 "GET /compute/v2.1/servers/dde6b4d2-9288-474c-b400-ce3b6f393b24" status: 200 len: 2824 microversion: 2.42 time: 0.204495 Apr 11 19:24:10 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 60/191] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 19:24:10 2023] GET /compute/v2.1/servers/dde6b4d2-9288-474c-b400-ce3b6f393b24 => generated 2824 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 19:24:10 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [None req-ab1c09b1-05e3-42c2-8b78-5f333b7948c9 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] Calling method '>' {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:24:10 user devstack@n-api.service[72090]: DEBUG nova.compute.api [None req-ab1c09b1-05e3-42c2-8b78-5f333b7948c9 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] [instance: dde6b4d2-9288-474c-b400-ce3b6f393b24] Fetching instance by UUID {{(pid=72090) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:24:10 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-ab1c09b1-05e3-42c2-8b78-5f333b7948c9 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:24:10 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-ab1c09b1-05e3-42c2-8b78-5f333b7948c9 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:24:10 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-ab1c09b1-05e3-42c2-8b78-5f333b7948c9 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:24:10 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-ab1c09b1-05e3-42c2-8b78-5f333b7948c9 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:24:10 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-ab1c09b1-05e3-42c2-8b78-5f333b7948c9 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:24:10 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-ab1c09b1-05e3-42c2-8b78-5f333b7948c9 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:24:10 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [None req-ab1c09b1-05e3-42c2-8b78-5f333b7948c9 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] 10.0.0.210 "GET /compute/v2.1/servers/dde6b4d2-9288-474c-b400-ce3b6f393b24/os-interface" status: 200 len: 1829 microversion: 2.42 time: 0.170453 Apr 11 19:24:10 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 63/192] 10.0.0.210 () {64 vars in 1393 bytes} [Tue Apr 11 19:24:10 2023] GET /compute/v2.1/servers/dde6b4d2-9288-474c-b400-ce3b6f393b24/os-interface => generated 1829 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 19:24:11 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [req-f50f05e5-b3a1-4894-af92-99a728174aca req-5b93b50f-f1a1-49c4-8e05-02cdc61bc352 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b71d95ed-728d-4386-b7c6-50b252718ca9", "tag": "64bd141d-04e6-46e6-bb46-e997d3234fa1"}]} {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:24:11 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-f50f05e5-b3a1-4894-af92-99a728174aca req-5b93b50f-f1a1-49c4-8e05-02cdc61bc352 service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:24:11 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-f50f05e5-b3a1-4894-af92-99a728174aca req-5b93b50f-f1a1-49c4-8e05-02cdc61bc352 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:24:11 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-f50f05e5-b3a1-4894-af92-99a728174aca req-5b93b50f-f1a1-49c4-8e05-02cdc61bc352 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:24:11 user devstack@n-api.service[72089]: INFO nova.api.openstack.compute.server_external_events [req-f50f05e5-b3a1-4894-af92-99a728174aca req-5b93b50f-f1a1-49c4-8e05-02cdc61bc352 service nova] Creating event network-changed:64bd141d-04e6-46e6-bb46-e997d3234fa1 for instance b71d95ed-728d-4386-b7c6-50b252718ca9 on user Apr 11 19:24:11 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [req-f50f05e5-b3a1-4894-af92-99a728174aca req-5b93b50f-f1a1-49c4-8e05-02cdc61bc352 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037921 Apr 11 19:24:11 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 70/193] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:24:11 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:24:11 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [None req-33f4a224-953c-434b-a336-6994e454a3c5 tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] Calling method '>' {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:24:11 user devstack@n-api.service[72088]: DEBUG nova.compute.api [None req-33f4a224-953c-434b-a336-6994e454a3c5 tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] [instance: b71d95ed-728d-4386-b7c6-50b252718ca9] Fetching instance by UUID {{(pid=72088) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:24:11 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-33f4a224-953c-434b-a336-6994e454a3c5 tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:24:11 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-33f4a224-953c-434b-a336-6994e454a3c5 tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:24:11 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-33f4a224-953c-434b-a336-6994e454a3c5 tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:24:11 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-33f4a224-953c-434b-a336-6994e454a3c5 tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:24:11 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-33f4a224-953c-434b-a336-6994e454a3c5 tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:24:11 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-33f4a224-953c-434b-a336-6994e454a3c5 tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:24:11 user devstack@n-api.service[72088]: DEBUG nova.policy [None req-33f4a224-953c-434b-a336-6994e454a3c5 tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f84e7cbdf6a4e588753fea907beba0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f39e7fdf571442b0a6f136020a99f7fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72088) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:24:11 user devstack@n-api.service[72088]: DEBUG nova.policy [None req-33f4a224-953c-434b-a336-6994e454a3c5 tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f84e7cbdf6a4e588753fea907beba0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f39e7fdf571442b0a6f136020a99f7fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72088) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:24:11 user devstack@n-api.service[72088]: DEBUG nova.policy [None req-33f4a224-953c-434b-a336-6994e454a3c5 tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f84e7cbdf6a4e588753fea907beba0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f39e7fdf571442b0a6f136020a99f7fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72088) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:24:11 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [None req-33f4a224-953c-434b-a336-6994e454a3c5 tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b71d95ed-728d-4386-b7c6-50b252718ca9" status: 200 len: 1627 microversion: 2.49 time: 0.150663 Apr 11 19:24:11 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 61/194] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 19:24:11 2023] GET /compute/v2.1/servers/b71d95ed-728d-4386-b7c6-50b252718ca9 => generated 1627 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 19:24:11 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [None req-c220a37e-8657-4d8e-aa7a-7968b0f0623c tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] Action: 'create', calling method: >, body: {"interfaceAttachment": {"net_id": "e6c6359b-b540-4414-b8d0-150634a2c699", "tag": "nic-tag"}} {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:24:11 user devstack@n-api.service[72090]: DEBUG nova.compute.api [None req-c220a37e-8657-4d8e-aa7a-7968b0f0623c tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] [instance: b71d95ed-728d-4386-b7c6-50b252718ca9] Fetching instance by UUID {{(pid=72090) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:24:11 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-c220a37e-8657-4d8e-aa7a-7968b0f0623c tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:24:11 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-c220a37e-8657-4d8e-aa7a-7968b0f0623c tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:24:11 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-c220a37e-8657-4d8e-aa7a-7968b0f0623c tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:24:11 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-c220a37e-8657-4d8e-aa7a-7968b0f0623c tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:24:11 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-c220a37e-8657-4d8e-aa7a-7968b0f0623c tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:24:11 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-c220a37e-8657-4d8e-aa7a-7968b0f0623c tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:24:11 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [None req-0fd068c2-8d8b-4975-a04f-dbdfd899f2c2 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] Calling method '>' {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:24:11 user devstack@n-api.service[72089]: DEBUG nova.compute.api [None req-0fd068c2-8d8b-4975-a04f-dbdfd899f2c2 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] [instance: dde6b4d2-9288-474c-b400-ce3b6f393b24] Fetching instance by UUID {{(pid=72089) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:24:11 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-0fd068c2-8d8b-4975-a04f-dbdfd899f2c2 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:24:11 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-0fd068c2-8d8b-4975-a04f-dbdfd899f2c2 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:24:11 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-0fd068c2-8d8b-4975-a04f-dbdfd899f2c2 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:24:11 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-0fd068c2-8d8b-4975-a04f-dbdfd899f2c2 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:24:11 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-0fd068c2-8d8b-4975-a04f-dbdfd899f2c2 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:24:11 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-0fd068c2-8d8b-4975-a04f-dbdfd899f2c2 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:24:11 user devstack@n-api.service[72089]: DEBUG nova.compute.api [None req-0fd068c2-8d8b-4975-a04f-dbdfd899f2c2 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] [instance: dde6b4d2-9288-474c-b400-ce3b6f393b24] Going to try to terminate instance {{(pid=72089) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 11 19:24:11 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [None req-0fd068c2-8d8b-4975-a04f-dbdfd899f2c2 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/dde6b4d2-9288-474c-b400-ce3b6f393b24" status: 204 len: 0 microversion: 2.42 time: 0.139855 Apr 11 19:24:11 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 71/195] 10.0.0.210 () {64 vars in 1357 bytes} [Tue Apr 11 19:24:11 2023] DELETE /compute/v2.1/servers/dde6b4d2-9288-474c-b400-ce3b6f393b24 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 11 19:24:11 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [None req-98c4eee3-240e-45fe-8aee-604747057707 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] Calling method '>' {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:24:11 user devstack@n-api.service[72088]: DEBUG nova.compute.api [None req-98c4eee3-240e-45fe-8aee-604747057707 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] [instance: dde6b4d2-9288-474c-b400-ce3b6f393b24] Fetching instance by UUID {{(pid=72088) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:24:11 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-98c4eee3-240e-45fe-8aee-604747057707 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:24:11 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-98c4eee3-240e-45fe-8aee-604747057707 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:24:11 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-98c4eee3-240e-45fe-8aee-604747057707 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:24:11 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-98c4eee3-240e-45fe-8aee-604747057707 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:24:11 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-98c4eee3-240e-45fe-8aee-604747057707 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:24:11 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-98c4eee3-240e-45fe-8aee-604747057707 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:24:12 user devstack@n-api.service[72088]: DEBUG nova.policy [None req-98c4eee3-240e-45fe-8aee-604747057707 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f44f0d0807342ba9b851e7530a82294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1afa97b49ae647c899a05d54b7f0f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72088) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:24:12 user devstack@n-api.service[72088]: DEBUG nova.policy [None req-98c4eee3-240e-45fe-8aee-604747057707 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f44f0d0807342ba9b851e7530a82294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1afa97b49ae647c899a05d54b7f0f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72088) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:24:12 user devstack@n-api.service[72088]: DEBUG nova.policy [None req-98c4eee3-240e-45fe-8aee-604747057707 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f44f0d0807342ba9b851e7530a82294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1afa97b49ae647c899a05d54b7f0f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72088) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:24:12 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [None req-98c4eee3-240e-45fe-8aee-604747057707 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] 10.0.0.210 "GET /compute/v2.1/servers/dde6b4d2-9288-474c-b400-ce3b6f393b24" status: 200 len: 2949 microversion: 2.42 time: 0.235335 Apr 11 19:24:12 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 62/196] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 19:24:11 2023] GET /compute/v2.1/servers/dde6b4d2-9288-474c-b400-ce3b6f393b24 => generated 2949 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 19:24:12 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [req-3b5f6418-bf6b-4426-9cd4-382625d98ba5 req-7f56ae4b-91af-44a0-ab65-57e8aaa0a721 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dde6b4d2-9288-474c-b400-ce3b6f393b24", "name": "network-vif-unplugged", "status": "completed", "tag": "4768cc5b-e792-4c52-805a-7f288ed9fbe5"}]} {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:24:12 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-3b5f6418-bf6b-4426-9cd4-382625d98ba5 req-7f56ae4b-91af-44a0-ab65-57e8aaa0a721 service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:24:12 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-3b5f6418-bf6b-4426-9cd4-382625d98ba5 req-7f56ae4b-91af-44a0-ab65-57e8aaa0a721 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:24:12 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-3b5f6418-bf6b-4426-9cd4-382625d98ba5 req-7f56ae4b-91af-44a0-ab65-57e8aaa0a721 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:24:12 user devstack@n-api.service[72089]: INFO nova.api.openstack.compute.server_external_events [req-3b5f6418-bf6b-4426-9cd4-382625d98ba5 req-7f56ae4b-91af-44a0-ab65-57e8aaa0a721 service nova] Creating event network-vif-unplugged:4768cc5b-e792-4c52-805a-7f288ed9fbe5 for instance dde6b4d2-9288-474c-b400-ce3b6f393b24 on user Apr 11 19:24:12 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [req-3b5f6418-bf6b-4426-9cd4-382625d98ba5 req-7f56ae4b-91af-44a0-ab65-57e8aaa0a721 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.043559 Apr 11 19:24:12 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 72/197] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:24:12 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:24:13 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [req-6470592f-3594-494b-961e-dd582069b666 req-25f52be0-02b4-4480-b03a-c97e3f09aa2a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dde6b4d2-9288-474c-b400-ce3b6f393b24", "name": "network-vif-unplugged", "status": "completed", "tag": "aeb74c01-d96e-4838-8d2c-c2499e3f8770"}, {"server_uuid": "dde6b4d2-9288-474c-b400-ce3b6f393b24", "name": "network-vif-plugged", "status": "completed", "tag": "aeb74c01-d96e-4838-8d2c-c2499e3f8770"}, {"server_uuid": "dde6b4d2-9288-474c-b400-ce3b6f393b24", "name": "network-vif-unplugged", "status": "completed", "tag": "66cd1e83-c736-444c-84c7-ecfc2c2b3802"}]} {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:24:13 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-6470592f-3594-494b-961e-dd582069b666 req-25f52be0-02b4-4480-b03a-c97e3f09aa2a service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:24:13 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-6470592f-3594-494b-961e-dd582069b666 req-25f52be0-02b4-4480-b03a-c97e3f09aa2a service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:24:13 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-6470592f-3594-494b-961e-dd582069b666 req-25f52be0-02b4-4480-b03a-c97e3f09aa2a service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:24:13 user devstack@n-api.service[72088]: INFO nova.api.openstack.compute.server_external_events [req-6470592f-3594-494b-961e-dd582069b666 req-25f52be0-02b4-4480-b03a-c97e3f09aa2a service nova] Creating event network-vif-unplugged:aeb74c01-d96e-4838-8d2c-c2499e3f8770 for instance dde6b4d2-9288-474c-b400-ce3b6f393b24 on user Apr 11 19:24:13 user devstack@n-api.service[72088]: INFO nova.api.openstack.compute.server_external_events [req-6470592f-3594-494b-961e-dd582069b666 req-25f52be0-02b4-4480-b03a-c97e3f09aa2a service nova] Creating event network-vif-plugged:aeb74c01-d96e-4838-8d2c-c2499e3f8770 for instance dde6b4d2-9288-474c-b400-ce3b6f393b24 on user Apr 11 19:24:13 user devstack@n-api.service[72088]: INFO nova.api.openstack.compute.server_external_events [req-6470592f-3594-494b-961e-dd582069b666 req-25f52be0-02b4-4480-b03a-c97e3f09aa2a service nova] Creating event network-vif-unplugged:66cd1e83-c736-444c-84c7-ecfc2c2b3802 for instance dde6b4d2-9288-474c-b400-ce3b6f393b24 on user Apr 11 19:24:13 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [req-6470592f-3594-494b-961e-dd582069b666 req-25f52be0-02b4-4480-b03a-c97e3f09aa2a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 529 microversion: 2.1 time: 0.049165 Apr 11 19:24:13 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 63/198] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:24:13 2023] POST /compute/v2.1/os-server-external-events => generated 529 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:24:13 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [req-da2764f8-1c42-41de-b0be-2481bf890d89 req-263761f8-da83-47a9-a87a-0e86bd0ec36b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b71d95ed-728d-4386-b7c6-50b252718ca9", "tag": "8f3ff9dd-32cc-4b19-b059-4e4e3da4d3a7"}]} {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:24:13 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-da2764f8-1c42-41de-b0be-2481bf890d89 req-263761f8-da83-47a9-a87a-0e86bd0ec36b service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:24:13 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-da2764f8-1c42-41de-b0be-2481bf890d89 req-263761f8-da83-47a9-a87a-0e86bd0ec36b service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:24:13 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-da2764f8-1c42-41de-b0be-2481bf890d89 req-263761f8-da83-47a9-a87a-0e86bd0ec36b service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:24:13 user devstack@n-api.service[72089]: INFO nova.api.openstack.compute.server_external_events [req-da2764f8-1c42-41de-b0be-2481bf890d89 req-263761f8-da83-47a9-a87a-0e86bd0ec36b service nova] Creating event network-changed:8f3ff9dd-32cc-4b19-b059-4e4e3da4d3a7 for instance b71d95ed-728d-4386-b7c6-50b252718ca9 on user Apr 11 19:24:13 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [req-da2764f8-1c42-41de-b0be-2481bf890d89 req-263761f8-da83-47a9-a87a-0e86bd0ec36b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081235 Apr 11 19:24:13 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 73/199] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:24:13 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:24:14 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [req-74d2f6b7-ba26-4622-b7fb-5cbe2790bf1d req-ea50688c-c529-484a-a5bb-c2f768da6d3f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dde6b4d2-9288-474c-b400-ce3b6f393b24", "name": "network-vif-plugged", "status": "completed", "tag": "4768cc5b-e792-4c52-805a-7f288ed9fbe5"}, {"server_uuid": "dde6b4d2-9288-474c-b400-ce3b6f393b24", "name": "network-vif-unplugged", "status": "completed", "tag": "1d14016e-af6d-4ce8-bd51-8a9dba7c4261"}, {"server_uuid": "dde6b4d2-9288-474c-b400-ce3b6f393b24", "name": "network-vif-plugged", "status": "completed", "tag": "1d14016e-af6d-4ce8-bd51-8a9dba7c4261"}, {"server_uuid": "dde6b4d2-9288-474c-b400-ce3b6f393b24", "name": "network-vif-unplugged", "status": "completed", "tag": "576d5a47-cb3a-4794-bc1e-dcbb82e25352"}, {"server_uuid": "dde6b4d2-9288-474c-b400-ce3b6f393b24", "name": "network-vif-plugged", "status": "completed", "tag": "576d5a47-cb3a-4794-bc1e-dcbb82e25352"}, {"server_uuid": "dde6b4d2-9288-474c-b400-ce3b6f393b24", "name": "network-vif-unplugged", "status": "completed", "tag": "db299c0f-eae0-45ae-ba9c-037c50e06a3c"}, {"server_uuid": "dde6b4d2-9288-474c-b400-ce3b6f393b24", "name": "network-vif-plugged", "status": "completed", "tag": "db299c0f-eae0-45ae-ba9c-037c50e06a3c"}, {"server_uuid": "dde6b4d2-9288-474c-b400-ce3b6f393b24", "name": "network-vif-unplugged", "status": "completed", "tag": "7e8c8382-c878-4ac7-b626-01cf2bc2f349"}, {"server_uuid": "dde6b4d2-9288-474c-b400-ce3b6f393b24", "name": "network-vif-plugged", "status": "completed", "tag": "7e8c8382-c878-4ac7-b626-01cf2bc2f349"}]} {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:24:14 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-74d2f6b7-ba26-4622-b7fb-5cbe2790bf1d req-ea50688c-c529-484a-a5bb-c2f768da6d3f service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:24:14 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-74d2f6b7-ba26-4622-b7fb-5cbe2790bf1d req-ea50688c-c529-484a-a5bb-c2f768da6d3f service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:24:14 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-74d2f6b7-ba26-4622-b7fb-5cbe2790bf1d req-ea50688c-c529-484a-a5bb-c2f768da6d3f service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:24:14 user devstack@n-api.service[72088]: INFO nova.api.openstack.compute.server_external_events [req-74d2f6b7-ba26-4622-b7fb-5cbe2790bf1d req-ea50688c-c529-484a-a5bb-c2f768da6d3f service nova] Creating event network-vif-plugged:4768cc5b-e792-4c52-805a-7f288ed9fbe5 for instance dde6b4d2-9288-474c-b400-ce3b6f393b24 on user Apr 11 19:24:14 user devstack@n-api.service[72088]: INFO nova.api.openstack.compute.server_external_events [req-74d2f6b7-ba26-4622-b7fb-5cbe2790bf1d req-ea50688c-c529-484a-a5bb-c2f768da6d3f service nova] Creating event network-vif-unplugged:1d14016e-af6d-4ce8-bd51-8a9dba7c4261 for instance dde6b4d2-9288-474c-b400-ce3b6f393b24 on user Apr 11 19:24:14 user devstack@n-api.service[72088]: INFO nova.api.openstack.compute.server_external_events [req-74d2f6b7-ba26-4622-b7fb-5cbe2790bf1d req-ea50688c-c529-484a-a5bb-c2f768da6d3f service nova] Creating event network-vif-plugged:1d14016e-af6d-4ce8-bd51-8a9dba7c4261 for instance dde6b4d2-9288-474c-b400-ce3b6f393b24 on user Apr 11 19:24:14 user devstack@n-api.service[72088]: INFO nova.api.openstack.compute.server_external_events [req-74d2f6b7-ba26-4622-b7fb-5cbe2790bf1d req-ea50688c-c529-484a-a5bb-c2f768da6d3f service nova] Creating event network-vif-unplugged:576d5a47-cb3a-4794-bc1e-dcbb82e25352 for instance dde6b4d2-9288-474c-b400-ce3b6f393b24 on user Apr 11 19:24:14 user devstack@n-api.service[72088]: INFO nova.api.openstack.compute.server_external_events [req-74d2f6b7-ba26-4622-b7fb-5cbe2790bf1d req-ea50688c-c529-484a-a5bb-c2f768da6d3f service nova] Creating event network-vif-plugged:576d5a47-cb3a-4794-bc1e-dcbb82e25352 for instance dde6b4d2-9288-474c-b400-ce3b6f393b24 on user Apr 11 19:24:14 user devstack@n-api.service[72088]: INFO nova.api.openstack.compute.server_external_events [req-74d2f6b7-ba26-4622-b7fb-5cbe2790bf1d req-ea50688c-c529-484a-a5bb-c2f768da6d3f service nova] Creating event network-vif-unplugged:db299c0f-eae0-45ae-ba9c-037c50e06a3c for instance dde6b4d2-9288-474c-b400-ce3b6f393b24 on user Apr 11 19:24:14 user devstack@n-api.service[72088]: INFO nova.api.openstack.compute.server_external_events [req-74d2f6b7-ba26-4622-b7fb-5cbe2790bf1d req-ea50688c-c529-484a-a5bb-c2f768da6d3f service nova] Creating event network-vif-plugged:db299c0f-eae0-45ae-ba9c-037c50e06a3c for instance dde6b4d2-9288-474c-b400-ce3b6f393b24 on user Apr 11 19:24:14 user devstack@n-api.service[72088]: INFO nova.api.openstack.compute.server_external_events [req-74d2f6b7-ba26-4622-b7fb-5cbe2790bf1d req-ea50688c-c529-484a-a5bb-c2f768da6d3f service nova] Creating event network-vif-unplugged:7e8c8382-c878-4ac7-b626-01cf2bc2f349 for instance dde6b4d2-9288-474c-b400-ce3b6f393b24 on user Apr 11 19:24:14 user devstack@n-api.service[72088]: INFO nova.api.openstack.compute.server_external_events [req-74d2f6b7-ba26-4622-b7fb-5cbe2790bf1d req-ea50688c-c529-484a-a5bb-c2f768da6d3f service nova] Creating event network-vif-plugged:7e8c8382-c878-4ac7-b626-01cf2bc2f349 for instance dde6b4d2-9288-474c-b400-ce3b6f393b24 on user Apr 11 19:24:14 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [req-74d2f6b7-ba26-4622-b7fb-5cbe2790bf1d req-ea50688c-c529-484a-a5bb-c2f768da6d3f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 1559 microversion: 2.1 time: 0.065282 Apr 11 19:24:14 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 64/200] 10.0.0.210 () {68 vars in 1395 bytes} [Tue Apr 11 19:24:14 2023] POST /compute/v2.1/os-server-external-events => generated 1559 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:24:14 user devstack@n-api.service[72090]: DEBUG nova.compute.api [None req-c220a37e-8657-4d8e-aa7a-7968b0f0623c tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] [instance: b71d95ed-728d-4386-b7c6-50b252718ca9] Fetching instance by UUID {{(pid=72090) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:24:14 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-c220a37e-8657-4d8e-aa7a-7968b0f0623c tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:24:14 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-c220a37e-8657-4d8e-aa7a-7968b0f0623c tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:24:14 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-c220a37e-8657-4d8e-aa7a-7968b0f0623c tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:24:14 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-c220a37e-8657-4d8e-aa7a-7968b0f0623c tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:24:14 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-c220a37e-8657-4d8e-aa7a-7968b0f0623c tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:24:14 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-c220a37e-8657-4d8e-aa7a-7968b0f0623c tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:24:15 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [None req-c220a37e-8657-4d8e-aa7a-7968b0f0623c tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] 10.0.0.210 "POST /compute/v2.1/servers/b71d95ed-728d-4386-b7c6-50b252718ca9/os-interface" status: 200 len: 283 microversion: 2.49 time: 3.646276 Apr 11 19:24:15 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 64/201] 10.0.0.210 () {66 vars in 1414 bytes} [Tue Apr 11 19:24:11 2023] POST /compute/v2.1/servers/b71d95ed-728d-4386-b7c6-50b252718ca9/os-interface => generated 283 bytes in 3649 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:24:15 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [None req-59deae07-0a4b-407f-be6c-1170fa12c310 tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "65685406-4266-4909-9989-927850da7d53", "tag": "volume-tag"}} {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:24:15 user devstack@n-api.service[72089]: DEBUG nova.compute.api [None req-59deae07-0a4b-407f-be6c-1170fa12c310 tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] [instance: b71d95ed-728d-4386-b7c6-50b252718ca9] Fetching instance by UUID {{(pid=72089) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:24:15 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-59deae07-0a4b-407f-be6c-1170fa12c310 tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:24:15 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-59deae07-0a4b-407f-be6c-1170fa12c310 tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:24:15 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-59deae07-0a4b-407f-be6c-1170fa12c310 tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:24:15 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-59deae07-0a4b-407f-be6c-1170fa12c310 tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:24:15 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-59deae07-0a4b-407f-be6c-1170fa12c310 tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:24:15 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-59deae07-0a4b-407f-be6c-1170fa12c310 tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:24:15 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [None req-025ccd39-853e-4e56-94e4-623042df7f0c tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] Calling method '>' {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:24:15 user devstack@n-api.service[72088]: DEBUG nova.compute.api [None req-025ccd39-853e-4e56-94e4-623042df7f0c tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] [instance: 8e449d09-f632-4f57-b304-430734096596] Fetching instance by UUID {{(pid=72088) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:24:15 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-025ccd39-853e-4e56-94e4-623042df7f0c tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:24:15 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-025ccd39-853e-4e56-94e4-623042df7f0c tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:24:15 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-025ccd39-853e-4e56-94e4-623042df7f0c tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:24:15 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-025ccd39-853e-4e56-94e4-623042df7f0c tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:24:15 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-025ccd39-853e-4e56-94e4-623042df7f0c tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:24:15 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-025ccd39-853e-4e56-94e4-623042df7f0c tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:24:15 user devstack@n-api.service[72088]: DEBUG nova.compute.api [None req-025ccd39-853e-4e56-94e4-623042df7f0c tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] [instance: 8e449d09-f632-4f57-b304-430734096596] Going to try to terminate instance {{(pid=72088) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 11 19:24:15 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [None req-025ccd39-853e-4e56-94e4-623042df7f0c tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/8e449d09-f632-4f57-b304-430734096596" status: 204 len: 0 microversion: 2.1 time: 0.130553 Apr 11 19:24:15 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 65/202] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 19:24:15 2023] DELETE /compute/v2.1/servers/8e449d09-f632-4f57-b304-430734096596 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 11 19:24:15 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [None req-aa2ae244-9431-4894-9a14-2fd1333fb571 tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] Calling method '>' {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:24:15 user devstack@n-api.service[72090]: DEBUG nova.compute.api [None req-aa2ae244-9431-4894-9a14-2fd1333fb571 tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] [instance: 8e449d09-f632-4f57-b304-430734096596] Fetching instance by UUID {{(pid=72090) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:24:15 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-aa2ae244-9431-4894-9a14-2fd1333fb571 tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:24:15 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-aa2ae244-9431-4894-9a14-2fd1333fb571 tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:24:15 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-aa2ae244-9431-4894-9a14-2fd1333fb571 tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:24:15 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-aa2ae244-9431-4894-9a14-2fd1333fb571 tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:24:15 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-aa2ae244-9431-4894-9a14-2fd1333fb571 tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:24:15 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-aa2ae244-9431-4894-9a14-2fd1333fb571 tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:24:15 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [req-01625bab-061b-4f3d-8c32-e6d2a70147f5 req-343c61f6-972a-4c2f-8f2e-7b6b93033fd8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dde6b4d2-9288-474c-b400-ce3b6f393b24", "name": "network-vif-plugged", "status": "completed", "tag": "66cd1e83-c736-444c-84c7-ecfc2c2b3802"}]} {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:24:15 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-01625bab-061b-4f3d-8c32-e6d2a70147f5 req-343c61f6-972a-4c2f-8f2e-7b6b93033fd8 service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:24:15 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-01625bab-061b-4f3d-8c32-e6d2a70147f5 req-343c61f6-972a-4c2f-8f2e-7b6b93033fd8 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:24:15 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-01625bab-061b-4f3d-8c32-e6d2a70147f5 req-343c61f6-972a-4c2f-8f2e-7b6b93033fd8 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:24:15 user devstack@n-api.service[72088]: INFO nova.api.openstack.compute.server_external_events [req-01625bab-061b-4f3d-8c32-e6d2a70147f5 req-343c61f6-972a-4c2f-8f2e-7b6b93033fd8 service nova] Creating event network-vif-plugged:66cd1e83-c736-444c-84c7-ecfc2c2b3802 for instance dde6b4d2-9288-474c-b400-ce3b6f393b24 on user Apr 11 19:24:15 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [req-01625bab-061b-4f3d-8c32-e6d2a70147f5 req-343c61f6-972a-4c2f-8f2e-7b6b93033fd8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039968 Apr 11 19:24:15 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 66/203] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:24:15 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:24:15 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [None req-59deae07-0a4b-407f-be6c-1170fa12c310 tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] 10.0.0.210 "POST /compute/v2.1/servers/b71d95ed-728d-4386-b7c6-50b252718ca9/os-volume_attachments" status: 200 len: 194 microversion: 2.49 time: 0.341044 Apr 11 19:24:15 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 74/204] 10.0.0.210 () {66 vars in 1441 bytes} [Tue Apr 11 19:24:15 2023] POST /compute/v2.1/servers/b71d95ed-728d-4386-b7c6-50b252718ca9/os-volume_attachments => generated 194 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:24:15 user devstack@n-api.service[72090]: DEBUG nova.policy [None req-aa2ae244-9431-4894-9a14-2fd1333fb571 tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c9641ceb17e4914b1cdf061c5bdc79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7543456a70d04d7f8c50f37e64b7ee9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72090) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:24:15 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [req-29cea411-e79e-47a3-8197-30745c6b548a req-6bee10ae-1fd9-4f1e-ac7f-ede5a28a71ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b71d95ed-728d-4386-b7c6-50b252718ca9", "name": "network-vif-plugged", "status": "completed", "tag": "8f3ff9dd-32cc-4b19-b059-4e4e3da4d3a7"}, {"server_uuid": "b71d95ed-728d-4386-b7c6-50b252718ca9", "name": "network-vif-plugged", "status": "completed", "tag": "8f3ff9dd-32cc-4b19-b059-4e4e3da4d3a7"}]} {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:24:15 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [None req-aa2ae244-9431-4894-9a14-2fd1333fb571 tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8e449d09-f632-4f57-b304-430734096596" status: 200 len: 1491 microversion: 2.1 time: 0.165520 Apr 11 19:24:15 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 65/205] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 19:24:15 2023] GET /compute/v2.1/servers/8e449d09-f632-4f57-b304-430734096596 => generated 1491 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:24:15 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-29cea411-e79e-47a3-8197-30745c6b548a req-6bee10ae-1fd9-4f1e-ac7f-ede5a28a71ac service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:24:15 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-29cea411-e79e-47a3-8197-30745c6b548a req-6bee10ae-1fd9-4f1e-ac7f-ede5a28a71ac service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:24:15 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-29cea411-e79e-47a3-8197-30745c6b548a req-6bee10ae-1fd9-4f1e-ac7f-ede5a28a71ac service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:24:15 user devstack@n-api.service[72088]: INFO nova.api.openstack.compute.server_external_events [req-29cea411-e79e-47a3-8197-30745c6b548a req-6bee10ae-1fd9-4f1e-ac7f-ede5a28a71ac service nova] Creating event network-vif-plugged:8f3ff9dd-32cc-4b19-b059-4e4e3da4d3a7 for instance b71d95ed-728d-4386-b7c6-50b252718ca9 on user Apr 11 19:24:15 user devstack@n-api.service[72088]: INFO nova.api.openstack.compute.server_external_events [req-29cea411-e79e-47a3-8197-30745c6b548a req-6bee10ae-1fd9-4f1e-ac7f-ede5a28a71ac service nova] Creating event network-vif-plugged:8f3ff9dd-32cc-4b19-b059-4e4e3da4d3a7 for instance b71d95ed-728d-4386-b7c6-50b252718ca9 on user Apr 11 19:24:15 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [req-29cea411-e79e-47a3-8197-30745c6b548a req-6bee10ae-1fd9-4f1e-ac7f-ede5a28a71ac service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.035188 Apr 11 19:24:15 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 67/206] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:24:15 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:24:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [req-4918d90a-24b7-43c3-8811-3e1ebe4d5e5f req-a1413f02-94e1-497e-8538-efb8276aff08 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e449d09-f632-4f57-b304-430734096596", "name": "network-vif-unplugged", "status": "completed", "tag": "5dea909b-eaed-4978-b239-4177f6cbdfdc"}, {"server_uuid": "8e449d09-f632-4f57-b304-430734096596", "name": "network-vif-plugged", "status": "completed", "tag": "5dea909b-eaed-4978-b239-4177f6cbdfdc"}]} {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:24:17 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-4918d90a-24b7-43c3-8811-3e1ebe4d5e5f req-a1413f02-94e1-497e-8538-efb8276aff08 service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:24:17 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-4918d90a-24b7-43c3-8811-3e1ebe4d5e5f req-a1413f02-94e1-497e-8538-efb8276aff08 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:24:17 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-4918d90a-24b7-43c3-8811-3e1ebe4d5e5f req-a1413f02-94e1-497e-8538-efb8276aff08 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:24:17 user devstack@n-api.service[72089]: INFO nova.api.openstack.compute.server_external_events [req-4918d90a-24b7-43c3-8811-3e1ebe4d5e5f req-a1413f02-94e1-497e-8538-efb8276aff08 service nova] Creating event network-vif-unplugged:5dea909b-eaed-4978-b239-4177f6cbdfdc for instance 8e449d09-f632-4f57-b304-430734096596 on user Apr 11 19:24:17 user devstack@n-api.service[72089]: INFO nova.api.openstack.compute.server_external_events [req-4918d90a-24b7-43c3-8811-3e1ebe4d5e5f req-a1413f02-94e1-497e-8538-efb8276aff08 service nova] Creating event network-vif-plugged:5dea909b-eaed-4978-b239-4177f6cbdfdc for instance 8e449d09-f632-4f57-b304-430734096596 on user Apr 11 19:24:17 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [req-4918d90a-24b7-43c3-8811-3e1ebe4d5e5f req-a1413f02-94e1-497e-8538-efb8276aff08 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.034451 Apr 11 19:24:17 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 75/207] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:24:17 2023] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:24:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [req-ab3ed9db-acb8-4f21-9455-a90b74d19102 req-52dfd333-9147-4dcd-aa33-24ce280f2529 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e449d09-f632-4f57-b304-430734096596", "name": "network-vif-deleted", "tag": "5dea909b-eaed-4978-b239-4177f6cbdfdc"}]} {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:24:17 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-ab3ed9db-acb8-4f21-9455-a90b74d19102 req-52dfd333-9147-4dcd-aa33-24ce280f2529 service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:24:17 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-ab3ed9db-acb8-4f21-9455-a90b74d19102 req-52dfd333-9147-4dcd-aa33-24ce280f2529 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:24:17 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-ab3ed9db-acb8-4f21-9455-a90b74d19102 req-52dfd333-9147-4dcd-aa33-24ce280f2529 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:24:17 user devstack@n-api.service[72090]: INFO nova.api.openstack.compute.server_external_events [req-ab3ed9db-acb8-4f21-9455-a90b74d19102 req-52dfd333-9147-4dcd-aa33-24ce280f2529 service nova] Creating event network-vif-deleted:5dea909b-eaed-4978-b239-4177f6cbdfdc for instance 8e449d09-f632-4f57-b304-430734096596 on user Apr 11 19:24:17 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [req-ab3ed9db-acb8-4f21-9455-a90b74d19102 req-52dfd333-9147-4dcd-aa33-24ce280f2529 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032987 Apr 11 19:24:17 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 66/208] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:24:17 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:24:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [None req-12ba9f16-996b-41c2-a6b0-6ca1cd373424 tempest-VolumesAdminNegativeTest-731043923 tempest-VolumesAdminNegativeTest-731043923-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "2acb97ee-7d1f-4349-8952-7c1da5c292c8"}} {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:24:17 user devstack@n-api.service[72088]: DEBUG nova.compute.api [None req-12ba9f16-996b-41c2-a6b0-6ca1cd373424 tempest-VolumesAdminNegativeTest-731043923 tempest-VolumesAdminNegativeTest-731043923-project-admin] [instance: 9941d033-15c2-4069-b9a6-f80840e95a38] Fetching instance by UUID {{(pid=72088) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:24:17 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-12ba9f16-996b-41c2-a6b0-6ca1cd373424 tempest-VolumesAdminNegativeTest-731043923 tempest-VolumesAdminNegativeTest-731043923-project-admin] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:24:17 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-12ba9f16-996b-41c2-a6b0-6ca1cd373424 tempest-VolumesAdminNegativeTest-731043923 tempest-VolumesAdminNegativeTest-731043923-project-admin] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:24:17 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-12ba9f16-996b-41c2-a6b0-6ca1cd373424 tempest-VolumesAdminNegativeTest-731043923 tempest-VolumesAdminNegativeTest-731043923-project-admin] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:24:17 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-12ba9f16-996b-41c2-a6b0-6ca1cd373424 tempest-VolumesAdminNegativeTest-731043923 tempest-VolumesAdminNegativeTest-731043923-project-admin] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:24:17 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-12ba9f16-996b-41c2-a6b0-6ca1cd373424 tempest-VolumesAdminNegativeTest-731043923 tempest-VolumesAdminNegativeTest-731043923-project-admin] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:24:17 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-12ba9f16-996b-41c2-a6b0-6ca1cd373424 tempest-VolumesAdminNegativeTest-731043923 tempest-VolumesAdminNegativeTest-731043923-project-admin] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:24:18 user devstack@n-api.service[72088]: INFO nova.api.openstack.wsgi [None req-12ba9f16-996b-41c2-a6b0-6ca1cd373424 tempest-VolumesAdminNegativeTest-731043923 tempest-VolumesAdminNegativeTest-731043923-project-admin] HTTP exception thrown: Volume 2acb97ee-7d1f-4349-8952-7c1da5c292c8 could not be found. Apr 11 19:24:18 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [None req-12ba9f16-996b-41c2-a6b0-6ca1cd373424 tempest-VolumesAdminNegativeTest-731043923 tempest-VolumesAdminNegativeTest-731043923-project-admin] Request method failure captured: Apr 11 19:24:18 user devstack@n-api.service[72088]: request: PUT /compute/v2.1/servers/9941d033-15c2-4069-b9a6-f80840e95a38/os-volume_attachments/447d1208-42c3-46ec-b882-104ae99ab8fe HTTP/1.1 Apr 11 19:24:18 user devstack@n-api.service[72088]: Accept: application/json Apr 11 19:24:18 user devstack@n-api.service[72088]: Accept-Encoding: identity Apr 11 19:24:18 user devstack@n-api.service[72088]: Connection: close Apr 11 19:24:18 user devstack@n-api.service[72088]: Content-Length: 74 Apr 11 19:24:18 user devstack@n-api.service[72088]: Content-Type: application/json Apr 11 19:24:18 user devstack@n-api.service[72088]: Host: 10.0.0.210 Apr 11 19:24:18 user devstack@n-api.service[72088]: Openstack-System-Scope: None Apr 11 19:24:18 user devstack@n-api.service[72088]: User-Agent: python-urllib3/1.26.15 Apr 11 19:24:18 user devstack@n-api.service[72088]: X-Auth-Token: gAAAAABkNbNjhstSp3gMaMntNK884ejhXS8F3SWSNiLKAkgVuBEPd6JpGPmj4s4SN1uLXS8B-HaS8_St3V3Vu6G6bqT2DHCxuNGGV_HW_-_cqNaZ7PMWZ9_aLmRi5HMLEp08IEObZ76AdvhBwWj_nO0PECB1TrrDojYETLTSAYmZal58u_AVZ5Y Apr 11 19:24:18 user devstack@n-api.service[72088]: X-Domain-Id: None Apr 11 19:24:18 user devstack@n-api.service[72088]: X-Domain-Name: None Apr 11 19:24:18 user devstack@n-api.service[72088]: X-Identity-Status: Confirmed Apr 11 19:24:18 user devstack@n-api.service[72088]: X-Is-Admin-Project: True Apr 11 19:24:18 user devstack@n-api.service[72088]: X-Project-Domain-Id: default Apr 11 19:24:18 user devstack@n-api.service[72088]: X-Project-Domain-Name: Default Apr 11 19:24:18 user devstack@n-api.service[72088]: X-Project-Id: 861da46acc9948bc87b3f81a520975dd Apr 11 19:24:18 user devstack@n-api.service[72088]: X-Project-Name: tempest-VolumesAdminNegativeTest-731043923 Apr 11 19:24:18 user devstack@n-api.service[72088]: X-Role: reader,admin,member Apr 11 19:24:18 user devstack@n-api.service[72088]: X-Roles: reader,admin,member Apr 11 19:24:18 user devstack@n-api.service[72088]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/861da46acc9948bc87b3f81a520975dd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/861da46acc9948bc87b3f81a520975dd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/861da46acc9948bc87b3f81a520975dd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 11 19:24:18 user devstack@n-api.service[72088]: X-Tenant: tempest-VolumesAdminNegativeTest-731043923 Apr 11 19:24:18 user devstack@n-api.service[72088]: X-Tenant-Id: 861da46acc9948bc87b3f81a520975dd Apr 11 19:24:18 user devstack@n-api.service[72088]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-731043923 Apr 11 19:24:18 user devstack@n-api.service[72088]: X-User: tempest-VolumesAdminNegativeTest-731043923-project-admin Apr 11 19:24:18 user devstack@n-api.service[72088]: X-User-Domain-Id: default Apr 11 19:24:18 user devstack@n-api.service[72088]: X-User-Domain-Name: Default Apr 11 19:24:18 user devstack@n-api.service[72088]: X-User-Id: 514a4ce680104cc8bff11add7c74f8cd Apr 11 19:24:18 user devstack@n-api.service[72088]: X-User-Name: tempest-VolumesAdminNegativeTest-731043923-project-admin Apr 11 19:24:18 user devstack@n-api.service[72088]: Apr 11 19:24:18 user devstack@n-api.service[72088]: {"volumeAttachment": {"volumeId": "2acb97ee-7d1f-4349-8952-7c1da5c292c8"}} Apr 11 19:24:18 user devstack@n-api.service[72088]: method: > Apr 11 19:24:18 user devstack@n-api.service[72088]: exception: Volume 2acb97ee-7d1f-4349-8952-7c1da5c292c8 could not be found. Apr 11 19:24:18 user devstack@n-api.service[72088]: action_args: {'server_id': '9941d033-15c2-4069-b9a6-f80840e95a38', 'id': '447d1208-42c3-46ec-b882-104ae99ab8fe', 'body': {'volumeAttachment': {'volumeId': '2acb97ee-7d1f-4349-8952-7c1da5c292c8'}}} Apr 11 19:24:18 user devstack@n-api.service[72088]: {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 19:24:18 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:24:18 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 11 19:24:18 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 11 19:24:18 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 11 19:24:18 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 11 19:24:18 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 11 19:24:18 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 11 19:24:18 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 11 19:24:18 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 11 19:24:18 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 11 19:24:18 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 11 19:24:18 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 11 19:24:18 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 11 19:24:18 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 11 19:24:18 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 11 19:24:18 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 2acb97ee-7d1f-4349-8952-7c1da5c292c8 could not be found. (HTTP 404) (Request-ID: req-74b27c0f-a2cc-4aa4-b586-980edebfce72) Apr 11 19:24:18 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi Apr 11 19:24:18 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 19:24:18 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi Apr 11 19:24:18 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:24:18 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 436, in _update_volume_swap Apr 11 19:24:18 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi new_volume = self.volume_api.get(context, new_volume_id) Apr 11 19:24:18 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 11 19:24:18 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 11 19:24:18 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 11 19:24:18 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 11 19:24:18 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 11 19:24:18 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 11 19:24:18 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 11 19:24:18 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 11 19:24:18 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 11 19:24:18 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 11 19:24:18 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 11 19:24:18 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 11 19:24:18 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 11 19:24:18 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 11 19:24:18 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 11 19:24:18 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 11 19:24:18 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 11 19:24:18 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 11 19:24:18 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 11 19:24:18 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 11 19:24:18 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 2acb97ee-7d1f-4349-8952-7c1da5c292c8 could not be found. Apr 11 19:24:18 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi Apr 11 19:24:18 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 19:24:18 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi Apr 11 19:24:18 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:24:18 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 19:24:18 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 19:24:18 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 19:24:18 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 19:24:18 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 19:24:18 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 19:24:18 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 11 19:24:18 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 11 19:24:18 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 11 19:24:18 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 11 19:24:18 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Apr 11 19:24:18 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Apr 11 19:24:18 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 445, in _update_volume_swap Apr 11 19:24:18 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Apr 11 19:24:18 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Volume 2acb97ee-7d1f-4349-8952-7c1da5c292c8 could not be found. Apr 11 19:24:18 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi Apr 11 19:24:18 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 19:24:18 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi Apr 11 19:24:18 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:24:18 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 19:24:18 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 19:24:18 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 19:24:18 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 19:24:18 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 2acb97ee-7d1f-4349-8952-7c1da5c292c8 could not be found. Apr 11 19:24:18 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi Apr 11 19:24:18 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [None req-12ba9f16-996b-41c2-a6b0-6ca1cd373424 tempest-VolumesAdminNegativeTest-731043923 tempest-VolumesAdminNegativeTest-731043923-project-admin] Returning 400 to user: Volume 2acb97ee-7d1f-4349-8952-7c1da5c292c8 could not be found. {{(pid=72088) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 19:24:18 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [None req-12ba9f16-996b-41c2-a6b0-6ca1cd373424 tempest-VolumesAdminNegativeTest-731043923 tempest-VolumesAdminNegativeTest-731043923-project-admin] 10.0.0.210 "PUT /compute/v2.1/servers/9941d033-15c2-4069-b9a6-f80840e95a38/os-volume_attachments/447d1208-42c3-46ec-b882-104ae99ab8fe" status: 400 len: 107 microversion: 2.1 time: 0.324534 Apr 11 19:24:18 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 68/209] 10.0.0.210 () {64 vars in 1510 bytes} [Tue Apr 11 19:24:17 2023] PUT /compute/v2.1/servers/9941d033-15c2-4069-b9a6-f80840e95a38/os-volume_attachments/447d1208-42c3-46ec-b882-104ae99ab8fe => generated 107 bytes in 326 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 11 19:24:18 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [None req-2af3465b-26cc-42a9-809e-f9861de007c0 tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] Calling method '>' {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:24:18 user devstack@n-api.service[72089]: DEBUG nova.compute.api [None req-2af3465b-26cc-42a9-809e-f9861de007c0 tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] [instance: 9941d033-15c2-4069-b9a6-f80840e95a38] Fetching instance by UUID {{(pid=72089) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:24:18 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-2af3465b-26cc-42a9-809e-f9861de007c0 tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:24:18 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-2af3465b-26cc-42a9-809e-f9861de007c0 tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:24:18 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-2af3465b-26cc-42a9-809e-f9861de007c0 tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:24:18 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-2af3465b-26cc-42a9-809e-f9861de007c0 tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:24:18 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-2af3465b-26cc-42a9-809e-f9861de007c0 tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:24:18 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-2af3465b-26cc-42a9-809e-f9861de007c0 tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:24:18 user devstack@n-api.service[72089]: DEBUG nova.objects.instance [None req-2af3465b-26cc-42a9-809e-f9861de007c0 tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] Lazy-loading 'services' on Instance uuid 9941d033-15c2-4069-b9a6-f80840e95a38 {{(pid=72089) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 11 19:24:18 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [None req-2af3465b-26cc-42a9-809e-f9861de007c0 tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/9941d033-15c2-4069-b9a6-f80840e95a38/os-volume_attachments/447d1208-42c3-46ec-b882-104ae99ab8fe" status: 202 len: 0 microversion: 2.1 time: 0.264948 Apr 11 19:24:18 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 76/210] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Apr 11 19:24:18 2023] DELETE /compute/v2.1/servers/9941d033-15c2-4069-b9a6-f80840e95a38/os-volume_attachments/447d1208-42c3-46ec-b882-104ae99ab8fe => generated 0 bytes in 266 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 19:24:18 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [None req-4304c46f-a9ac-4e49-8fd4-b729433dfb37 tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] Calling method '>' {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:24:18 user devstack@n-api.service[72090]: DEBUG nova.compute.api [None req-4304c46f-a9ac-4e49-8fd4-b729433dfb37 tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] [instance: 9941d033-15c2-4069-b9a6-f80840e95a38] Fetching instance by UUID {{(pid=72090) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:24:18 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-4304c46f-a9ac-4e49-8fd4-b729433dfb37 tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:24:18 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-4304c46f-a9ac-4e49-8fd4-b729433dfb37 tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:24:18 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-4304c46f-a9ac-4e49-8fd4-b729433dfb37 tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:24:18 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-4304c46f-a9ac-4e49-8fd4-b729433dfb37 tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:24:18 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-4304c46f-a9ac-4e49-8fd4-b729433dfb37 tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:24:18 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-4304c46f-a9ac-4e49-8fd4-b729433dfb37 tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:24:18 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [None req-4304c46f-a9ac-4e49-8fd4-b729433dfb37 tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9941d033-15c2-4069-b9a6-f80840e95a38/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041392 Apr 11 19:24:18 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 67/211] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Apr 11 19:24:18 2023] GET /compute/v2.1/servers/9941d033-15c2-4069-b9a6-f80840e95a38/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:24:18 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [None req-375f557b-3947-4e38-a91b-35f5661fe704 tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] Calling method '>' {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:24:18 user devstack@n-api.service[72088]: DEBUG nova.compute.api [None req-375f557b-3947-4e38-a91b-35f5661fe704 tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] [instance: e84ad0e4-a65b-404c-adbf-c49d5f0b3cca] Fetching instance by UUID {{(pid=72088) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:24:18 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-375f557b-3947-4e38-a91b-35f5661fe704 tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:24:18 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-375f557b-3947-4e38-a91b-35f5661fe704 tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:24:18 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-375f557b-3947-4e38-a91b-35f5661fe704 tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:24:18 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-375f557b-3947-4e38-a91b-35f5661fe704 tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:24:18 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-375f557b-3947-4e38-a91b-35f5661fe704 tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:24:18 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-375f557b-3947-4e38-a91b-35f5661fe704 tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:24:18 user devstack@n-api.service[72088]: DEBUG nova.policy [None req-375f557b-3947-4e38-a91b-35f5661fe704 tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f44dfa2528b4540a81f4eb7c3f3f2f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5d7769df1e4974b295cb30407151dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72088) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:24:18 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [None req-375f557b-3947-4e38-a91b-35f5661fe704 tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e84ad0e4-a65b-404c-adbf-c49d5f0b3cca" status: 200 len: 1493 microversion: 2.1 time: 0.158592 Apr 11 19:24:18 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 69/212] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 19:24:18 2023] GET /compute/v2.1/servers/e84ad0e4-a65b-404c-adbf-c49d5f0b3cca => generated 1493 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:24:18 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [None req-cb704516-b2b0-4ed6-b783-06f5a4a25120 tempest-TestVolumeSwap-371271722 tempest-TestVolumeSwap-371271722-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "666f5f51-f96b-47f7-9acf-7d0b1c27ecd0"}} {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:24:18 user devstack@n-api.service[72089]: DEBUG nova.compute.api [None req-cb704516-b2b0-4ed6-b783-06f5a4a25120 tempest-TestVolumeSwap-371271722 tempest-TestVolumeSwap-371271722-project-admin] [instance: a49d379e-3976-4d68-b6df-f572a922107c] Fetching instance by UUID {{(pid=72089) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:24:18 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-cb704516-b2b0-4ed6-b783-06f5a4a25120 tempest-TestVolumeSwap-371271722 tempest-TestVolumeSwap-371271722-project-admin] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:24:18 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-cb704516-b2b0-4ed6-b783-06f5a4a25120 tempest-TestVolumeSwap-371271722 tempest-TestVolumeSwap-371271722-project-admin] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:24:18 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-cb704516-b2b0-4ed6-b783-06f5a4a25120 tempest-TestVolumeSwap-371271722 tempest-TestVolumeSwap-371271722-project-admin] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:24:18 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-cb704516-b2b0-4ed6-b783-06f5a4a25120 tempest-TestVolumeSwap-371271722 tempest-TestVolumeSwap-371271722-project-admin] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:24:18 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-cb704516-b2b0-4ed6-b783-06f5a4a25120 tempest-TestVolumeSwap-371271722 tempest-TestVolumeSwap-371271722-project-admin] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:24:18 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-cb704516-b2b0-4ed6-b783-06f5a4a25120 tempest-TestVolumeSwap-371271722 tempest-TestVolumeSwap-371271722-project-admin] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:24:19 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [None req-cb704516-b2b0-4ed6-b783-06f5a4a25120 tempest-TestVolumeSwap-371271722 tempest-TestVolumeSwap-371271722-project-admin] 10.0.0.210 "PUT /compute/v2.1/servers/a49d379e-3976-4d68-b6df-f572a922107c/os-volume_attachments/51e97579-56cc-414f-9a25-3a7c7d045694" status: 202 len: 0 microversion: 2.1 time: 0.420686 Apr 11 19:24:19 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 77/213] 10.0.0.210 () {64 vars in 1510 bytes} [Tue Apr 11 19:24:18 2023] PUT /compute/v2.1/servers/a49d379e-3976-4d68-b6df-f572a922107c/os-volume_attachments/51e97579-56cc-414f-9a25-3a7c7d045694 => generated 0 bytes in 423 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 19:24:21 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [None req-8fa6c67a-8e3f-43f2-b09b-74683bd7454a tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] Calling method '>' {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:24:21 user devstack@n-api.service[72090]: DEBUG nova.compute.api [None req-8fa6c67a-8e3f-43f2-b09b-74683bd7454a tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] [instance: 1ded3918-3bae-465c-a53c-e88011914c50] Fetching instance by UUID {{(pid=72090) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:24:21 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-8fa6c67a-8e3f-43f2-b09b-74683bd7454a tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:24:21 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-8fa6c67a-8e3f-43f2-b09b-74683bd7454a tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:24:21 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-8fa6c67a-8e3f-43f2-b09b-74683bd7454a tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:24:21 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-8fa6c67a-8e3f-43f2-b09b-74683bd7454a tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:24:21 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-8fa6c67a-8e3f-43f2-b09b-74683bd7454a tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:24:21 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-8fa6c67a-8e3f-43f2-b09b-74683bd7454a tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:24:21 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [None req-8fa6c67a-8e3f-43f2-b09b-74683bd7454a tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1ded3918-3bae-465c-a53c-e88011914c50/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042176 Apr 11 19:24:21 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 68/214] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Apr 11 19:24:21 2023] GET /compute/v2.1/servers/1ded3918-3bae-465c-a53c-e88011914c50/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:24:21 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [None req-53f529bd-1760-49fe-8339-7859e72b5a31 tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] Calling method '>' {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:24:21 user devstack@n-api.service[72088]: DEBUG nova.compute.api [None req-53f529bd-1760-49fe-8339-7859e72b5a31 tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] [instance: 1ded3918-3bae-465c-a53c-e88011914c50] Fetching instance by UUID {{(pid=72088) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:24:21 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-53f529bd-1760-49fe-8339-7859e72b5a31 tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:24:21 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-53f529bd-1760-49fe-8339-7859e72b5a31 tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:24:21 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-53f529bd-1760-49fe-8339-7859e72b5a31 tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:24:21 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-53f529bd-1760-49fe-8339-7859e72b5a31 tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:24:21 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-53f529bd-1760-49fe-8339-7859e72b5a31 tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:24:21 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-53f529bd-1760-49fe-8339-7859e72b5a31 tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:24:21 user devstack@n-api.service[72088]: DEBUG nova.objects.instance [None req-53f529bd-1760-49fe-8339-7859e72b5a31 tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] Lazy-loading 'services' on Instance uuid 1ded3918-3bae-465c-a53c-e88011914c50 {{(pid=72088) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 11 19:24:21 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [req-50ab0b1d-8ad5-4f1f-9e26-edcc338d4076 req-45646116-abeb-4c11-af76-543c17ff0b09 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dde6b4d2-9288-474c-b400-ce3b6f393b24", "name": "network-vif-deleted", "tag": "7e8c8382-c878-4ac7-b626-01cf2bc2f349"}]} {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:24:21 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-50ab0b1d-8ad5-4f1f-9e26-edcc338d4076 req-45646116-abeb-4c11-af76-543c17ff0b09 service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:24:21 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-50ab0b1d-8ad5-4f1f-9e26-edcc338d4076 req-45646116-abeb-4c11-af76-543c17ff0b09 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:24:21 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-50ab0b1d-8ad5-4f1f-9e26-edcc338d4076 req-45646116-abeb-4c11-af76-543c17ff0b09 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:24:21 user devstack@n-api.service[72089]: INFO nova.api.openstack.compute.server_external_events [req-50ab0b1d-8ad5-4f1f-9e26-edcc338d4076 req-45646116-abeb-4c11-af76-543c17ff0b09 service nova] Creating event network-vif-deleted:7e8c8382-c878-4ac7-b626-01cf2bc2f349 for instance dde6b4d2-9288-474c-b400-ce3b6f393b24 on user Apr 11 19:24:21 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [req-50ab0b1d-8ad5-4f1f-9e26-edcc338d4076 req-45646116-abeb-4c11-af76-543c17ff0b09 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042398 Apr 11 19:24:21 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 78/215] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:24:21 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:24:21 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [None req-53f529bd-1760-49fe-8339-7859e72b5a31 tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/1ded3918-3bae-465c-a53c-e88011914c50/os-volume_attachments/d7bac8da-a912-4a54-b7d8-a012f3ff9c79" status: 202 len: 0 microversion: 2.1 time: 0.278677 Apr 11 19:24:21 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 70/216] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Apr 11 19:24:21 2023] DELETE /compute/v2.1/servers/1ded3918-3bae-465c-a53c-e88011914c50/os-volume_attachments/d7bac8da-a912-4a54-b7d8-a012f3ff9c79 => generated 0 bytes in 280 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 19:24:23 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [req-bb7ef298-02c3-44a2-9607-c7314c35b650 req-26f6b36f-94ef-41fc-ad46-ab5018501a7c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dde6b4d2-9288-474c-b400-ce3b6f393b24", "name": "network-vif-deleted", "tag": "66cd1e83-c736-444c-84c7-ecfc2c2b3802"}, {"server_uuid": "dde6b4d2-9288-474c-b400-ce3b6f393b24", "name": "network-vif-deleted", "tag": "576d5a47-cb3a-4794-bc1e-dcbb82e25352"}]} {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:24:23 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-bb7ef298-02c3-44a2-9607-c7314c35b650 req-26f6b36f-94ef-41fc-ad46-ab5018501a7c service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:24:23 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-bb7ef298-02c3-44a2-9607-c7314c35b650 req-26f6b36f-94ef-41fc-ad46-ab5018501a7c service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:24:23 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-bb7ef298-02c3-44a2-9607-c7314c35b650 req-26f6b36f-94ef-41fc-ad46-ab5018501a7c service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:24:23 user devstack@n-api.service[72090]: INFO nova.api.openstack.compute.server_external_events [req-bb7ef298-02c3-44a2-9607-c7314c35b650 req-26f6b36f-94ef-41fc-ad46-ab5018501a7c service nova] Creating event network-vif-deleted:66cd1e83-c736-444c-84c7-ecfc2c2b3802 for instance dde6b4d2-9288-474c-b400-ce3b6f393b24 on user Apr 11 19:24:23 user devstack@n-api.service[72090]: INFO nova.api.openstack.compute.server_external_events [req-bb7ef298-02c3-44a2-9607-c7314c35b650 req-26f6b36f-94ef-41fc-ad46-ab5018501a7c service nova] Creating event network-vif-deleted:576d5a47-cb3a-4794-bc1e-dcbb82e25352 for instance dde6b4d2-9288-474c-b400-ce3b6f393b24 on user Apr 11 19:24:23 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [req-bb7ef298-02c3-44a2-9607-c7314c35b650 req-26f6b36f-94ef-41fc-ad46-ab5018501a7c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.049942 Apr 11 19:24:23 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 69/217] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:24:23 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:24:23 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [None req-ebb8c39f-5900-4086-bac9-a4149cabcc87 tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] Calling method '>' {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:24:23 user devstack@n-api.service[72089]: DEBUG nova.compute.api [None req-ebb8c39f-5900-4086-bac9-a4149cabcc87 tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] [instance: 1ded3918-3bae-465c-a53c-e88011914c50] Fetching instance by UUID {{(pid=72089) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:24:23 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-ebb8c39f-5900-4086-bac9-a4149cabcc87 tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:24:23 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-ebb8c39f-5900-4086-bac9-a4149cabcc87 tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:24:23 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-ebb8c39f-5900-4086-bac9-a4149cabcc87 tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:24:23 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-ebb8c39f-5900-4086-bac9-a4149cabcc87 tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:24:23 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-ebb8c39f-5900-4086-bac9-a4149cabcc87 tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:24:23 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-ebb8c39f-5900-4086-bac9-a4149cabcc87 tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:24:23 user devstack@n-api.service[72089]: DEBUG dbcounter [-] [72089] Writing DB stats nova_cell1:SELECT=86,nova_cell1:UPDATE=8,nova_cell1:INSERT=6 {{(pid=72089) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:24:23 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [None req-ebb8c39f-5900-4086-bac9-a4149cabcc87 tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1ded3918-3bae-465c-a53c-e88011914c50/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.097219 Apr 11 19:24:23 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 79/218] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Apr 11 19:24:23 2023] GET /compute/v2.1/servers/1ded3918-3bae-465c-a53c-e88011914c50/os-volume_attachments => generated 25 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 11 19:24:23 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [None req-a3d298fe-4f29-4a96-b8db-40025d97c3d6 tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] Calling method '>' {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:24:23 user devstack@n-api.service[72088]: DEBUG nova.compute.api [None req-a3d298fe-4f29-4a96-b8db-40025d97c3d6 tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] [instance: 1ded3918-3bae-465c-a53c-e88011914c50] Fetching instance by UUID {{(pid=72088) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:24:23 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-a3d298fe-4f29-4a96-b8db-40025d97c3d6 tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:24:23 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-a3d298fe-4f29-4a96-b8db-40025d97c3d6 tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:24:23 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-a3d298fe-4f29-4a96-b8db-40025d97c3d6 tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:24:23 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-a3d298fe-4f29-4a96-b8db-40025d97c3d6 tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:24:23 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-a3d298fe-4f29-4a96-b8db-40025d97c3d6 tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:24:23 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-a3d298fe-4f29-4a96-b8db-40025d97c3d6 tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:24:23 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [None req-a3d298fe-4f29-4a96-b8db-40025d97c3d6 tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1ded3918-3bae-465c-a53c-e88011914c50/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.086155 Apr 11 19:24:23 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 71/219] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Apr 11 19:24:23 2023] GET /compute/v2.1/servers/1ded3918-3bae-465c-a53c-e88011914c50/os-volume_attachments => generated 25 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 11 19:24:23 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [None req-03023ab6-aa8d-429c-b95e-3b6d1d11e8d1 tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] Calling method '>' {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:24:23 user devstack@n-api.service[72090]: DEBUG nova.compute.api [None req-03023ab6-aa8d-429c-b95e-3b6d1d11e8d1 tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] [instance: 1ded3918-3bae-465c-a53c-e88011914c50] Fetching instance by UUID {{(pid=72090) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:24:23 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-03023ab6-aa8d-429c-b95e-3b6d1d11e8d1 tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:24:23 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-03023ab6-aa8d-429c-b95e-3b6d1d11e8d1 tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:24:23 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-03023ab6-aa8d-429c-b95e-3b6d1d11e8d1 tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:24:23 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-03023ab6-aa8d-429c-b95e-3b6d1d11e8d1 tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:24:23 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-03023ab6-aa8d-429c-b95e-3b6d1d11e8d1 tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:24:23 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-03023ab6-aa8d-429c-b95e-3b6d1d11e8d1 tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:24:23 user devstack@n-api.service[72090]: DEBUG nova.compute.api [None req-03023ab6-aa8d-429c-b95e-3b6d1d11e8d1 tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] [instance: 1ded3918-3bae-465c-a53c-e88011914c50] Going to try to terminate instance {{(pid=72090) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 11 19:24:24 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [None req-c63b9770-3b71-43d9-9593-7ad4a492c7ff tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] Calling method '>' {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:24:24 user devstack@n-api.service[72089]: DEBUG nova.compute.api [None req-c63b9770-3b71-43d9-9593-7ad4a492c7ff tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] [instance: b71d95ed-728d-4386-b7c6-50b252718ca9] Fetching instance by UUID {{(pid=72089) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:24:24 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [None req-03023ab6-aa8d-429c-b95e-3b6d1d11e8d1 tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/1ded3918-3bae-465c-a53c-e88011914c50" status: 204 len: 0 microversion: 2.1 time: 0.180134 Apr 11 19:24:24 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-c63b9770-3b71-43d9-9593-7ad4a492c7ff tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:24:24 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-c63b9770-3b71-43d9-9593-7ad4a492c7ff tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:24:24 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-c63b9770-3b71-43d9-9593-7ad4a492c7ff tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:24:24 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 70/220] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 19:24:23 2023] DELETE /compute/v2.1/servers/1ded3918-3bae-465c-a53c-e88011914c50 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 11 19:24:24 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-c63b9770-3b71-43d9-9593-7ad4a492c7ff tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:24:24 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-c63b9770-3b71-43d9-9593-7ad4a492c7ff tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:24:24 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-c63b9770-3b71-43d9-9593-7ad4a492c7ff tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:24:24 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [None req-6fcc4580-f671-4a5c-a175-18600714ac03 tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] Calling method '>' {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:24:24 user devstack@n-api.service[72088]: DEBUG nova.compute.api [None req-6fcc4580-f671-4a5c-a175-18600714ac03 tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] [instance: 1ded3918-3bae-465c-a53c-e88011914c50] Fetching instance by UUID {{(pid=72088) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:24:24 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-6fcc4580-f671-4a5c-a175-18600714ac03 tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:24:24 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-6fcc4580-f671-4a5c-a175-18600714ac03 tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:24:24 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-6fcc4580-f671-4a5c-a175-18600714ac03 tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:24:24 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-6fcc4580-f671-4a5c-a175-18600714ac03 tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:24:24 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-6fcc4580-f671-4a5c-a175-18600714ac03 tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:24:24 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-6fcc4580-f671-4a5c-a175-18600714ac03 tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:24:24 user devstack@n-api.service[72088]: DEBUG dbcounter [-] [72088] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=72088) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:24:24 user devstack@n-api.service[72089]: DEBUG nova.objects.instance [None req-c63b9770-3b71-43d9-9593-7ad4a492c7ff tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] Lazy-loading 'services' on Instance uuid b71d95ed-728d-4386-b7c6-50b252718ca9 {{(pid=72089) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 11 19:24:24 user devstack@n-api.service[72088]: DEBUG nova.policy [None req-6fcc4580-f671-4a5c-a175-18600714ac03 tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26555f273c374f9ba0ed151d2f1cbaef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4c6f64ecc104480a149bcfd0610dfef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72088) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:24:24 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [None req-6fcc4580-f671-4a5c-a175-18600714ac03 tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1ded3918-3bae-465c-a53c-e88011914c50" status: 200 len: 1674 microversion: 2.1 time: 0.244813 Apr 11 19:24:24 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 72/221] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 19:24:24 2023] GET /compute/v2.1/servers/1ded3918-3bae-465c-a53c-e88011914c50 => generated 1674 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 19:24:24 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [None req-c63b9770-3b71-43d9-9593-7ad4a492c7ff tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/b71d95ed-728d-4386-b7c6-50b252718ca9/os-volume_attachments/65685406-4266-4909-9989-927850da7d53" status: 202 len: 0 microversion: 2.49 time: 0.902712 Apr 11 19:24:24 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 80/222] 10.0.0.210 () {64 vars in 1534 bytes} [Tue Apr 11 19:24:24 2023] DELETE /compute/v2.1/servers/b71d95ed-728d-4386-b7c6-50b252718ca9/os-volume_attachments/65685406-4266-4909-9989-927850da7d53 => generated 0 bytes in 905 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 11 19:24:25 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [req-320729a9-d58b-4085-bef1-541ade6b0cb7 req-e7163b38-f93e-4a2c-818d-8bb56d16e967 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dde6b4d2-9288-474c-b400-ce3b6f393b24", "name": "network-vif-deleted", "tag": "aeb74c01-d96e-4838-8d2c-c2499e3f8770"}, {"server_uuid": "dde6b4d2-9288-474c-b400-ce3b6f393b24", "name": "network-vif-deleted", "tag": "db299c0f-eae0-45ae-ba9c-037c50e06a3c"}, {"server_uuid": "1ded3918-3bae-465c-a53c-e88011914c50", "name": "network-vif-unplugged", "status": "completed", "tag": "8f590426-373c-4a90-8829-a2ad1a61fcd7"}, {"server_uuid": "1ded3918-3bae-465c-a53c-e88011914c50", "name": "network-vif-plugged", "status": "completed", "tag": "8f590426-373c-4a90-8829-a2ad1a61fcd7"}]} {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:24:25 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-320729a9-d58b-4085-bef1-541ade6b0cb7 req-e7163b38-f93e-4a2c-818d-8bb56d16e967 service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:24:25 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-320729a9-d58b-4085-bef1-541ade6b0cb7 req-e7163b38-f93e-4a2c-818d-8bb56d16e967 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:24:25 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-320729a9-d58b-4085-bef1-541ade6b0cb7 req-e7163b38-f93e-4a2c-818d-8bb56d16e967 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:24:25 user devstack@n-api.service[72090]: INFO nova.api.openstack.compute.server_external_events [req-320729a9-d58b-4085-bef1-541ade6b0cb7 req-e7163b38-f93e-4a2c-818d-8bb56d16e967 service nova] Creating event network-vif-deleted:aeb74c01-d96e-4838-8d2c-c2499e3f8770 for instance dde6b4d2-9288-474c-b400-ce3b6f393b24 on user Apr 11 19:24:25 user devstack@n-api.service[72090]: INFO nova.api.openstack.compute.server_external_events [req-320729a9-d58b-4085-bef1-541ade6b0cb7 req-e7163b38-f93e-4a2c-818d-8bb56d16e967 service nova] Creating event network-vif-deleted:db299c0f-eae0-45ae-ba9c-037c50e06a3c for instance dde6b4d2-9288-474c-b400-ce3b6f393b24 on user Apr 11 19:24:25 user devstack@n-api.service[72090]: INFO nova.api.openstack.compute.server_external_events [req-320729a9-d58b-4085-bef1-541ade6b0cb7 req-e7163b38-f93e-4a2c-818d-8bb56d16e967 service nova] Creating event network-vif-unplugged:8f590426-373c-4a90-8829-a2ad1a61fcd7 for instance 1ded3918-3bae-465c-a53c-e88011914c50 on user Apr 11 19:24:25 user devstack@n-api.service[72090]: INFO nova.api.openstack.compute.server_external_events [req-320729a9-d58b-4085-bef1-541ade6b0cb7 req-e7163b38-f93e-4a2c-818d-8bb56d16e967 service nova] Creating event network-vif-plugged:8f590426-373c-4a90-8829-a2ad1a61fcd7 for instance 1ded3918-3bae-465c-a53c-e88011914c50 on user Apr 11 19:24:25 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [req-320729a9-d58b-4085-bef1-541ade6b0cb7 req-e7163b38-f93e-4a2c-818d-8bb56d16e967 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 698 microversion: 2.1 time: 0.050715 Apr 11 19:24:25 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 71/223] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:24:25 2023] POST /compute/v2.1/os-server-external-events => generated 698 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:24:25 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [None req-7388356d-0847-41ff-bdb5-3ad41b0d5aac tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] Calling method '>' {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:24:25 user devstack@n-api.service[72088]: DEBUG nova.compute.api [None req-7388356d-0847-41ff-bdb5-3ad41b0d5aac tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] [instance: 75a4ef96-a6c3-4ccd-9503-bab0d4174b2b] Fetching instance by UUID {{(pid=72088) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:24:25 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-7388356d-0847-41ff-bdb5-3ad41b0d5aac tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:24:25 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-7388356d-0847-41ff-bdb5-3ad41b0d5aac tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:24:25 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-7388356d-0847-41ff-bdb5-3ad41b0d5aac tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:24:25 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-7388356d-0847-41ff-bdb5-3ad41b0d5aac tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:24:25 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-7388356d-0847-41ff-bdb5-3ad41b0d5aac tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:24:25 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-7388356d-0847-41ff-bdb5-3ad41b0d5aac tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:24:25 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [None req-7388356d-0847-41ff-bdb5-3ad41b0d5aac tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] 10.0.0.210 "GET /compute/v2.1/servers/75a4ef96-a6c3-4ccd-9503-bab0d4174b2b/os-interface" status: 200 len: 1828 microversion: 2.32 time: 0.172903 Apr 11 19:24:25 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 73/224] 10.0.0.210 () {64 vars in 1393 bytes} [Tue Apr 11 19:24:25 2023] GET /compute/v2.1/servers/75a4ef96-a6c3-4ccd-9503-bab0d4174b2b/os-interface => generated 1828 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 19:24:26 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [None req-c60c3737-a6b4-4704-954f-a0b616ad19c1 tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] Calling method '>' {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:24:26 user devstack@n-api.service[72089]: DEBUG nova.compute.api [None req-c60c3737-a6b4-4704-954f-a0b616ad19c1 tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] [instance: 75a4ef96-a6c3-4ccd-9503-bab0d4174b2b] Fetching instance by UUID {{(pid=72089) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:24:26 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-c60c3737-a6b4-4704-954f-a0b616ad19c1 tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:24:26 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-c60c3737-a6b4-4704-954f-a0b616ad19c1 tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:24:26 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-c60c3737-a6b4-4704-954f-a0b616ad19c1 tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:24:26 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-c60c3737-a6b4-4704-954f-a0b616ad19c1 tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:24:26 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-c60c3737-a6b4-4704-954f-a0b616ad19c1 tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:24:26 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-c60c3737-a6b4-4704-954f-a0b616ad19c1 tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:24:26 user devstack@n-api.service[72089]: DEBUG nova.policy [None req-c60c3737-a6b4-4704-954f-a0b616ad19c1 tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb69b26bc5af47069cdd00b39db75375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ac81630b23345679b841ea2c3fe28f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72089) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:24:26 user devstack@n-api.service[72089]: DEBUG nova.policy [None req-c60c3737-a6b4-4704-954f-a0b616ad19c1 tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb69b26bc5af47069cdd00b39db75375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ac81630b23345679b841ea2c3fe28f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72089) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:24:26 user devstack@n-api.service[72089]: DEBUG nova.policy [None req-c60c3737-a6b4-4704-954f-a0b616ad19c1 tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb69b26bc5af47069cdd00b39db75375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ac81630b23345679b841ea2c3fe28f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72089) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:24:26 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [None req-c60c3737-a6b4-4704-954f-a0b616ad19c1 tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] 10.0.0.210 "GET /compute/v2.1/servers/75a4ef96-a6c3-4ccd-9503-bab0d4174b2b" status: 200 len: 2822 microversion: 2.32 time: 0.250894 Apr 11 19:24:26 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 81/225] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 19:24:26 2023] GET /compute/v2.1/servers/75a4ef96-a6c3-4ccd-9503-bab0d4174b2b => generated 2822 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 19:24:26 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [None req-83fc6f34-de1a-497f-912b-9156947cee18 tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] Calling method '>' {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:24:26 user devstack@n-api.service[72090]: DEBUG nova.compute.api [None req-83fc6f34-de1a-497f-912b-9156947cee18 tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] [instance: 75a4ef96-a6c3-4ccd-9503-bab0d4174b2b] Fetching instance by UUID {{(pid=72090) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:24:26 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-83fc6f34-de1a-497f-912b-9156947cee18 tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:24:26 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-83fc6f34-de1a-497f-912b-9156947cee18 tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:24:26 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-83fc6f34-de1a-497f-912b-9156947cee18 tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:24:26 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-83fc6f34-de1a-497f-912b-9156947cee18 tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:24:26 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-83fc6f34-de1a-497f-912b-9156947cee18 tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:24:26 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-83fc6f34-de1a-497f-912b-9156947cee18 tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:24:26 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [None req-83fc6f34-de1a-497f-912b-9156947cee18 tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] 10.0.0.210 "GET /compute/v2.1/servers/75a4ef96-a6c3-4ccd-9503-bab0d4174b2b/os-interface" status: 200 len: 1828 microversion: 2.32 time: 0.131827 Apr 11 19:24:26 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 72/226] 10.0.0.210 () {64 vars in 1393 bytes} [Tue Apr 11 19:24:26 2023] GET /compute/v2.1/servers/75a4ef96-a6c3-4ccd-9503-bab0d4174b2b/os-interface => generated 1828 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 19:24:27 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [req-75bba134-7408-4de5-9d12-59f3db5dbba9 req-2522676f-fde1-40a2-b0aa-476d009fef50 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ded3918-3bae-465c-a53c-e88011914c50", "name": "network-vif-deleted", "tag": "8f590426-373c-4a90-8829-a2ad1a61fcd7"}, {"name": "network-changed", "server_uuid": "75a4ef96-a6c3-4ccd-9503-bab0d4174b2b", "tag": "59314c6a-6d9a-4586-a8de-27a566e58eb4"}]} {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:24:27 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-75bba134-7408-4de5-9d12-59f3db5dbba9 req-2522676f-fde1-40a2-b0aa-476d009fef50 service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:24:27 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-75bba134-7408-4de5-9d12-59f3db5dbba9 req-2522676f-fde1-40a2-b0aa-476d009fef50 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:24:27 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-75bba134-7408-4de5-9d12-59f3db5dbba9 req-2522676f-fde1-40a2-b0aa-476d009fef50 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:24:27 user devstack@n-api.service[72088]: INFO nova.api.openstack.compute.server_external_events [req-75bba134-7408-4de5-9d12-59f3db5dbba9 req-2522676f-fde1-40a2-b0aa-476d009fef50 service nova] Creating event network-vif-deleted:8f590426-373c-4a90-8829-a2ad1a61fcd7 for instance 1ded3918-3bae-465c-a53c-e88011914c50 on user Apr 11 19:24:27 user devstack@n-api.service[72088]: INFO nova.api.openstack.compute.server_external_events [req-75bba134-7408-4de5-9d12-59f3db5dbba9 req-2522676f-fde1-40a2-b0aa-476d009fef50 service nova] Creating event network-changed:59314c6a-6d9a-4586-a8de-27a566e58eb4 for instance 75a4ef96-a6c3-4ccd-9503-bab0d4174b2b on user Apr 11 19:24:27 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [req-75bba134-7408-4de5-9d12-59f3db5dbba9 req-2522676f-fde1-40a2-b0aa-476d009fef50 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.041407 Apr 11 19:24:27 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 74/227] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:24:27 2023] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:24:27 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [None req-9c16874f-1d7e-40c9-9c45-3e8d0afe6e0e tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] Calling method '>' {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:24:27 user devstack@n-api.service[72089]: DEBUG nova.compute.api [None req-9c16874f-1d7e-40c9-9c45-3e8d0afe6e0e tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] [instance: 75a4ef96-a6c3-4ccd-9503-bab0d4174b2b] Fetching instance by UUID {{(pid=72089) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:24:27 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-9c16874f-1d7e-40c9-9c45-3e8d0afe6e0e tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:24:27 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-9c16874f-1d7e-40c9-9c45-3e8d0afe6e0e tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:24:27 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-9c16874f-1d7e-40c9-9c45-3e8d0afe6e0e tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:24:27 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-9c16874f-1d7e-40c9-9c45-3e8d0afe6e0e tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:24:27 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-9c16874f-1d7e-40c9-9c45-3e8d0afe6e0e tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:24:27 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-9c16874f-1d7e-40c9-9c45-3e8d0afe6e0e tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:24:27 user devstack@n-api.service[72089]: DEBUG nova.compute.api [None req-9c16874f-1d7e-40c9-9c45-3e8d0afe6e0e tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] [instance: 75a4ef96-a6c3-4ccd-9503-bab0d4174b2b] Going to try to terminate instance {{(pid=72089) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 11 19:24:28 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [None req-9c16874f-1d7e-40c9-9c45-3e8d0afe6e0e tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/75a4ef96-a6c3-4ccd-9503-bab0d4174b2b" status: 204 len: 0 microversion: 2.32 time: 0.129706 Apr 11 19:24:28 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 82/228] 10.0.0.210 () {64 vars in 1357 bytes} [Tue Apr 11 19:24:27 2023] DELETE /compute/v2.1/servers/75a4ef96-a6c3-4ccd-9503-bab0d4174b2b => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 11 19:24:28 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [None req-69253876-99d1-46a8-8289-1bf9e67b0be5 tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] Calling method '>' {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:24:28 user devstack@n-api.service[72090]: DEBUG nova.compute.api [None req-69253876-99d1-46a8-8289-1bf9e67b0be5 tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] [instance: 75a4ef96-a6c3-4ccd-9503-bab0d4174b2b] Fetching instance by UUID {{(pid=72090) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:24:28 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-69253876-99d1-46a8-8289-1bf9e67b0be5 tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:24:28 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-69253876-99d1-46a8-8289-1bf9e67b0be5 tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:24:28 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-69253876-99d1-46a8-8289-1bf9e67b0be5 tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:24:28 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-69253876-99d1-46a8-8289-1bf9e67b0be5 tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:24:28 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-69253876-99d1-46a8-8289-1bf9e67b0be5 tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:24:28 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-69253876-99d1-46a8-8289-1bf9e67b0be5 tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:24:28 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [None req-c887787e-a7f4-4464-a36d-b38521327164 tempest-DeleteServersTestJSON-124461992 tempest-DeleteServersTestJSON-124461992-project-member] Calling method '>' {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:24:28 user devstack@n-api.service[72088]: DEBUG nova.compute.api [None req-c887787e-a7f4-4464-a36d-b38521327164 tempest-DeleteServersTestJSON-124461992 tempest-DeleteServersTestJSON-124461992-project-member] [instance: efd7afec-d6d0-4e3f-a3b9-f672b3e711cf] Fetching instance by UUID {{(pid=72088) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:24:28 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-c887787e-a7f4-4464-a36d-b38521327164 tempest-DeleteServersTestJSON-124461992 tempest-DeleteServersTestJSON-124461992-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:24:28 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-c887787e-a7f4-4464-a36d-b38521327164 tempest-DeleteServersTestJSON-124461992 tempest-DeleteServersTestJSON-124461992-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:24:28 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-c887787e-a7f4-4464-a36d-b38521327164 tempest-DeleteServersTestJSON-124461992 tempest-DeleteServersTestJSON-124461992-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:24:28 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-c887787e-a7f4-4464-a36d-b38521327164 tempest-DeleteServersTestJSON-124461992 tempest-DeleteServersTestJSON-124461992-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:24:28 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-c887787e-a7f4-4464-a36d-b38521327164 tempest-DeleteServersTestJSON-124461992 tempest-DeleteServersTestJSON-124461992-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:24:28 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-c887787e-a7f4-4464-a36d-b38521327164 tempest-DeleteServersTestJSON-124461992 tempest-DeleteServersTestJSON-124461992-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:24:28 user devstack@n-api.service[72088]: INFO nova.api.openstack.wsgi [None req-c887787e-a7f4-4464-a36d-b38521327164 tempest-DeleteServersTestJSON-124461992 tempest-DeleteServersTestJSON-124461992-project-member] HTTP exception thrown: Instance efd7afec-d6d0-4e3f-a3b9-f672b3e711cf could not be found. Apr 11 19:24:28 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [None req-c887787e-a7f4-4464-a36d-b38521327164 tempest-DeleteServersTestJSON-124461992 tempest-DeleteServersTestJSON-124461992-project-member] Request method failure captured: Apr 11 19:24:28 user devstack@n-api.service[72088]: request: GET /compute/v2.1/servers/efd7afec-d6d0-4e3f-a3b9-f672b3e711cf HTTP/1.1 Apr 11 19:24:28 user devstack@n-api.service[72088]: Accept: application/json Apr 11 19:24:28 user devstack@n-api.service[72088]: Accept-Encoding: identity Apr 11 19:24:28 user devstack@n-api.service[72088]: Connection: close Apr 11 19:24:28 user devstack@n-api.service[72088]: Content-Length: 0 Apr 11 19:24:28 user devstack@n-api.service[72088]: Content-Type: application/json Apr 11 19:24:28 user devstack@n-api.service[72088]: Host: 10.0.0.210 Apr 11 19:24:28 user devstack@n-api.service[72088]: Openstack-System-Scope: None Apr 11 19:24:28 user devstack@n-api.service[72088]: User-Agent: python-urllib3/1.26.15 Apr 11 19:24:28 user devstack@n-api.service[72088]: X-Auth-Token: gAAAAABkNbM_Rf4O0Sh5ZvgQ_ZOPNSen9l_p9scIqx_3uP10ki6YPvVdmBmbTqDWmOzB2EvmUlqWMbdKbIUki3zvc_e7XnrsxMB8XJQlwsozYzOpaGPL8uctuEGO-iGFkEqGmZi_-oeMfavk4fYhbPgRTRmcO5kw17T_1qQa5ZqPrRUCh6QgFqE Apr 11 19:24:28 user devstack@n-api.service[72088]: X-Domain-Id: None Apr 11 19:24:28 user devstack@n-api.service[72088]: X-Domain-Name: None Apr 11 19:24:28 user devstack@n-api.service[72088]: X-Identity-Status: Confirmed Apr 11 19:24:28 user devstack@n-api.service[72088]: X-Is-Admin-Project: True Apr 11 19:24:28 user devstack@n-api.service[72088]: X-Project-Domain-Id: default Apr 11 19:24:28 user devstack@n-api.service[72088]: X-Project-Domain-Name: Default Apr 11 19:24:28 user devstack@n-api.service[72088]: X-Project-Id: 34322e02b2fc4c2c84fb77583faf4405 Apr 11 19:24:28 user devstack@n-api.service[72088]: X-Project-Name: tempest-DeleteServersTestJSON-124461992 Apr 11 19:24:28 user devstack@n-api.service[72088]: X-Role: reader,member Apr 11 19:24:28 user devstack@n-api.service[72088]: X-Roles: reader,member Apr 11 19:24:28 user devstack@n-api.service[72088]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/34322e02b2fc4c2c84fb77583faf4405"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/34322e02b2fc4c2c84fb77583faf4405"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/34322e02b2fc4c2c84fb77583faf4405"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 11 19:24:28 user devstack@n-api.service[72088]: X-Tenant: tempest-DeleteServersTestJSON-124461992 Apr 11 19:24:28 user devstack@n-api.service[72088]: X-Tenant-Id: 34322e02b2fc4c2c84fb77583faf4405 Apr 11 19:24:28 user devstack@n-api.service[72088]: X-Tenant-Name: tempest-DeleteServersTestJSON-124461992 Apr 11 19:24:28 user devstack@n-api.service[72088]: X-User: tempest-DeleteServersTestJSON-124461992-project-member Apr 11 19:24:28 user devstack@n-api.service[72088]: X-User-Domain-Id: default Apr 11 19:24:28 user devstack@n-api.service[72088]: X-User-Domain-Name: Default Apr 11 19:24:28 user devstack@n-api.service[72088]: X-User-Id: 502b859ece744cf680123cd4e9643938 Apr 11 19:24:28 user devstack@n-api.service[72088]: X-User-Name: tempest-DeleteServersTestJSON-124461992-project-member Apr 11 19:24:28 user devstack@n-api.service[72088]: method: > Apr 11 19:24:28 user devstack@n-api.service[72088]: exception: Instance efd7afec-d6d0-4e3f-a3b9-f672b3e711cf could not be found. Apr 11 19:24:28 user devstack@n-api.service[72088]: action_args: {'id': 'efd7afec-d6d0-4e3f-a3b9-f672b3e711cf'} Apr 11 19:24:28 user devstack@n-api.service[72088]: {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 19:24:28 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:24:28 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 19:24:28 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 19:24:28 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 19:24:28 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 19:24:28 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 19:24:28 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 19:24:28 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 19:24:28 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 19:24:28 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance efd7afec-d6d0-4e3f-a3b9-f672b3e711cf could not be found. Apr 11 19:24:28 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi Apr 11 19:24:28 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 19:24:28 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi Apr 11 19:24:28 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:24:28 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 19:24:28 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 19:24:28 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 19:24:28 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 19:24:28 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 19:24:28 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 19:24:28 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 19:24:28 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 19:24:28 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 19:24:28 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 19:24:28 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 19:24:28 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 19:24:28 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance efd7afec-d6d0-4e3f-a3b9-f672b3e711cf could not be found. Apr 11 19:24:28 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi Apr 11 19:24:28 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 19:24:28 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi Apr 11 19:24:28 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:24:28 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 19:24:28 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 19:24:28 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 19:24:28 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 19:24:28 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance efd7afec-d6d0-4e3f-a3b9-f672b3e711cf could not be found. Apr 11 19:24:28 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi Apr 11 19:24:28 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [None req-c887787e-a7f4-4464-a36d-b38521327164 tempest-DeleteServersTestJSON-124461992 tempest-DeleteServersTestJSON-124461992-project-member] Returning 404 to user: Instance efd7afec-d6d0-4e3f-a3b9-f672b3e711cf could not be found. {{(pid=72088) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 19:24:28 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [None req-c887787e-a7f4-4464-a36d-b38521327164 tempest-DeleteServersTestJSON-124461992 tempest-DeleteServersTestJSON-124461992-project-member] 10.0.0.210 "GET /compute/v2.1/servers/efd7afec-d6d0-4e3f-a3b9-f672b3e711cf" status: 404 len: 111 microversion: 2.1 time: 0.032864 Apr 11 19:24:28 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 75/229] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 19:24:28 2023] GET /compute/v2.1/servers/efd7afec-d6d0-4e3f-a3b9-f672b3e711cf => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 19:24:28 user devstack@n-api.service[72090]: DEBUG nova.policy [None req-69253876-99d1-46a8-8289-1bf9e67b0be5 tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb69b26bc5af47069cdd00b39db75375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ac81630b23345679b841ea2c3fe28f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72090) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:24:28 user devstack@n-api.service[72090]: DEBUG nova.policy [None req-69253876-99d1-46a8-8289-1bf9e67b0be5 tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb69b26bc5af47069cdd00b39db75375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ac81630b23345679b841ea2c3fe28f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72090) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:24:28 user devstack@n-api.service[72090]: DEBUG nova.policy [None req-69253876-99d1-46a8-8289-1bf9e67b0be5 tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb69b26bc5af47069cdd00b39db75375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ac81630b23345679b841ea2c3fe28f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72090) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:24:28 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [None req-69253876-99d1-46a8-8289-1bf9e67b0be5 tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] 10.0.0.210 "GET /compute/v2.1/servers/75a4ef96-a6c3-4ccd-9503-bab0d4174b2b" status: 200 len: 2947 microversion: 2.32 time: 0.200973 Apr 11 19:24:28 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 73/230] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 19:24:28 2023] GET /compute/v2.1/servers/75a4ef96-a6c3-4ccd-9503-bab0d4174b2b => generated 2947 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 19:24:28 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [None req-18cd3cfd-c0f1-4ba4-bd8e-830bfe3a1e28 tempest-DeleteServersTestJSON-124461992 tempest-DeleteServersTestJSON-124461992-project-member] Calling method '>' {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:24:28 user devstack@n-api.service[72089]: DEBUG nova.compute.api [None req-18cd3cfd-c0f1-4ba4-bd8e-830bfe3a1e28 tempest-DeleteServersTestJSON-124461992 tempest-DeleteServersTestJSON-124461992-project-member] [instance: efd7afec-d6d0-4e3f-a3b9-f672b3e711cf] Fetching instance by UUID {{(pid=72089) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:24:28 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-18cd3cfd-c0f1-4ba4-bd8e-830bfe3a1e28 tempest-DeleteServersTestJSON-124461992 tempest-DeleteServersTestJSON-124461992-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:24:28 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-18cd3cfd-c0f1-4ba4-bd8e-830bfe3a1e28 tempest-DeleteServersTestJSON-124461992 tempest-DeleteServersTestJSON-124461992-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:24:28 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-18cd3cfd-c0f1-4ba4-bd8e-830bfe3a1e28 tempest-DeleteServersTestJSON-124461992 tempest-DeleteServersTestJSON-124461992-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:24:28 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-18cd3cfd-c0f1-4ba4-bd8e-830bfe3a1e28 tempest-DeleteServersTestJSON-124461992 tempest-DeleteServersTestJSON-124461992-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:24:28 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-18cd3cfd-c0f1-4ba4-bd8e-830bfe3a1e28 tempest-DeleteServersTestJSON-124461992 tempest-DeleteServersTestJSON-124461992-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:24:28 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-18cd3cfd-c0f1-4ba4-bd8e-830bfe3a1e28 tempest-DeleteServersTestJSON-124461992 tempest-DeleteServersTestJSON-124461992-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:24:28 user devstack@n-api.service[72089]: INFO nova.api.openstack.wsgi [None req-18cd3cfd-c0f1-4ba4-bd8e-830bfe3a1e28 tempest-DeleteServersTestJSON-124461992 tempest-DeleteServersTestJSON-124461992-project-member] HTTP exception thrown: Instance efd7afec-d6d0-4e3f-a3b9-f672b3e711cf could not be found. Apr 11 19:24:28 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [None req-18cd3cfd-c0f1-4ba4-bd8e-830bfe3a1e28 tempest-DeleteServersTestJSON-124461992 tempest-DeleteServersTestJSON-124461992-project-member] Request method failure captured: Apr 11 19:24:28 user devstack@n-api.service[72089]: request: GET /compute/v2.1/servers/efd7afec-d6d0-4e3f-a3b9-f672b3e711cf/os-volume_attachments HTTP/1.1 Apr 11 19:24:28 user devstack@n-api.service[72089]: Accept: application/json Apr 11 19:24:28 user devstack@n-api.service[72089]: Accept-Encoding: identity Apr 11 19:24:28 user devstack@n-api.service[72089]: Connection: close Apr 11 19:24:28 user devstack@n-api.service[72089]: Content-Length: 0 Apr 11 19:24:28 user devstack@n-api.service[72089]: Content-Type: application/json Apr 11 19:24:28 user devstack@n-api.service[72089]: Host: 10.0.0.210 Apr 11 19:24:28 user devstack@n-api.service[72089]: Openstack-System-Scope: None Apr 11 19:24:28 user devstack@n-api.service[72089]: User-Agent: python-urllib3/1.26.15 Apr 11 19:24:28 user devstack@n-api.service[72089]: X-Auth-Token: gAAAAABkNbM_Rf4O0Sh5ZvgQ_ZOPNSen9l_p9scIqx_3uP10ki6YPvVdmBmbTqDWmOzB2EvmUlqWMbdKbIUki3zvc_e7XnrsxMB8XJQlwsozYzOpaGPL8uctuEGO-iGFkEqGmZi_-oeMfavk4fYhbPgRTRmcO5kw17T_1qQa5ZqPrRUCh6QgFqE Apr 11 19:24:28 user devstack@n-api.service[72089]: X-Domain-Id: None Apr 11 19:24:28 user devstack@n-api.service[72089]: X-Domain-Name: None Apr 11 19:24:28 user devstack@n-api.service[72089]: X-Identity-Status: Confirmed Apr 11 19:24:28 user devstack@n-api.service[72089]: X-Is-Admin-Project: True Apr 11 19:24:28 user devstack@n-api.service[72089]: X-Project-Domain-Id: default Apr 11 19:24:28 user devstack@n-api.service[72089]: X-Project-Domain-Name: Default Apr 11 19:24:28 user devstack@n-api.service[72089]: X-Project-Id: 34322e02b2fc4c2c84fb77583faf4405 Apr 11 19:24:28 user devstack@n-api.service[72089]: X-Project-Name: tempest-DeleteServersTestJSON-124461992 Apr 11 19:24:28 user devstack@n-api.service[72089]: X-Role: reader,member Apr 11 19:24:28 user devstack@n-api.service[72089]: X-Roles: reader,member Apr 11 19:24:28 user devstack@n-api.service[72089]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/34322e02b2fc4c2c84fb77583faf4405"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/34322e02b2fc4c2c84fb77583faf4405"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/34322e02b2fc4c2c84fb77583faf4405"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 11 19:24:28 user devstack@n-api.service[72089]: X-Tenant: tempest-DeleteServersTestJSON-124461992 Apr 11 19:24:28 user devstack@n-api.service[72089]: X-Tenant-Id: 34322e02b2fc4c2c84fb77583faf4405 Apr 11 19:24:28 user devstack@n-api.service[72089]: X-Tenant-Name: tempest-DeleteServersTestJSON-124461992 Apr 11 19:24:28 user devstack@n-api.service[72089]: X-User: tempest-DeleteServersTestJSON-124461992-project-member Apr 11 19:24:28 user devstack@n-api.service[72089]: X-User-Domain-Id: default Apr 11 19:24:28 user devstack@n-api.service[72089]: X-User-Domain-Name: Default Apr 11 19:24:28 user devstack@n-api.service[72089]: X-User-Id: 502b859ece744cf680123cd4e9643938 Apr 11 19:24:28 user devstack@n-api.service[72089]: X-User-Name: tempest-DeleteServersTestJSON-124461992-project-member Apr 11 19:24:28 user devstack@n-api.service[72089]: method: > Apr 11 19:24:28 user devstack@n-api.service[72089]: exception: Instance efd7afec-d6d0-4e3f-a3b9-f672b3e711cf could not be found. Apr 11 19:24:28 user devstack@n-api.service[72089]: action_args: {'server_id': 'efd7afec-d6d0-4e3f-a3b9-f672b3e711cf'} Apr 11 19:24:28 user devstack@n-api.service[72089]: {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 19:24:28 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:24:28 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 19:24:28 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 19:24:28 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 19:24:28 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 19:24:28 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 19:24:28 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 19:24:28 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 19:24:28 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 19:24:28 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance efd7afec-d6d0-4e3f-a3b9-f672b3e711cf could not be found. Apr 11 19:24:28 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi Apr 11 19:24:28 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 19:24:28 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi Apr 11 19:24:28 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:24:28 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 19:24:28 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 19:24:28 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 19:24:28 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 19:24:28 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 19:24:28 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 19:24:28 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Apr 11 19:24:28 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 11 19:24:28 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Apr 11 19:24:28 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 11 19:24:28 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Apr 11 19:24:28 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Apr 11 19:24:28 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 19:24:28 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 19:24:28 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance efd7afec-d6d0-4e3f-a3b9-f672b3e711cf could not be found. Apr 11 19:24:28 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi Apr 11 19:24:28 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 19:24:28 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi Apr 11 19:24:28 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:24:28 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 19:24:28 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 19:24:28 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 19:24:28 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 19:24:28 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance efd7afec-d6d0-4e3f-a3b9-f672b3e711cf could not be found. Apr 11 19:24:28 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi Apr 11 19:24:28 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [None req-18cd3cfd-c0f1-4ba4-bd8e-830bfe3a1e28 tempest-DeleteServersTestJSON-124461992 tempest-DeleteServersTestJSON-124461992-project-member] Returning 404 to user: Instance efd7afec-d6d0-4e3f-a3b9-f672b3e711cf could not be found. {{(pid=72089) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 19:24:28 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [None req-18cd3cfd-c0f1-4ba4-bd8e-830bfe3a1e28 tempest-DeleteServersTestJSON-124461992 tempest-DeleteServersTestJSON-124461992-project-member] 10.0.0.210 "GET /compute/v2.1/servers/efd7afec-d6d0-4e3f-a3b9-f672b3e711cf/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.071825 Apr 11 19:24:28 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 83/231] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Apr 11 19:24:28 2023] GET /compute/v2.1/servers/efd7afec-d6d0-4e3f-a3b9-f672b3e711cf/os-volume_attachments => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 19:24:28 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [req-40411a70-65a0-4374-a761-9d33b5883895 req-a1455d22-6b77-483b-939b-95e71b17a618 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75a4ef96-a6c3-4ccd-9503-bab0d4174b2b", "name": "network-vif-unplugged", "status": "completed", "tag": "986b85fe-4d6d-4ac6-95c7-02e58e4073b2"}]} {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:24:28 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-40411a70-65a0-4374-a761-9d33b5883895 req-a1455d22-6b77-483b-939b-95e71b17a618 service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:24:28 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-40411a70-65a0-4374-a761-9d33b5883895 req-a1455d22-6b77-483b-939b-95e71b17a618 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:24:28 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-40411a70-65a0-4374-a761-9d33b5883895 req-a1455d22-6b77-483b-939b-95e71b17a618 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:24:28 user devstack@n-api.service[72088]: INFO nova.api.openstack.compute.server_external_events [req-40411a70-65a0-4374-a761-9d33b5883895 req-a1455d22-6b77-483b-939b-95e71b17a618 service nova] Creating event network-vif-unplugged:986b85fe-4d6d-4ac6-95c7-02e58e4073b2 for instance 75a4ef96-a6c3-4ccd-9503-bab0d4174b2b on user Apr 11 19:24:28 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [req-40411a70-65a0-4374-a761-9d33b5883895 req-a1455d22-6b77-483b-939b-95e71b17a618 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.091780 Apr 11 19:24:28 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 76/232] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:24:28 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:24:29 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [None req-9913b844-137a-403a-a75f-bb43d1cf1163 tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] Calling method '>' {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:24:29 user devstack@n-api.service[72090]: DEBUG nova.compute.api [None req-9913b844-137a-403a-a75f-bb43d1cf1163 tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] [instance: b71d95ed-728d-4386-b7c6-50b252718ca9] Fetching instance by UUID {{(pid=72090) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:24:29 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-9913b844-137a-403a-a75f-bb43d1cf1163 tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:24:29 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-9913b844-137a-403a-a75f-bb43d1cf1163 tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:24:29 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-9913b844-137a-403a-a75f-bb43d1cf1163 tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:24:29 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-9913b844-137a-403a-a75f-bb43d1cf1163 tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:24:29 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-9913b844-137a-403a-a75f-bb43d1cf1163 tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:24:29 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-9913b844-137a-403a-a75f-bb43d1cf1163 tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:24:29 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [None req-9913b844-137a-403a-a75f-bb43d1cf1163 tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/b71d95ed-728d-4386-b7c6-50b252718ca9/os-interface/8f3ff9dd-32cc-4b19-b059-4e4e3da4d3a7" status: 202 len: 0 microversion: 2.49 time: 0.172342 Apr 11 19:24:29 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 74/233] 10.0.0.210 () {64 vars in 1507 bytes} [Tue Apr 11 19:24:29 2023] DELETE /compute/v2.1/servers/b71d95ed-728d-4386-b7c6-50b252718ca9/os-interface/8f3ff9dd-32cc-4b19-b059-4e4e3da4d3a7 => generated 0 bytes in 175 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 11 19:24:29 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [req-efd45e24-0619-48d9-98b1-605a34fe6bf9 req-1875e2e1-c0f5-4f21-84a7-2e1196962a33 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75a4ef96-a6c3-4ccd-9503-bab0d4174b2b", "name": "network-vif-unplugged", "status": "completed", "tag": "59314c6a-6d9a-4586-a8de-27a566e58eb4"}, {"server_uuid": "75a4ef96-a6c3-4ccd-9503-bab0d4174b2b", "name": "network-vif-plugged", "status": "completed", "tag": "59314c6a-6d9a-4586-a8de-27a566e58eb4"}, {"server_uuid": "75a4ef96-a6c3-4ccd-9503-bab0d4174b2b", "name": "network-vif-unplugged", "status": "completed", "tag": "f3db6cdb-4d7d-4c66-a809-d59e3feaea97"}]} {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:24:29 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-efd45e24-0619-48d9-98b1-605a34fe6bf9 req-1875e2e1-c0f5-4f21-84a7-2e1196962a33 service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:24:29 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-efd45e24-0619-48d9-98b1-605a34fe6bf9 req-1875e2e1-c0f5-4f21-84a7-2e1196962a33 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:24:29 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-efd45e24-0619-48d9-98b1-605a34fe6bf9 req-1875e2e1-c0f5-4f21-84a7-2e1196962a33 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:24:29 user devstack@n-api.service[72088]: INFO nova.api.openstack.compute.server_external_events [req-efd45e24-0619-48d9-98b1-605a34fe6bf9 req-1875e2e1-c0f5-4f21-84a7-2e1196962a33 service nova] Creating event network-vif-unplugged:59314c6a-6d9a-4586-a8de-27a566e58eb4 for instance 75a4ef96-a6c3-4ccd-9503-bab0d4174b2b on user Apr 11 19:24:29 user devstack@n-api.service[72088]: INFO nova.api.openstack.compute.server_external_events [req-efd45e24-0619-48d9-98b1-605a34fe6bf9 req-1875e2e1-c0f5-4f21-84a7-2e1196962a33 service nova] Creating event network-vif-plugged:59314c6a-6d9a-4586-a8de-27a566e58eb4 for instance 75a4ef96-a6c3-4ccd-9503-bab0d4174b2b on user Apr 11 19:24:29 user devstack@n-api.service[72088]: INFO nova.api.openstack.compute.server_external_events [req-efd45e24-0619-48d9-98b1-605a34fe6bf9 req-1875e2e1-c0f5-4f21-84a7-2e1196962a33 service nova] Creating event network-vif-unplugged:f3db6cdb-4d7d-4c66-a809-d59e3feaea97 for instance 75a4ef96-a6c3-4ccd-9503-bab0d4174b2b on user Apr 11 19:24:29 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [req-efd45e24-0619-48d9-98b1-605a34fe6bf9 req-1875e2e1-c0f5-4f21-84a7-2e1196962a33 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 529 microversion: 2.1 time: 0.065857 Apr 11 19:24:29 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 77/234] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:24:29 2023] POST /compute/v2.1/os-server-external-events => generated 529 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:24:29 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [None req-9d461688-f57b-4669-bbc5-caa4c5986044 tempest-TaggedAttachmentsTest-326619538 tempest-TaggedAttachmentsTest-326619538-project-admin] Calling method '>' {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:24:29 user devstack@n-api.service[72089]: DEBUG nova.compute.api [None req-9d461688-f57b-4669-bbc5-caa4c5986044 tempest-TaggedAttachmentsTest-326619538 tempest-TaggedAttachmentsTest-326619538-project-admin] [instance: b71d95ed-728d-4386-b7c6-50b252718ca9] Fetching instance by UUID {{(pid=72089) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:24:29 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-9d461688-f57b-4669-bbc5-caa4c5986044 tempest-TaggedAttachmentsTest-326619538 tempest-TaggedAttachmentsTest-326619538-project-admin] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:24:29 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-9d461688-f57b-4669-bbc5-caa4c5986044 tempest-TaggedAttachmentsTest-326619538 tempest-TaggedAttachmentsTest-326619538-project-admin] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:24:29 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-9d461688-f57b-4669-bbc5-caa4c5986044 tempest-TaggedAttachmentsTest-326619538 tempest-TaggedAttachmentsTest-326619538-project-admin] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:24:29 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-9d461688-f57b-4669-bbc5-caa4c5986044 tempest-TaggedAttachmentsTest-326619538 tempest-TaggedAttachmentsTest-326619538-project-admin] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:24:29 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-9d461688-f57b-4669-bbc5-caa4c5986044 tempest-TaggedAttachmentsTest-326619538 tempest-TaggedAttachmentsTest-326619538-project-admin] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:24:29 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-9d461688-f57b-4669-bbc5-caa4c5986044 tempest-TaggedAttachmentsTest-326619538 tempest-TaggedAttachmentsTest-326619538-project-admin] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:24:30 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [None req-9d461688-f57b-4669-bbc5-caa4c5986044 tempest-TaggedAttachmentsTest-326619538 tempest-TaggedAttachmentsTest-326619538-project-admin] 10.0.0.210 "GET /compute/v2.1/servers/b71d95ed-728d-4386-b7c6-50b252718ca9/os-instance-actions/req-9913b844-137a-403a-a75f-bb43d1cf1163" status: 200 len: 474 microversion: 2.49 time: 0.580424 Apr 11 19:24:30 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 84/235] 10.0.0.210 () {64 vars in 1537 bytes} [Tue Apr 11 19:24:29 2023] GET /compute/v2.1/servers/b71d95ed-728d-4386-b7c6-50b252718ca9/os-instance-actions/req-9913b844-137a-403a-a75f-bb43d1cf1163 => generated 474 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:24:30 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [None req-1eae677f-4b62-422f-8eef-fffb168aafc5 tempest-DeleteServersTestJSON-124461992 tempest-DeleteServersTestJSON-124461992-project-member] Calling method '>' {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:24:30 user devstack@n-api.service[72090]: DEBUG nova.compute.api [None req-1eae677f-4b62-422f-8eef-fffb168aafc5 tempest-DeleteServersTestJSON-124461992 tempest-DeleteServersTestJSON-124461992-project-member] [instance: efd7afec-d6d0-4e3f-a3b9-f672b3e711cf] Fetching instance by UUID {{(pid=72090) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:24:30 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-1eae677f-4b62-422f-8eef-fffb168aafc5 tempest-DeleteServersTestJSON-124461992 tempest-DeleteServersTestJSON-124461992-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:24:30 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-1eae677f-4b62-422f-8eef-fffb168aafc5 tempest-DeleteServersTestJSON-124461992 tempest-DeleteServersTestJSON-124461992-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:24:30 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-1eae677f-4b62-422f-8eef-fffb168aafc5 tempest-DeleteServersTestJSON-124461992 tempest-DeleteServersTestJSON-124461992-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:24:30 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-1eae677f-4b62-422f-8eef-fffb168aafc5 tempest-DeleteServersTestJSON-124461992 tempest-DeleteServersTestJSON-124461992-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:24:30 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-1eae677f-4b62-422f-8eef-fffb168aafc5 tempest-DeleteServersTestJSON-124461992 tempest-DeleteServersTestJSON-124461992-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:24:30 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-1eae677f-4b62-422f-8eef-fffb168aafc5 tempest-DeleteServersTestJSON-124461992 tempest-DeleteServersTestJSON-124461992-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:24:30 user devstack@n-api.service[72090]: INFO nova.api.openstack.wsgi [None req-1eae677f-4b62-422f-8eef-fffb168aafc5 tempest-DeleteServersTestJSON-124461992 tempest-DeleteServersTestJSON-124461992-project-member] HTTP exception thrown: Instance efd7afec-d6d0-4e3f-a3b9-f672b3e711cf could not be found. Apr 11 19:24:30 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [None req-1eae677f-4b62-422f-8eef-fffb168aafc5 tempest-DeleteServersTestJSON-124461992 tempest-DeleteServersTestJSON-124461992-project-member] Request method failure captured: Apr 11 19:24:30 user devstack@n-api.service[72090]: request: DELETE /compute/v2.1/servers/efd7afec-d6d0-4e3f-a3b9-f672b3e711cf HTTP/1.1 Apr 11 19:24:30 user devstack@n-api.service[72090]: Accept: application/json Apr 11 19:24:30 user devstack@n-api.service[72090]: Accept-Encoding: identity Apr 11 19:24:30 user devstack@n-api.service[72090]: Connection: close Apr 11 19:24:30 user devstack@n-api.service[72090]: Content-Length: 0 Apr 11 19:24:30 user devstack@n-api.service[72090]: Content-Type: application/json Apr 11 19:24:30 user devstack@n-api.service[72090]: Host: 10.0.0.210 Apr 11 19:24:30 user devstack@n-api.service[72090]: Openstack-System-Scope: None Apr 11 19:24:30 user devstack@n-api.service[72090]: User-Agent: python-urllib3/1.26.15 Apr 11 19:24:30 user devstack@n-api.service[72090]: X-Auth-Token: gAAAAABkNbM_Rf4O0Sh5ZvgQ_ZOPNSen9l_p9scIqx_3uP10ki6YPvVdmBmbTqDWmOzB2EvmUlqWMbdKbIUki3zvc_e7XnrsxMB8XJQlwsozYzOpaGPL8uctuEGO-iGFkEqGmZi_-oeMfavk4fYhbPgRTRmcO5kw17T_1qQa5ZqPrRUCh6QgFqE Apr 11 19:24:30 user devstack@n-api.service[72090]: X-Domain-Id: None Apr 11 19:24:30 user devstack@n-api.service[72090]: X-Domain-Name: None Apr 11 19:24:30 user devstack@n-api.service[72090]: X-Identity-Status: Confirmed Apr 11 19:24:30 user devstack@n-api.service[72090]: X-Is-Admin-Project: True Apr 11 19:24:30 user devstack@n-api.service[72090]: X-Project-Domain-Id: default Apr 11 19:24:30 user devstack@n-api.service[72090]: X-Project-Domain-Name: Default Apr 11 19:24:30 user devstack@n-api.service[72090]: X-Project-Id: 34322e02b2fc4c2c84fb77583faf4405 Apr 11 19:24:30 user devstack@n-api.service[72090]: X-Project-Name: tempest-DeleteServersTestJSON-124461992 Apr 11 19:24:30 user devstack@n-api.service[72090]: X-Role: reader,member Apr 11 19:24:30 user devstack@n-api.service[72090]: X-Roles: reader,member Apr 11 19:24:30 user devstack@n-api.service[72090]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/34322e02b2fc4c2c84fb77583faf4405"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/34322e02b2fc4c2c84fb77583faf4405"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/34322e02b2fc4c2c84fb77583faf4405"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 11 19:24:30 user devstack@n-api.service[72090]: X-Tenant: tempest-DeleteServersTestJSON-124461992 Apr 11 19:24:30 user devstack@n-api.service[72090]: X-Tenant-Id: 34322e02b2fc4c2c84fb77583faf4405 Apr 11 19:24:30 user devstack@n-api.service[72090]: X-Tenant-Name: tempest-DeleteServersTestJSON-124461992 Apr 11 19:24:30 user devstack@n-api.service[72090]: X-User: tempest-DeleteServersTestJSON-124461992-project-member Apr 11 19:24:30 user devstack@n-api.service[72090]: X-User-Domain-Id: default Apr 11 19:24:30 user devstack@n-api.service[72090]: X-User-Domain-Name: Default Apr 11 19:24:30 user devstack@n-api.service[72090]: X-User-Id: 502b859ece744cf680123cd4e9643938 Apr 11 19:24:30 user devstack@n-api.service[72090]: X-User-Name: tempest-DeleteServersTestJSON-124461992-project-member Apr 11 19:24:30 user devstack@n-api.service[72090]: method: > Apr 11 19:24:30 user devstack@n-api.service[72090]: exception: Instance efd7afec-d6d0-4e3f-a3b9-f672b3e711cf could not be found. Apr 11 19:24:30 user devstack@n-api.service[72090]: action_args: {'id': 'efd7afec-d6d0-4e3f-a3b9-f672b3e711cf'} Apr 11 19:24:30 user devstack@n-api.service[72090]: {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 19:24:30 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:24:30 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 19:24:30 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 19:24:30 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 19:24:30 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 19:24:30 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 19:24:30 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 19:24:30 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 19:24:30 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 19:24:30 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance efd7afec-d6d0-4e3f-a3b9-f672b3e711cf could not be found. Apr 11 19:24:30 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi Apr 11 19:24:30 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 19:24:30 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi Apr 11 19:24:30 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:24:30 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 19:24:30 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 19:24:30 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 19:24:30 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 19:24:30 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 19:24:30 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 19:24:30 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 11 19:24:30 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 11 19:24:30 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 11 19:24:30 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 11 19:24:30 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 19:24:30 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 19:24:30 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 19:24:30 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 19:24:30 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance efd7afec-d6d0-4e3f-a3b9-f672b3e711cf could not be found. Apr 11 19:24:30 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi Apr 11 19:24:30 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 19:24:30 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi Apr 11 19:24:30 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:24:30 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 19:24:30 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 19:24:30 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 19:24:30 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 19:24:30 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance efd7afec-d6d0-4e3f-a3b9-f672b3e711cf could not be found. Apr 11 19:24:30 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi Apr 11 19:24:30 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [None req-1eae677f-4b62-422f-8eef-fffb168aafc5 tempest-DeleteServersTestJSON-124461992 tempest-DeleteServersTestJSON-124461992-project-member] Returning 404 to user: Instance efd7afec-d6d0-4e3f-a3b9-f672b3e711cf could not be found. {{(pid=72090) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 19:24:30 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [None req-1eae677f-4b62-422f-8eef-fffb168aafc5 tempest-DeleteServersTestJSON-124461992 tempest-DeleteServersTestJSON-124461992-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/efd7afec-d6d0-4e3f-a3b9-f672b3e711cf" status: 404 len: 111 microversion: 2.1 time: 0.042158 Apr 11 19:24:30 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 75/236] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 19:24:30 2023] DELETE /compute/v2.1/servers/efd7afec-d6d0-4e3f-a3b9-f672b3e711cf => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 19:24:30 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [req-317e5bf2-0ffa-4098-9149-8e418ab337e8 req-bded158a-d35e-4f37-abd9-4d0486943852 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75a4ef96-a6c3-4ccd-9503-bab0d4174b2b", "name": "network-vif-plugged", "status": "completed", "tag": "986b85fe-4d6d-4ac6-95c7-02e58e4073b2"}, {"server_uuid": "75a4ef96-a6c3-4ccd-9503-bab0d4174b2b", "name": "network-vif-unplugged", "status": "completed", "tag": "1f5ae163-b670-4418-b5d3-1f0b70fdd991"}, {"server_uuid": "75a4ef96-a6c3-4ccd-9503-bab0d4174b2b", "name": "network-vif-plugged", "status": "completed", "tag": "1f5ae163-b670-4418-b5d3-1f0b70fdd991"}]} {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:24:30 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [None req-fad1e770-fd23-4c0c-8996-8907a1bfeddb tempest-DeleteServersTestJSON-124461992 tempest-DeleteServersTestJSON-124461992-project-member] Calling method '>' {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:24:30 user devstack@n-api.service[72089]: DEBUG nova.compute.api [None req-fad1e770-fd23-4c0c-8996-8907a1bfeddb tempest-DeleteServersTestJSON-124461992 tempest-DeleteServersTestJSON-124461992-project-member] [instance: efd7afec-d6d0-4e3f-a3b9-f672b3e711cf] Fetching instance by UUID {{(pid=72089) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:24:30 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-317e5bf2-0ffa-4098-9149-8e418ab337e8 req-bded158a-d35e-4f37-abd9-4d0486943852 service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:24:30 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-317e5bf2-0ffa-4098-9149-8e418ab337e8 req-bded158a-d35e-4f37-abd9-4d0486943852 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:24:30 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-317e5bf2-0ffa-4098-9149-8e418ab337e8 req-bded158a-d35e-4f37-abd9-4d0486943852 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:24:30 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-fad1e770-fd23-4c0c-8996-8907a1bfeddb tempest-DeleteServersTestJSON-124461992 tempest-DeleteServersTestJSON-124461992-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:24:30 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-fad1e770-fd23-4c0c-8996-8907a1bfeddb tempest-DeleteServersTestJSON-124461992 tempest-DeleteServersTestJSON-124461992-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:24:30 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-fad1e770-fd23-4c0c-8996-8907a1bfeddb tempest-DeleteServersTestJSON-124461992 tempest-DeleteServersTestJSON-124461992-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:24:30 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-fad1e770-fd23-4c0c-8996-8907a1bfeddb tempest-DeleteServersTestJSON-124461992 tempest-DeleteServersTestJSON-124461992-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:24:30 user devstack@n-api.service[72088]: INFO nova.api.openstack.compute.server_external_events [req-317e5bf2-0ffa-4098-9149-8e418ab337e8 req-bded158a-d35e-4f37-abd9-4d0486943852 service nova] Creating event network-vif-plugged:986b85fe-4d6d-4ac6-95c7-02e58e4073b2 for instance 75a4ef96-a6c3-4ccd-9503-bab0d4174b2b on user Apr 11 19:24:30 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-fad1e770-fd23-4c0c-8996-8907a1bfeddb tempest-DeleteServersTestJSON-124461992 tempest-DeleteServersTestJSON-124461992-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:24:30 user devstack@n-api.service[72088]: INFO nova.api.openstack.compute.server_external_events [req-317e5bf2-0ffa-4098-9149-8e418ab337e8 req-bded158a-d35e-4f37-abd9-4d0486943852 service nova] Creating event network-vif-unplugged:1f5ae163-b670-4418-b5d3-1f0b70fdd991 for instance 75a4ef96-a6c3-4ccd-9503-bab0d4174b2b on user Apr 11 19:24:30 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-fad1e770-fd23-4c0c-8996-8907a1bfeddb tempest-DeleteServersTestJSON-124461992 tempest-DeleteServersTestJSON-124461992-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:24:30 user devstack@n-api.service[72088]: INFO nova.api.openstack.compute.server_external_events [req-317e5bf2-0ffa-4098-9149-8e418ab337e8 req-bded158a-d35e-4f37-abd9-4d0486943852 service nova] Creating event network-vif-plugged:1f5ae163-b670-4418-b5d3-1f0b70fdd991 for instance 75a4ef96-a6c3-4ccd-9503-bab0d4174b2b on user Apr 11 19:24:30 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [req-317e5bf2-0ffa-4098-9149-8e418ab337e8 req-bded158a-d35e-4f37-abd9-4d0486943852 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 527 microversion: 2.1 time: 0.057326 Apr 11 19:24:30 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 78/237] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:24:30 2023] POST /compute/v2.1/os-server-external-events => generated 527 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:24:31 user devstack@n-api.service[72089]: INFO nova.api.openstack.wsgi [None req-fad1e770-fd23-4c0c-8996-8907a1bfeddb tempest-DeleteServersTestJSON-124461992 tempest-DeleteServersTestJSON-124461992-project-member] HTTP exception thrown: Instance efd7afec-d6d0-4e3f-a3b9-f672b3e711cf could not be found. Apr 11 19:24:31 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [None req-fad1e770-fd23-4c0c-8996-8907a1bfeddb tempest-DeleteServersTestJSON-124461992 tempest-DeleteServersTestJSON-124461992-project-member] Request method failure captured: Apr 11 19:24:31 user devstack@n-api.service[72089]: request: GET /compute/v2.1/servers/efd7afec-d6d0-4e3f-a3b9-f672b3e711cf HTTP/1.1 Apr 11 19:24:31 user devstack@n-api.service[72089]: Accept: application/json Apr 11 19:24:31 user devstack@n-api.service[72089]: Accept-Encoding: identity Apr 11 19:24:31 user devstack@n-api.service[72089]: Connection: close Apr 11 19:24:31 user devstack@n-api.service[72089]: Content-Length: 0 Apr 11 19:24:31 user devstack@n-api.service[72089]: Content-Type: application/json Apr 11 19:24:31 user devstack@n-api.service[72089]: Host: 10.0.0.210 Apr 11 19:24:31 user devstack@n-api.service[72089]: Openstack-System-Scope: None Apr 11 19:24:31 user devstack@n-api.service[72089]: User-Agent: python-urllib3/1.26.15 Apr 11 19:24:31 user devstack@n-api.service[72089]: X-Auth-Token: gAAAAABkNbM_Rf4O0Sh5ZvgQ_ZOPNSen9l_p9scIqx_3uP10ki6YPvVdmBmbTqDWmOzB2EvmUlqWMbdKbIUki3zvc_e7XnrsxMB8XJQlwsozYzOpaGPL8uctuEGO-iGFkEqGmZi_-oeMfavk4fYhbPgRTRmcO5kw17T_1qQa5ZqPrRUCh6QgFqE Apr 11 19:24:31 user devstack@n-api.service[72089]: X-Domain-Id: None Apr 11 19:24:31 user devstack@n-api.service[72089]: X-Domain-Name: None Apr 11 19:24:31 user devstack@n-api.service[72089]: X-Identity-Status: Confirmed Apr 11 19:24:31 user devstack@n-api.service[72089]: X-Is-Admin-Project: True Apr 11 19:24:31 user devstack@n-api.service[72089]: X-Project-Domain-Id: default Apr 11 19:24:31 user devstack@n-api.service[72089]: X-Project-Domain-Name: Default Apr 11 19:24:31 user devstack@n-api.service[72089]: X-Project-Id: 34322e02b2fc4c2c84fb77583faf4405 Apr 11 19:24:31 user devstack@n-api.service[72089]: X-Project-Name: tempest-DeleteServersTestJSON-124461992 Apr 11 19:24:31 user devstack@n-api.service[72089]: X-Role: reader,member Apr 11 19:24:31 user devstack@n-api.service[72089]: X-Roles: reader,member Apr 11 19:24:31 user devstack@n-api.service[72089]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/34322e02b2fc4c2c84fb77583faf4405"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/34322e02b2fc4c2c84fb77583faf4405"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/34322e02b2fc4c2c84fb77583faf4405"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 11 19:24:31 user devstack@n-api.service[72089]: X-Tenant: tempest-DeleteServersTestJSON-124461992 Apr 11 19:24:31 user devstack@n-api.service[72089]: X-Tenant-Id: 34322e02b2fc4c2c84fb77583faf4405 Apr 11 19:24:31 user devstack@n-api.service[72089]: X-Tenant-Name: tempest-DeleteServersTestJSON-124461992 Apr 11 19:24:31 user devstack@n-api.service[72089]: X-User: tempest-DeleteServersTestJSON-124461992-project-member Apr 11 19:24:31 user devstack@n-api.service[72089]: X-User-Domain-Id: default Apr 11 19:24:31 user devstack@n-api.service[72089]: X-User-Domain-Name: Default Apr 11 19:24:31 user devstack@n-api.service[72089]: X-User-Id: 502b859ece744cf680123cd4e9643938 Apr 11 19:24:31 user devstack@n-api.service[72089]: X-User-Name: tempest-DeleteServersTestJSON-124461992-project-member Apr 11 19:24:31 user devstack@n-api.service[72089]: method: > Apr 11 19:24:31 user devstack@n-api.service[72089]: exception: Instance efd7afec-d6d0-4e3f-a3b9-f672b3e711cf could not be found. Apr 11 19:24:31 user devstack@n-api.service[72089]: action_args: {'id': 'efd7afec-d6d0-4e3f-a3b9-f672b3e711cf'} Apr 11 19:24:31 user devstack@n-api.service[72089]: {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 19:24:31 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:24:31 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 19:24:31 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 19:24:31 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 19:24:31 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 19:24:31 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 19:24:31 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 19:24:31 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 19:24:31 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 19:24:31 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance efd7afec-d6d0-4e3f-a3b9-f672b3e711cf could not be found. Apr 11 19:24:31 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi Apr 11 19:24:31 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 19:24:31 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi Apr 11 19:24:31 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:24:31 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 19:24:31 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 19:24:31 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 19:24:31 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 19:24:31 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 19:24:31 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 19:24:31 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 19:24:31 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 19:24:31 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 19:24:31 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 19:24:31 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 19:24:31 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 19:24:31 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance efd7afec-d6d0-4e3f-a3b9-f672b3e711cf could not be found. Apr 11 19:24:31 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi Apr 11 19:24:31 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 19:24:31 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi Apr 11 19:24:31 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:24:31 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 19:24:31 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 19:24:31 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 19:24:31 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 19:24:31 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance efd7afec-d6d0-4e3f-a3b9-f672b3e711cf could not be found. Apr 11 19:24:31 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi Apr 11 19:24:31 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [None req-fad1e770-fd23-4c0c-8996-8907a1bfeddb tempest-DeleteServersTestJSON-124461992 tempest-DeleteServersTestJSON-124461992-project-member] Returning 404 to user: Instance efd7afec-d6d0-4e3f-a3b9-f672b3e711cf could not be found. {{(pid=72089) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 19:24:31 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [None req-fad1e770-fd23-4c0c-8996-8907a1bfeddb tempest-DeleteServersTestJSON-124461992 tempest-DeleteServersTestJSON-124461992-project-member] 10.0.0.210 "GET /compute/v2.1/servers/efd7afec-d6d0-4e3f-a3b9-f672b3e711cf" status: 404 len: 111 microversion: 2.1 time: 0.064287 Apr 11 19:24:31 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 85/238] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 19:24:30 2023] GET /compute/v2.1/servers/efd7afec-d6d0-4e3f-a3b9-f672b3e711cf => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 19:24:31 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [req-3f649c52-4fa0-47c5-b7fa-62cf00fbd566 req-a5c28243-681f-46ec-a4e4-56aa7d21a279 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75a4ef96-a6c3-4ccd-9503-bab0d4174b2b", "name": "network-vif-plugged", "status": "completed", "tag": "f3db6cdb-4d7d-4c66-a809-d59e3feaea97"}, {"server_uuid": "75a4ef96-a6c3-4ccd-9503-bab0d4174b2b", "name": "network-vif-unplugged", "status": "completed", "tag": "cde1df21-a053-49fd-a275-51926ac238e5"}, {"server_uuid": "75a4ef96-a6c3-4ccd-9503-bab0d4174b2b", "name": "network-vif-plugged", "status": "completed", "tag": "cde1df21-a053-49fd-a275-51926ac238e5"}, {"server_uuid": "75a4ef96-a6c3-4ccd-9503-bab0d4174b2b", "name": "network-vif-unplugged", "status": "completed", "tag": "8b7ae73d-744e-48fa-af96-b17e7dba1d58"}, {"server_uuid": "75a4ef96-a6c3-4ccd-9503-bab0d4174b2b", "name": "network-vif-plugged", "status": "completed", "tag": "8b7ae73d-744e-48fa-af96-b17e7dba1d58"}, {"server_uuid": "b71d95ed-728d-4386-b7c6-50b252718ca9", "name": "network-vif-deleted", "tag": "8f3ff9dd-32cc-4b19-b059-4e4e3da4d3a7"}, {"server_uuid": "75a4ef96-a6c3-4ccd-9503-bab0d4174b2b", "name": "network-vif-unplugged", "status": "completed", "tag": "6503fe71-75d3-4388-9368-0de318a6d614"}]} {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:24:31 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-3f649c52-4fa0-47c5-b7fa-62cf00fbd566 req-a5c28243-681f-46ec-a4e4-56aa7d21a279 service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:24:31 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-3f649c52-4fa0-47c5-b7fa-62cf00fbd566 req-a5c28243-681f-46ec-a4e4-56aa7d21a279 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:24:31 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-3f649c52-4fa0-47c5-b7fa-62cf00fbd566 req-a5c28243-681f-46ec-a4e4-56aa7d21a279 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:24:31 user devstack@n-api.service[72090]: INFO nova.api.openstack.compute.server_external_events [req-3f649c52-4fa0-47c5-b7fa-62cf00fbd566 req-a5c28243-681f-46ec-a4e4-56aa7d21a279 service nova] Creating event network-vif-plugged:f3db6cdb-4d7d-4c66-a809-d59e3feaea97 for instance 75a4ef96-a6c3-4ccd-9503-bab0d4174b2b on user Apr 11 19:24:31 user devstack@n-api.service[72090]: INFO nova.api.openstack.compute.server_external_events [req-3f649c52-4fa0-47c5-b7fa-62cf00fbd566 req-a5c28243-681f-46ec-a4e4-56aa7d21a279 service nova] Creating event network-vif-unplugged:cde1df21-a053-49fd-a275-51926ac238e5 for instance 75a4ef96-a6c3-4ccd-9503-bab0d4174b2b on user Apr 11 19:24:31 user devstack@n-api.service[72090]: INFO nova.api.openstack.compute.server_external_events [req-3f649c52-4fa0-47c5-b7fa-62cf00fbd566 req-a5c28243-681f-46ec-a4e4-56aa7d21a279 service nova] Creating event network-vif-plugged:cde1df21-a053-49fd-a275-51926ac238e5 for instance 75a4ef96-a6c3-4ccd-9503-bab0d4174b2b on user Apr 11 19:24:31 user devstack@n-api.service[72090]: INFO nova.api.openstack.compute.server_external_events [req-3f649c52-4fa0-47c5-b7fa-62cf00fbd566 req-a5c28243-681f-46ec-a4e4-56aa7d21a279 service nova] Creating event network-vif-unplugged:8b7ae73d-744e-48fa-af96-b17e7dba1d58 for instance 75a4ef96-a6c3-4ccd-9503-bab0d4174b2b on user Apr 11 19:24:31 user devstack@n-api.service[72090]: INFO nova.api.openstack.compute.server_external_events [req-3f649c52-4fa0-47c5-b7fa-62cf00fbd566 req-a5c28243-681f-46ec-a4e4-56aa7d21a279 service nova] Creating event network-vif-plugged:8b7ae73d-744e-48fa-af96-b17e7dba1d58 for instance 75a4ef96-a6c3-4ccd-9503-bab0d4174b2b on user Apr 11 19:24:31 user devstack@n-api.service[72090]: INFO nova.api.openstack.compute.server_external_events [req-3f649c52-4fa0-47c5-b7fa-62cf00fbd566 req-a5c28243-681f-46ec-a4e4-56aa7d21a279 service nova] Creating event network-vif-deleted:8f3ff9dd-32cc-4b19-b059-4e4e3da4d3a7 for instance b71d95ed-728d-4386-b7c6-50b252718ca9 on user Apr 11 19:24:31 user devstack@n-api.service[72090]: INFO nova.api.openstack.compute.server_external_events [req-3f649c52-4fa0-47c5-b7fa-62cf00fbd566 req-a5c28243-681f-46ec-a4e4-56aa7d21a279 service nova] Creating event network-vif-unplugged:6503fe71-75d3-4388-9368-0de318a6d614 for instance 75a4ef96-a6c3-4ccd-9503-bab0d4174b2b on user Apr 11 19:24:31 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [req-3f649c52-4fa0-47c5-b7fa-62cf00fbd566 req-a5c28243-681f-46ec-a4e4-56aa7d21a279 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 1215 microversion: 2.1 time: 0.061152 Apr 11 19:24:31 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 76/239] 10.0.0.210 () {68 vars in 1395 bytes} [Tue Apr 11 19:24:31 2023] POST /compute/v2.1/os-server-external-events => generated 1215 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:24:33 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [None req-635c46eb-c3f7-4c06-8bdc-9b52d4f46313 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] Calling method '.version_select at 0x7f119db06560>' {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:24:33 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [None req-635c46eb-c3f7-4c06-8bdc-9b52d4f46313 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] 10.0.0.210 "GET /compute/v2.1/images/6a269858-cd4f-452f-ae3e-e35cf198749c" status: 200 len: 1722 microversion: 2.1 time: 0.056449 Apr 11 19:24:33 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 79/240] 10.0.0.210 () {62 vars in 1310 bytes} [Tue Apr 11 19:24:33 2023] GET /compute/v2.1/images/6a269858-cd4f-452f-ae3e-e35cf198749c => generated 1722 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:24:33 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [None req-abc7991a-8016-474d-9192-b9bcdd9112c7 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] Calling method '.version_select at 0x7f119db0ff40>' {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:24:33 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [None req-abc7991a-8016-474d-9192-b9bcdd9112c7 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] 10.0.0.210 "GET /compute/v2.1/images/6a269858-cd4f-452f-ae3e-e35cf198749c" status: 200 len: 1722 microversion: 2.1 time: 0.061867 Apr 11 19:24:33 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 86/241] 10.0.0.210 () {62 vars in 1310 bytes} [Tue Apr 11 19:24:33 2023] GET /compute/v2.1/images/6a269858-cd4f-452f-ae3e-e35cf198749c => generated 1722 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:24:33 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [None req-ae768a75-fca3-433d-b7c8-e791bbec69ba tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] Calling method '>' {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:24:33 user devstack@n-api.service[72090]: DEBUG nova.compute.api [None req-ae768a75-fca3-433d-b7c8-e791bbec69ba tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] [instance: aa0bb9aa-a93d-45bc-9f90-46eeb6416365] Fetching instance by UUID {{(pid=72090) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:24:33 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-ae768a75-fca3-433d-b7c8-e791bbec69ba tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:24:33 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-ae768a75-fca3-433d-b7c8-e791bbec69ba tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:24:33 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-ae768a75-fca3-433d-b7c8-e791bbec69ba tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:24:33 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-ae768a75-fca3-433d-b7c8-e791bbec69ba tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:24:33 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-ae768a75-fca3-433d-b7c8-e791bbec69ba tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:24:33 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-ae768a75-fca3-433d-b7c8-e791bbec69ba tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:24:33 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [None req-694e8661-ad49-4b61-a7a4-23ce6ea866fc tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] Calling method '>' {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:24:33 user devstack@n-api.service[72088]: DEBUG nova.compute.api [None req-694e8661-ad49-4b61-a7a4-23ce6ea866fc tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] [instance: a49d379e-3976-4d68-b6df-f572a922107c] Fetching instance by UUID {{(pid=72088) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:24:33 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-694e8661-ad49-4b61-a7a4-23ce6ea866fc tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:24:33 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-694e8661-ad49-4b61-a7a4-23ce6ea866fc tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:24:33 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-694e8661-ad49-4b61-a7a4-23ce6ea866fc tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:24:33 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-694e8661-ad49-4b61-a7a4-23ce6ea866fc tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:24:33 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-694e8661-ad49-4b61-a7a4-23ce6ea866fc tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:24:33 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-694e8661-ad49-4b61-a7a4-23ce6ea866fc tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:24:33 user devstack@n-api.service[72090]: DEBUG nova.policy [None req-ae768a75-fca3-433d-b7c8-e791bbec69ba tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26f091a1508b4d2689005b660f6a1380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ee7c68b277420ba524c2a99cd444ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72090) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:24:33 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [None req-694e8661-ad49-4b61-a7a4-23ce6ea866fc tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a49d379e-3976-4d68-b6df-f572a922107c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.065541 Apr 11 19:24:33 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 80/242] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Apr 11 19:24:33 2023] GET /compute/v2.1/servers/a49d379e-3976-4d68-b6df-f572a922107c/os-volume_attachments => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:24:33 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [None req-ae768a75-fca3-433d-b7c8-e791bbec69ba tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] 10.0.0.210 "GET /compute/v2.1/servers/aa0bb9aa-a93d-45bc-9f90-46eeb6416365" status: 200 len: 1671 microversion: 2.1 time: 0.233601 Apr 11 19:24:33 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 77/243] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 19:24:33 2023] GET /compute/v2.1/servers/aa0bb9aa-a93d-45bc-9f90-46eeb6416365 => generated 1671 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:24:33 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [None req-c1da34d0-ffc6-4543-9272-352566983bcf tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] Calling method '>' {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:24:33 user devstack@n-api.service[72089]: DEBUG nova.compute.api [None req-c1da34d0-ffc6-4543-9272-352566983bcf tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] [instance: a49d379e-3976-4d68-b6df-f572a922107c] Fetching instance by UUID {{(pid=72089) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:24:33 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-c1da34d0-ffc6-4543-9272-352566983bcf tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:24:33 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-c1da34d0-ffc6-4543-9272-352566983bcf tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:24:33 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-c1da34d0-ffc6-4543-9272-352566983bcf tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:24:33 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-c1da34d0-ffc6-4543-9272-352566983bcf tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:24:33 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-c1da34d0-ffc6-4543-9272-352566983bcf tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:24:33 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-c1da34d0-ffc6-4543-9272-352566983bcf tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:24:33 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [None req-c1da34d0-ffc6-4543-9272-352566983bcf tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a49d379e-3976-4d68-b6df-f572a922107c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047746 Apr 11 19:24:33 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 87/244] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Apr 11 19:24:33 2023] GET /compute/v2.1/servers/a49d379e-3976-4d68-b6df-f572a922107c/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:24:33 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [None req-fc69c446-9d1f-4057-80ca-090575b8f785 tempest-TestVolumeSwap-371271722 tempest-TestVolumeSwap-371271722-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "51e97579-56cc-414f-9a25-3a7c7d045694"}} {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:24:33 user devstack@n-api.service[72088]: DEBUG nova.compute.api [None req-fc69c446-9d1f-4057-80ca-090575b8f785 tempest-TestVolumeSwap-371271722 tempest-TestVolumeSwap-371271722-project-admin] [instance: a49d379e-3976-4d68-b6df-f572a922107c] Fetching instance by UUID {{(pid=72088) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:24:33 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-fc69c446-9d1f-4057-80ca-090575b8f785 tempest-TestVolumeSwap-371271722 tempest-TestVolumeSwap-371271722-project-admin] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:24:33 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-fc69c446-9d1f-4057-80ca-090575b8f785 tempest-TestVolumeSwap-371271722 tempest-TestVolumeSwap-371271722-project-admin] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:24:33 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-fc69c446-9d1f-4057-80ca-090575b8f785 tempest-TestVolumeSwap-371271722 tempest-TestVolumeSwap-371271722-project-admin] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:24:33 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-fc69c446-9d1f-4057-80ca-090575b8f785 tempest-TestVolumeSwap-371271722 tempest-TestVolumeSwap-371271722-project-admin] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:24:33 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-fc69c446-9d1f-4057-80ca-090575b8f785 tempest-TestVolumeSwap-371271722 tempest-TestVolumeSwap-371271722-project-admin] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:24:33 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-fc69c446-9d1f-4057-80ca-090575b8f785 tempest-TestVolumeSwap-371271722 tempest-TestVolumeSwap-371271722-project-admin] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:24:33 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [req-ec4221d9-c4c5-4106-9e7e-b465d0807c88 req-aec2b563-b58c-4758-a617-e136b8e08c01 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75a4ef96-a6c3-4ccd-9503-bab0d4174b2b", "name": "network-vif-plugged", "status": "completed", "tag": "6503fe71-75d3-4388-9368-0de318a6d614"}]} {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:24:33 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-ec4221d9-c4c5-4106-9e7e-b465d0807c88 req-aec2b563-b58c-4758-a617-e136b8e08c01 service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:24:33 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-ec4221d9-c4c5-4106-9e7e-b465d0807c88 req-aec2b563-b58c-4758-a617-e136b8e08c01 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:24:33 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-ec4221d9-c4c5-4106-9e7e-b465d0807c88 req-aec2b563-b58c-4758-a617-e136b8e08c01 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:24:33 user devstack@n-api.service[72090]: INFO nova.api.openstack.compute.server_external_events [req-ec4221d9-c4c5-4106-9e7e-b465d0807c88 req-aec2b563-b58c-4758-a617-e136b8e08c01 service nova] Creating event network-vif-plugged:6503fe71-75d3-4388-9368-0de318a6d614 for instance 75a4ef96-a6c3-4ccd-9503-bab0d4174b2b on user Apr 11 19:24:33 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [req-ec4221d9-c4c5-4106-9e7e-b465d0807c88 req-aec2b563-b58c-4758-a617-e136b8e08c01 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043987 Apr 11 19:24:33 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 78/245] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:24:33 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:24:34 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [None req-fc69c446-9d1f-4057-80ca-090575b8f785 tempest-TestVolumeSwap-371271722 tempest-TestVolumeSwap-371271722-project-admin] 10.0.0.210 "PUT /compute/v2.1/servers/a49d379e-3976-4d68-b6df-f572a922107c/os-volume_attachments/666f5f51-f96b-47f7-9acf-7d0b1c27ecd0" status: 202 len: 0 microversion: 2.1 time: 0.285617 Apr 11 19:24:34 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 81/246] 10.0.0.210 () {64 vars in 1510 bytes} [Tue Apr 11 19:24:33 2023] PUT /compute/v2.1/servers/a49d379e-3976-4d68-b6df-f572a922107c/os-volume_attachments/666f5f51-f96b-47f7-9acf-7d0b1c27ecd0 => generated 0 bytes in 287 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 19:24:35 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [req-60c6ff57-a0d8-4ff9-a0a4-a6e06f43fab1 req-156f7671-2c52-49ed-880f-540ba713a80a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75a4ef96-a6c3-4ccd-9503-bab0d4174b2b", "name": "network-vif-deleted", "tag": "6503fe71-75d3-4388-9368-0de318a6d614"}, {"server_uuid": "75a4ef96-a6c3-4ccd-9503-bab0d4174b2b", "name": "network-vif-deleted", "tag": "1f5ae163-b670-4418-b5d3-1f0b70fdd991"}, {"server_uuid": "75a4ef96-a6c3-4ccd-9503-bab0d4174b2b", "name": "network-vif-deleted", "tag": "8b7ae73d-744e-48fa-af96-b17e7dba1d58"}]} {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:24:35 user devstack@n-api.service[72089]: DEBUG dbcounter [-] [72089] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=2 {{(pid=72089) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:24:35 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-60c6ff57-a0d8-4ff9-a0a4-a6e06f43fab1 req-156f7671-2c52-49ed-880f-540ba713a80a service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:24:35 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-60c6ff57-a0d8-4ff9-a0a4-a6e06f43fab1 req-156f7671-2c52-49ed-880f-540ba713a80a service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:24:35 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-60c6ff57-a0d8-4ff9-a0a4-a6e06f43fab1 req-156f7671-2c52-49ed-880f-540ba713a80a service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:24:35 user devstack@n-api.service[72089]: INFO nova.api.openstack.compute.server_external_events [req-60c6ff57-a0d8-4ff9-a0a4-a6e06f43fab1 req-156f7671-2c52-49ed-880f-540ba713a80a service nova] Creating event network-vif-deleted:6503fe71-75d3-4388-9368-0de318a6d614 for instance 75a4ef96-a6c3-4ccd-9503-bab0d4174b2b on user Apr 11 19:24:35 user devstack@n-api.service[72089]: INFO nova.api.openstack.compute.server_external_events [req-60c6ff57-a0d8-4ff9-a0a4-a6e06f43fab1 req-156f7671-2c52-49ed-880f-540ba713a80a service nova] Creating event network-vif-deleted:1f5ae163-b670-4418-b5d3-1f0b70fdd991 for instance 75a4ef96-a6c3-4ccd-9503-bab0d4174b2b on user Apr 11 19:24:35 user devstack@n-api.service[72089]: INFO nova.api.openstack.compute.server_external_events [req-60c6ff57-a0d8-4ff9-a0a4-a6e06f43fab1 req-156f7671-2c52-49ed-880f-540ba713a80a service nova] Creating event network-vif-deleted:8b7ae73d-744e-48fa-af96-b17e7dba1d58 for instance 75a4ef96-a6c3-4ccd-9503-bab0d4174b2b on user Apr 11 19:24:36 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [req-60c6ff57-a0d8-4ff9-a0a4-a6e06f43fab1 req-156f7671-2c52-49ed-880f-540ba713a80a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.040354 Apr 11 19:24:36 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 88/247] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:24:35 2023] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:24:38 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [req-618540ce-1e69-47b9-8935-61e69c0c864c req-dc8a4590-62df-4015-9375-a54eb78e0223 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75a4ef96-a6c3-4ccd-9503-bab0d4174b2b", "name": "network-vif-deleted", "tag": "59314c6a-6d9a-4586-a8de-27a566e58eb4"}, {"server_uuid": "75a4ef96-a6c3-4ccd-9503-bab0d4174b2b", "name": "network-vif-deleted", "tag": "cde1df21-a053-49fd-a275-51926ac238e5"}]} {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:24:38 user devstack@n-api.service[72090]: DEBUG dbcounter [-] [72090] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=1 {{(pid=72090) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:24:38 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-618540ce-1e69-47b9-8935-61e69c0c864c req-dc8a4590-62df-4015-9375-a54eb78e0223 service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:24:38 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-618540ce-1e69-47b9-8935-61e69c0c864c req-dc8a4590-62df-4015-9375-a54eb78e0223 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:24:38 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-618540ce-1e69-47b9-8935-61e69c0c864c req-dc8a4590-62df-4015-9375-a54eb78e0223 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:24:38 user devstack@n-api.service[72090]: DEBUG dbcounter [-] [72090] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=72090) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:24:38 user devstack@n-api.service[72090]: INFO nova.api.openstack.compute.server_external_events [req-618540ce-1e69-47b9-8935-61e69c0c864c req-dc8a4590-62df-4015-9375-a54eb78e0223 service nova] Creating event network-vif-deleted:59314c6a-6d9a-4586-a8de-27a566e58eb4 for instance 75a4ef96-a6c3-4ccd-9503-bab0d4174b2b on user Apr 11 19:24:38 user devstack@n-api.service[72090]: INFO nova.api.openstack.compute.server_external_events [req-618540ce-1e69-47b9-8935-61e69c0c864c req-dc8a4590-62df-4015-9375-a54eb78e0223 service nova] Creating event network-vif-deleted:cde1df21-a053-49fd-a275-51926ac238e5 for instance 75a4ef96-a6c3-4ccd-9503-bab0d4174b2b on user Apr 11 19:24:38 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [req-618540ce-1e69-47b9-8935-61e69c0c864c req-dc8a4590-62df-4015-9375-a54eb78e0223 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.038814 Apr 11 19:24:38 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 79/248] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:24:38 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:24:39 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [None req-8d2de865-dd64-4782-aa35-f6d7952e6cbb tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Calling method '>' {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:24:39 user devstack@n-api.service[72088]: DEBUG nova.compute.api [None req-8d2de865-dd64-4782-aa35-f6d7952e6cbb tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] [instance: 53ccc829-6323-48ec-b63f-9de9bc607456] Fetching instance by UUID {{(pid=72088) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:24:39 user devstack@n-api.service[72088]: DEBUG dbcounter [-] [72088] Writing DB stats nova_api:SELECT=56,nova_api:UPDATE=1 {{(pid=72088) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:24:39 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-8d2de865-dd64-4782-aa35-f6d7952e6cbb tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:24:39 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-8d2de865-dd64-4782-aa35-f6d7952e6cbb tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:24:39 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-8d2de865-dd64-4782-aa35-f6d7952e6cbb tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:24:39 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-8d2de865-dd64-4782-aa35-f6d7952e6cbb tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:24:39 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-8d2de865-dd64-4782-aa35-f6d7952e6cbb tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:24:39 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-8d2de865-dd64-4782-aa35-f6d7952e6cbb tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:24:40 user devstack@n-api.service[72088]: DEBUG nova.policy [None req-8d2de865-dd64-4782-aa35-f6d7952e6cbb tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5d405421ceb4d99967ef2e7f55e7809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06966e2f4d3a4dec92282c7ad348635d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72088) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:24:40 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [None req-8d2de865-dd64-4782-aa35-f6d7952e6cbb tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] 10.0.0.210 "GET /compute/v2.1/servers/53ccc829-6323-48ec-b63f-9de9bc607456" status: 200 len: 1543 microversion: 2.1 time: 0.159190 Apr 11 19:24:40 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 82/249] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 19:24:39 2023] GET /compute/v2.1/servers/53ccc829-6323-48ec-b63f-9de9bc607456 => generated 1543 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:24:40 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [None req-aaee70bf-f6c9-4401-93b0-970706fe87ed tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Calling method '>' {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:24:40 user devstack@n-api.service[72089]: DEBUG nova.compute.api [None req-aaee70bf-f6c9-4401-93b0-970706fe87ed tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] [instance: d424f88d-5f82-4cac-aa0f-4f99624bd3e7] Fetching instance by UUID {{(pid=72089) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:24:40 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-aaee70bf-f6c9-4401-93b0-970706fe87ed tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:24:40 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-aaee70bf-f6c9-4401-93b0-970706fe87ed tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:24:40 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-aaee70bf-f6c9-4401-93b0-970706fe87ed tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:24:40 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-aaee70bf-f6c9-4401-93b0-970706fe87ed tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:24:40 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-aaee70bf-f6c9-4401-93b0-970706fe87ed tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:24:40 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-aaee70bf-f6c9-4401-93b0-970706fe87ed tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:24:41 user devstack@n-api.service[72089]: DEBUG nova.policy [None req-aaee70bf-f6c9-4401-93b0-970706fe87ed tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a32a5d0547141a180f655e98567ed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bceca6e3506e43f68f9cf8d0b56d141b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72089) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:24:41 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [None req-aaee70bf-f6c9-4401-93b0-970706fe87ed tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d424f88d-5f82-4cac-aa0f-4f99624bd3e7" status: 200 len: 1538 microversion: 2.1 time: 0.335016 Apr 11 19:24:41 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 89/250] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 19:24:40 2023] GET /compute/v2.1/servers/d424f88d-5f82-4cac-aa0f-4f99624bd3e7 => generated 1538 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:24:43 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [req-4d21323c-7cc7-4d4e-a23d-4ed1c98d39db req-1ddd2470-7a5c-48a6-803f-22243b8b3989 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d424f88d-5f82-4cac-aa0f-4f99624bd3e7", "tag": "93054605-985d-4168-9809-21feb31c1346"}]} {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:24:43 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-4d21323c-7cc7-4d4e-a23d-4ed1c98d39db req-1ddd2470-7a5c-48a6-803f-22243b8b3989 service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:24:43 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-4d21323c-7cc7-4d4e-a23d-4ed1c98d39db req-1ddd2470-7a5c-48a6-803f-22243b8b3989 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:24:43 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-4d21323c-7cc7-4d4e-a23d-4ed1c98d39db req-1ddd2470-7a5c-48a6-803f-22243b8b3989 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:24:43 user devstack@n-api.service[72090]: INFO nova.api.openstack.compute.server_external_events [req-4d21323c-7cc7-4d4e-a23d-4ed1c98d39db req-1ddd2470-7a5c-48a6-803f-22243b8b3989 service nova] Creating event network-changed:93054605-985d-4168-9809-21feb31c1346 for instance d424f88d-5f82-4cac-aa0f-4f99624bd3e7 on user Apr 11 19:24:43 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [req-4d21323c-7cc7-4d4e-a23d-4ed1c98d39db req-1ddd2470-7a5c-48a6-803f-22243b8b3989 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036820 Apr 11 19:24:43 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 80/251] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:24:43 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:24:44 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [None req-b69670ea-25e2-4b9f-957a-4f1e4d971c70 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6c80ed14-155b-4ad7-94d3-a2f3616e15a1"}} {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:24:44 user devstack@n-api.service[72088]: DEBUG nova.compute.api [None req-b69670ea-25e2-4b9f-957a-4f1e4d971c70 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] [instance: d424f88d-5f82-4cac-aa0f-4f99624bd3e7] Fetching instance by UUID {{(pid=72088) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:24:44 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-b69670ea-25e2-4b9f-957a-4f1e4d971c70 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:24:44 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-b69670ea-25e2-4b9f-957a-4f1e4d971c70 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:24:44 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-b69670ea-25e2-4b9f-957a-4f1e4d971c70 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:24:44 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-b69670ea-25e2-4b9f-957a-4f1e4d971c70 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:24:44 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-b69670ea-25e2-4b9f-957a-4f1e4d971c70 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:24:44 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-b69670ea-25e2-4b9f-957a-4f1e4d971c70 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:24:44 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [None req-b69670ea-25e2-4b9f-957a-4f1e4d971c70 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] 10.0.0.210 "POST /compute/v2.1/servers/d424f88d-5f82-4cac-aa0f-4f99624bd3e7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.335615 Apr 11 19:24:44 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 83/252] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Apr 11 19:24:44 2023] POST /compute/v2.1/servers/d424f88d-5f82-4cac-aa0f-4f99624bd3e7/os-volume_attachments => generated 194 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:24:44 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [None req-0bf012c0-e946-4abd-8e33-48e3b58267a7 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Action: 'create', calling method: .version_select at 0x7f119db0cee0>, body: {"keypair": {"name": "tempest-keypair-1431410116", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMOPD4tcuauGjUTVAuhtjF6Ujtk7F6BaqU+NEO4mmGMGLvyjwNgcmLISc53y0YOwfDCzVZpJizbGjjXjSyz46Q14bi5LzbNBxPb/IJFa2O26n4+/fWcXb8RJ3mMBruboVA=="}} {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:24:44 user devstack@n-api.service[72089]: DEBUG nova.quota [None req-0bf012c0-e946-4abd-8e33-48e3b58267a7 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Getting quotas for project d886d2ec5fc946b49af3c8ca7c8556c7. Resources: {'key_pairs'} {{(pid=72089) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 19:24:44 user devstack@n-api.service[72089]: DEBUG nova.quota [None req-0bf012c0-e946-4abd-8e33-48e3b58267a7 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Getting quotas for user 31c237e142784bd6aa460d6f1bf33400 and project d886d2ec5fc946b49af3c8ca7c8556c7. Resources: {'key_pairs'} {{(pid=72089) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 19:24:44 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [None req-0bf012c0-e946-4abd-8e33-48e3b58267a7 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.201174 Apr 11 19:24:44 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 90/253] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Apr 11 19:24:44 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:24:45 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [None req-93460b5f-df81-4ab1-a590-cf84e7522117 tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] Calling method '>' {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:24:45 user devstack@n-api.service[72090]: DEBUG nova.compute.api [None req-93460b5f-df81-4ab1-a590-cf84e7522117 tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] [instance: a49d379e-3976-4d68-b6df-f572a922107c] Fetching instance by UUID {{(pid=72090) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:24:45 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-93460b5f-df81-4ab1-a590-cf84e7522117 tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:24:45 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-93460b5f-df81-4ab1-a590-cf84e7522117 tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:24:45 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-93460b5f-df81-4ab1-a590-cf84e7522117 tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:24:45 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-93460b5f-df81-4ab1-a590-cf84e7522117 tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:24:45 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-93460b5f-df81-4ab1-a590-cf84e7522117 tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:24:45 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-93460b5f-df81-4ab1-a590-cf84e7522117 tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:24:45 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [None req-93460b5f-df81-4ab1-a590-cf84e7522117 tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a49d379e-3976-4d68-b6df-f572a922107c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048537 Apr 11 19:24:45 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 81/254] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Apr 11 19:24:45 2023] GET /compute/v2.1/servers/a49d379e-3976-4d68-b6df-f572a922107c/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:24:45 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [None req-d713a452-035e-4373-a9b5-24148e49b015 tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] Calling method '>' {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:24:45 user devstack@n-api.service[72088]: DEBUG nova.compute.api [None req-d713a452-035e-4373-a9b5-24148e49b015 tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] [instance: a49d379e-3976-4d68-b6df-f572a922107c] Fetching instance by UUID {{(pid=72088) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:24:45 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-d713a452-035e-4373-a9b5-24148e49b015 tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:24:45 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-d713a452-035e-4373-a9b5-24148e49b015 tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:24:45 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-d713a452-035e-4373-a9b5-24148e49b015 tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:24:45 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-d713a452-035e-4373-a9b5-24148e49b015 tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:24:45 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-d713a452-035e-4373-a9b5-24148e49b015 tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:24:45 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-d713a452-035e-4373-a9b5-24148e49b015 tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:24:46 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [None req-1eb5893b-887c-4cb6-8078-667528aabb74 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1133297397", "imageRef": "4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "5e65a1b0-a59c-43dd-abed-4aa020abdf5a"}], "security_groups": [{"name": "tempest-securitygroup--528003782"}], "key_name": "tempest-keypair-1431410116", "user_data": "}} {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:24:46 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [None req-d713a452-035e-4373-a9b5-24148e49b015 tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a49d379e-3976-4d68-b6df-f572a922107c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045641 Apr 11 19:24:46 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 84/255] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Apr 11 19:24:45 2023] GET /compute/v2.1/servers/a49d379e-3976-4d68-b6df-f572a922107c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:24:46 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [None req-38f3a85d-cd30-4de3-abc6-99a9d1b87fe2 tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] Calling method '>' {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:24:46 user devstack@n-api.service[72090]: DEBUG nova.compute.api [None req-38f3a85d-cd30-4de3-abc6-99a9d1b87fe2 tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] [instance: a49d379e-3976-4d68-b6df-f572a922107c] Fetching instance by UUID {{(pid=72090) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:24:46 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-38f3a85d-cd30-4de3-abc6-99a9d1b87fe2 tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:24:46 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-38f3a85d-cd30-4de3-abc6-99a9d1b87fe2 tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:24:46 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-38f3a85d-cd30-4de3-abc6-99a9d1b87fe2 tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:24:46 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-38f3a85d-cd30-4de3-abc6-99a9d1b87fe2 tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:24:46 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-38f3a85d-cd30-4de3-abc6-99a9d1b87fe2 tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:24:46 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-38f3a85d-cd30-4de3-abc6-99a9d1b87fe2 tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:24:46 user devstack@n-api.service[72089]: DEBUG nova.network.neutron [None req-1eb5893b-887c-4cb6-8078-667528aabb74 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] validate_networks() for [('5e65a1b0-a59c-43dd-abed-4aa020abdf5a', None, None, None, None, None)] {{(pid=72089) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 11 19:24:46 user devstack@n-api.service[72090]: DEBUG nova.objects.instance [None req-38f3a85d-cd30-4de3-abc6-99a9d1b87fe2 tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] Lazy-loading 'services' on Instance uuid a49d379e-3976-4d68-b6df-f572a922107c {{(pid=72090) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 11 19:24:46 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [None req-38f3a85d-cd30-4de3-abc6-99a9d1b87fe2 tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/a49d379e-3976-4d68-b6df-f572a922107c/os-volume_attachments/51e97579-56cc-414f-9a25-3a7c7d045694" status: 202 len: 0 microversion: 2.1 time: 0.221891 Apr 11 19:24:46 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 82/256] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Apr 11 19:24:46 2023] DELETE /compute/v2.1/servers/a49d379e-3976-4d68-b6df-f572a922107c/os-volume_attachments/51e97579-56cc-414f-9a25-3a7c7d045694 => generated 0 bytes in 223 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 19:24:46 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [None req-377db99c-06cd-40f1-8f8b-74b03b8155a3 tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] Calling method '>' {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:24:46 user devstack@n-api.service[72088]: DEBUG nova.compute.api [None req-377db99c-06cd-40f1-8f8b-74b03b8155a3 tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] [instance: a49d379e-3976-4d68-b6df-f572a922107c] Fetching instance by UUID {{(pid=72088) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:24:46 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-377db99c-06cd-40f1-8f8b-74b03b8155a3 tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:24:46 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-377db99c-06cd-40f1-8f8b-74b03b8155a3 tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:24:46 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-377db99c-06cd-40f1-8f8b-74b03b8155a3 tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:24:46 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-377db99c-06cd-40f1-8f8b-74b03b8155a3 tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:24:46 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-377db99c-06cd-40f1-8f8b-74b03b8155a3 tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:24:46 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-377db99c-06cd-40f1-8f8b-74b03b8155a3 tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:24:46 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [None req-377db99c-06cd-40f1-8f8b-74b03b8155a3 tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a49d379e-3976-4d68-b6df-f572a922107c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054843 Apr 11 19:24:46 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 85/257] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Apr 11 19:24:46 2023] GET /compute/v2.1/servers/a49d379e-3976-4d68-b6df-f572a922107c/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:24:46 user devstack@n-api.service[72089]: DEBUG nova.virt.hardware [None req-1eb5893b-887c-4cb6-8078-667528aabb74 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Flavor limits 0:0:0 {{(pid=72089) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 19:24:46 user devstack@n-api.service[72089]: DEBUG nova.virt.hardware [None req-1eb5893b-887c-4cb6-8078-667528aabb74 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Image limits 0:0:0 {{(pid=72089) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 19:24:46 user devstack@n-api.service[72089]: DEBUG nova.virt.hardware [None req-1eb5893b-887c-4cb6-8078-667528aabb74 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Flavor pref 0:0:0 {{(pid=72089) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 19:24:46 user devstack@n-api.service[72089]: DEBUG nova.virt.hardware [None req-1eb5893b-887c-4cb6-8078-667528aabb74 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Image pref 0:0:0 {{(pid=72089) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 19:24:46 user devstack@n-api.service[72089]: DEBUG nova.virt.hardware [None req-1eb5893b-887c-4cb6-8078-667528aabb74 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72089) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 19:24:46 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-1eb5893b-887c-4cb6-8078-667528aabb74 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:24:46 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-1eb5893b-887c-4cb6-8078-667528aabb74 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:24:46 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-1eb5893b-887c-4cb6-8078-667528aabb74 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:24:46 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-1eb5893b-887c-4cb6-8078-667528aabb74 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:24:46 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-1eb5893b-887c-4cb6-8078-667528aabb74 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:24:46 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-1eb5893b-887c-4cb6-8078-667528aabb74 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:24:46 user devstack@n-api.service[72089]: DEBUG nova.quota [None req-1eb5893b-887c-4cb6-8078-667528aabb74 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Getting quotas for project d886d2ec5fc946b49af3c8ca7c8556c7. Resources: {'ram', 'instances', 'cores'} {{(pid=72089) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 19:24:46 user devstack@n-api.service[72089]: DEBUG nova.quota [None req-1eb5893b-887c-4cb6-8078-667528aabb74 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Getting quotas for user 31c237e142784bd6aa460d6f1bf33400 and project d886d2ec5fc946b49af3c8ca7c8556c7. Resources: {'ram', 'instances', 'cores'} {{(pid=72089) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 19:24:46 user devstack@n-api.service[72089]: DEBUG nova.compute.api [None req-1eb5893b-887c-4cb6-8078-667528aabb74 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Going to run 1 instances... {{(pid=72089) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 11 19:24:46 user devstack@n-api.service[72089]: DEBUG nova.compute.api [None req-1eb5893b-887c-4cb6-8078-667528aabb74 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] [instance: 6802f099-9236-4c79-a892-2963f1b15b0e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=72089) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 11 19:24:46 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [None req-1eb5893b-887c-4cb6-8078-667528aabb74 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 399 microversion: 2.1 time: 0.600692 Apr 11 19:24:46 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 91/258] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 11 19:24:46 2023] POST /compute/v2.1/servers => generated 399 bytes in 602 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 11 19:24:46 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [None req-543a77d0-d63b-4ee0-b256-d5765ae3e355 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Calling method '>' {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:24:46 user devstack@n-api.service[72090]: DEBUG nova.compute.api [None req-543a77d0-d63b-4ee0-b256-d5765ae3e355 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] [instance: 6802f099-9236-4c79-a892-2963f1b15b0e] Fetching instance by UUID {{(pid=72090) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:24:46 user devstack@n-api.service[72090]: DEBUG nova.policy [None req-543a77d0-d63b-4ee0-b256-d5765ae3e355 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31c237e142784bd6aa460d6f1bf33400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd886d2ec5fc946b49af3c8ca7c8556c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72090) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:24:46 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [None req-543a77d0-d63b-4ee0-b256-d5765ae3e355 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6802f099-9236-4c79-a892-2963f1b15b0e" status: 200 len: 1232 microversion: 2.1 time: 0.069374 Apr 11 19:24:46 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 83/259] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 19:24:46 2023] GET /compute/v2.1/servers/6802f099-9236-4c79-a892-2963f1b15b0e => generated 1232 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:24:49 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [req-e07c1890-7b00-4222-a03e-f21d9e068787 req-8bbb149c-a45b-405b-97c2-c8897aa0bd1e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6802f099-9236-4c79-a892-2963f1b15b0e", "tag": "6193819b-0c1b-476b-b89e-dbbfc7938fc5"}]} {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:24:49 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-e07c1890-7b00-4222-a03e-f21d9e068787 req-8bbb149c-a45b-405b-97c2-c8897aa0bd1e service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:24:49 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-e07c1890-7b00-4222-a03e-f21d9e068787 req-8bbb149c-a45b-405b-97c2-c8897aa0bd1e service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:24:49 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-e07c1890-7b00-4222-a03e-f21d9e068787 req-8bbb149c-a45b-405b-97c2-c8897aa0bd1e service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:24:49 user devstack@n-api.service[72088]: INFO nova.api.openstack.compute.server_external_events [req-e07c1890-7b00-4222-a03e-f21d9e068787 req-8bbb149c-a45b-405b-97c2-c8897aa0bd1e service nova] Creating event network-changed:6193819b-0c1b-476b-b89e-dbbfc7938fc5 for instance 6802f099-9236-4c79-a892-2963f1b15b0e on user Apr 11 19:24:49 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [req-e07c1890-7b00-4222-a03e-f21d9e068787 req-8bbb149c-a45b-405b-97c2-c8897aa0bd1e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029017 Apr 11 19:24:49 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 86/260] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:24:49 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:24:51 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [None req-59aabd2e-c00f-4fac-bd90-24c6f639894e tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Calling method '>' {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:24:51 user devstack@n-api.service[72089]: DEBUG nova.compute.api [None req-59aabd2e-c00f-4fac-bd90-24c6f639894e tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] [instance: d424f88d-5f82-4cac-aa0f-4f99624bd3e7] Fetching instance by UUID {{(pid=72089) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:24:51 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-59aabd2e-c00f-4fac-bd90-24c6f639894e tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:24:51 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-59aabd2e-c00f-4fac-bd90-24c6f639894e tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:24:51 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-59aabd2e-c00f-4fac-bd90-24c6f639894e tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:24:51 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-59aabd2e-c00f-4fac-bd90-24c6f639894e tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:24:51 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-59aabd2e-c00f-4fac-bd90-24c6f639894e tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:24:51 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-59aabd2e-c00f-4fac-bd90-24c6f639894e tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:24:51 user devstack@n-api.service[72089]: DEBUG nova.objects.instance [None req-59aabd2e-c00f-4fac-bd90-24c6f639894e tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Lazy-loading 'services' on Instance uuid d424f88d-5f82-4cac-aa0f-4f99624bd3e7 {{(pid=72089) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 11 19:24:52 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [req-906ca546-340d-4c9f-891d-2ca20f4e7d0c req-b04d8cfc-ee20-428c-b267-7088e4df39ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6802f099-9236-4c79-a892-2963f1b15b0e", "name": "network-vif-plugged", "status": "completed", "tag": "6193819b-0c1b-476b-b89e-dbbfc7938fc5"}]} {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:24:52 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-906ca546-340d-4c9f-891d-2ca20f4e7d0c req-b04d8cfc-ee20-428c-b267-7088e4df39ec service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:24:52 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-906ca546-340d-4c9f-891d-2ca20f4e7d0c req-b04d8cfc-ee20-428c-b267-7088e4df39ec service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:24:52 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-906ca546-340d-4c9f-891d-2ca20f4e7d0c req-b04d8cfc-ee20-428c-b267-7088e4df39ec service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:24:52 user devstack@n-api.service[72090]: INFO nova.api.openstack.compute.server_external_events [req-906ca546-340d-4c9f-891d-2ca20f4e7d0c req-b04d8cfc-ee20-428c-b267-7088e4df39ec service nova] Creating event network-vif-plugged:6193819b-0c1b-476b-b89e-dbbfc7938fc5 for instance 6802f099-9236-4c79-a892-2963f1b15b0e on user Apr 11 19:24:52 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [req-906ca546-340d-4c9f-891d-2ca20f4e7d0c req-b04d8cfc-ee20-428c-b267-7088e4df39ec service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028206 Apr 11 19:24:52 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 84/261] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:24:52 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:24:52 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [None req-59aabd2e-c00f-4fac-bd90-24c6f639894e tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/d424f88d-5f82-4cac-aa0f-4f99624bd3e7/os-volume_attachments/6c80ed14-155b-4ad7-94d3-a2f3616e15a1" status: 202 len: 0 microversion: 2.1 time: 0.251848 Apr 11 19:24:52 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 92/262] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Apr 11 19:24:51 2023] DELETE /compute/v2.1/servers/d424f88d-5f82-4cac-aa0f-4f99624bd3e7/os-volume_attachments/6c80ed14-155b-4ad7-94d3-a2f3616e15a1 => generated 0 bytes in 254 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 19:24:52 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [None req-628dc2ac-eb90-4fb0-97af-8e6dfa777ced tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Calling method '>' {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:24:52 user devstack@n-api.service[72088]: DEBUG nova.compute.api [None req-628dc2ac-eb90-4fb0-97af-8e6dfa777ced tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] [instance: d424f88d-5f82-4cac-aa0f-4f99624bd3e7] Fetching instance by UUID {{(pid=72088) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:24:52 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-628dc2ac-eb90-4fb0-97af-8e6dfa777ced tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:24:52 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-628dc2ac-eb90-4fb0-97af-8e6dfa777ced tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:24:52 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-628dc2ac-eb90-4fb0-97af-8e6dfa777ced tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:24:52 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-628dc2ac-eb90-4fb0-97af-8e6dfa777ced tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:24:52 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-628dc2ac-eb90-4fb0-97af-8e6dfa777ced tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:24:52 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-628dc2ac-eb90-4fb0-97af-8e6dfa777ced tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:24:52 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [None req-628dc2ac-eb90-4fb0-97af-8e6dfa777ced tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d424f88d-5f82-4cac-aa0f-4f99624bd3e7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.062407 Apr 11 19:24:52 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 87/263] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Apr 11 19:24:52 2023] GET /compute/v2.1/servers/d424f88d-5f82-4cac-aa0f-4f99624bd3e7/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:24:54 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [req-7c62a8f7-4738-4f6d-a500-9d768cdc0c04 req-64fbabe8-de3c-4aad-af5c-1165799ed566 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6802f099-9236-4c79-a892-2963f1b15b0e", "name": "network-vif-plugged", "status": "completed", "tag": "6193819b-0c1b-476b-b89e-dbbfc7938fc5"}]} {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:24:54 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-7c62a8f7-4738-4f6d-a500-9d768cdc0c04 req-64fbabe8-de3c-4aad-af5c-1165799ed566 service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:24:54 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-7c62a8f7-4738-4f6d-a500-9d768cdc0c04 req-64fbabe8-de3c-4aad-af5c-1165799ed566 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:24:54 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-7c62a8f7-4738-4f6d-a500-9d768cdc0c04 req-64fbabe8-de3c-4aad-af5c-1165799ed566 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:24:54 user devstack@n-api.service[72090]: INFO nova.api.openstack.compute.server_external_events [req-7c62a8f7-4738-4f6d-a500-9d768cdc0c04 req-64fbabe8-de3c-4aad-af5c-1165799ed566 service nova] Creating event network-vif-plugged:6193819b-0c1b-476b-b89e-dbbfc7938fc5 for instance 6802f099-9236-4c79-a892-2963f1b15b0e on user Apr 11 19:24:54 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [req-7c62a8f7-4738-4f6d-a500-9d768cdc0c04 req-64fbabe8-de3c-4aad-af5c-1165799ed566 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035810 Apr 11 19:24:54 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 85/264] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:24:54 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:25:02 user devstack@n-api.service[72089]: DEBUG dbcounter [-] [72089] Writing DB stats nova_cell0:SELECT=2 {{(pid=72089) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:25:02 user devstack@n-api.service[72089]: DEBUG dbcounter [-] [72089] Writing DB stats nova_cell0:SELECT=10 {{(pid=72089) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:25:02 user devstack@n-api.service[72089]: DEBUG dbcounter [-] [72089] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=4 {{(pid=72089) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:25:02 user devstack@n-api.service[72089]: DEBUG dbcounter [-] [72089] Writing DB stats nova_cell1:SELECT=69,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=72089) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:25:02 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [None req-9740041a-8263-4e81-b4aa-909c6d9292a8 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] Calling method '>' {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:25:02 user devstack@n-api.service[72089]: DEBUG nova.compute.api [None req-9740041a-8263-4e81-b4aa-909c6d9292a8 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] [instance: dde6b4d2-9288-474c-b400-ce3b6f393b24] Fetching instance by UUID {{(pid=72089) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:25:02 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-9740041a-8263-4e81-b4aa-909c6d9292a8 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:25:02 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-9740041a-8263-4e81-b4aa-909c6d9292a8 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:25:02 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-9740041a-8263-4e81-b4aa-909c6d9292a8 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:25:02 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-9740041a-8263-4e81-b4aa-909c6d9292a8 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:25:02 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-9740041a-8263-4e81-b4aa-909c6d9292a8 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:25:02 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-9740041a-8263-4e81-b4aa-909c6d9292a8 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:25:02 user devstack@n-api.service[72089]: INFO nova.api.openstack.wsgi [None req-9740041a-8263-4e81-b4aa-909c6d9292a8 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] HTTP exception thrown: Instance dde6b4d2-9288-474c-b400-ce3b6f393b24 could not be found. Apr 11 19:25:02 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [None req-9740041a-8263-4e81-b4aa-909c6d9292a8 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] Request method failure captured: Apr 11 19:25:02 user devstack@n-api.service[72089]: request: GET /compute/v2.1/servers/dde6b4d2-9288-474c-b400-ce3b6f393b24 HTTP/1.1 Apr 11 19:25:02 user devstack@n-api.service[72089]: Accept: application/json Apr 11 19:25:02 user devstack@n-api.service[72089]: Accept-Encoding: identity Apr 11 19:25:02 user devstack@n-api.service[72089]: Connection: close Apr 11 19:25:02 user devstack@n-api.service[72089]: Content-Length: 0 Apr 11 19:25:02 user devstack@n-api.service[72089]: Content-Type: application/json Apr 11 19:25:02 user devstack@n-api.service[72089]: Host: 10.0.0.210 Apr 11 19:25:02 user devstack@n-api.service[72089]: Openstack-System-Scope: None Apr 11 19:25:02 user devstack@n-api.service[72089]: User-Agent: python-urllib3/1.26.15 Apr 11 19:25:02 user devstack@n-api.service[72089]: X-Auth-Token: gAAAAABkNbM8Vsqqe8dNH64RIo-f1nvoYcew7Q9GbjqCkmUyLkKtKrODZSpC2Mxxng1EJJjtaGxIZp4dL_NRsI1aqGxIpHzb1qGh45vg9gGgcbsnka9g7A1DJ0AWfGAovmO-FT2SQsh1WwzRAxPO02QmCG6IC7BPoiGCkrPyuuNHQEDkrBI7ppY Apr 11 19:25:02 user devstack@n-api.service[72089]: X-Domain-Id: None Apr 11 19:25:02 user devstack@n-api.service[72089]: X-Domain-Name: None Apr 11 19:25:02 user devstack@n-api.service[72089]: X-Identity-Status: Confirmed Apr 11 19:25:02 user devstack@n-api.service[72089]: X-Is-Admin-Project: True Apr 11 19:25:02 user devstack@n-api.service[72089]: X-Openstack-Nova-Api-Version: 2.42 Apr 11 19:25:02 user devstack@n-api.service[72089]: X-Project-Domain-Id: default Apr 11 19:25:02 user devstack@n-api.service[72089]: X-Project-Domain-Name: Default Apr 11 19:25:02 user devstack@n-api.service[72089]: X-Project-Id: 1afa97b49ae647c899a05d54b7f0f16b Apr 11 19:25:02 user devstack@n-api.service[72089]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-1381679461 Apr 11 19:25:02 user devstack@n-api.service[72089]: X-Role: reader,member Apr 11 19:25:02 user devstack@n-api.service[72089]: X-Roles: reader,member Apr 11 19:25:02 user devstack@n-api.service[72089]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/1afa97b49ae647c899a05d54b7f0f16b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/1afa97b49ae647c899a05d54b7f0f16b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/1afa97b49ae647c899a05d54b7f0f16b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 11 19:25:02 user devstack@n-api.service[72089]: X-Tenant: tempest-TaggedBootDevicesTest_v242-1381679461 Apr 11 19:25:02 user devstack@n-api.service[72089]: X-Tenant-Id: 1afa97b49ae647c899a05d54b7f0f16b Apr 11 19:25:02 user devstack@n-api.service[72089]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-1381679461 Apr 11 19:25:02 user devstack@n-api.service[72089]: X-User: tempest-TaggedBootDevicesTest_v242-1381679461-project-member Apr 11 19:25:02 user devstack@n-api.service[72089]: X-User-Domain-Id: default Apr 11 19:25:02 user devstack@n-api.service[72089]: X-User-Domain-Name: Default Apr 11 19:25:02 user devstack@n-api.service[72089]: X-User-Id: 2f44f0d0807342ba9b851e7530a82294 Apr 11 19:25:02 user devstack@n-api.service[72089]: X-User-Name: tempest-TaggedBootDevicesTest_v242-1381679461-project-member Apr 11 19:25:02 user devstack@n-api.service[72089]: method: > Apr 11 19:25:02 user devstack@n-api.service[72089]: exception: Instance dde6b4d2-9288-474c-b400-ce3b6f393b24 could not be found. Apr 11 19:25:02 user devstack@n-api.service[72089]: action_args: {'id': 'dde6b4d2-9288-474c-b400-ce3b6f393b24'} Apr 11 19:25:02 user devstack@n-api.service[72089]: {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 19:25:02 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:25:02 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 19:25:02 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 19:25:02 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 19:25:02 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 19:25:02 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 19:25:02 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 19:25:02 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 19:25:02 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 19:25:02 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dde6b4d2-9288-474c-b400-ce3b6f393b24 could not be found. Apr 11 19:25:02 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi Apr 11 19:25:02 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 19:25:02 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi Apr 11 19:25:02 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:25:02 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 19:25:02 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 19:25:02 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 19:25:02 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 19:25:02 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 19:25:02 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 19:25:02 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 19:25:02 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 19:25:02 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 19:25:02 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 19:25:02 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 19:25:02 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 19:25:02 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dde6b4d2-9288-474c-b400-ce3b6f393b24 could not be found. Apr 11 19:25:02 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi Apr 11 19:25:02 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 19:25:02 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi Apr 11 19:25:02 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:25:02 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 19:25:02 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 19:25:02 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 19:25:02 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 19:25:02 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dde6b4d2-9288-474c-b400-ce3b6f393b24 could not be found. Apr 11 19:25:02 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi Apr 11 19:25:02 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [None req-9740041a-8263-4e81-b4aa-909c6d9292a8 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] Returning 404 to user: Instance dde6b4d2-9288-474c-b400-ce3b6f393b24 could not be found. {{(pid=72089) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 19:25:02 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [None req-9740041a-8263-4e81-b4aa-909c6d9292a8 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] 10.0.0.210 "GET /compute/v2.1/servers/dde6b4d2-9288-474c-b400-ce3b6f393b24" status: 404 len: 111 microversion: 2.42 time: 0.043725 Apr 11 19:25:02 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 93/265] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 19:25:02 2023] GET /compute/v2.1/servers/dde6b4d2-9288-474c-b400-ce3b6f393b24 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 11 19:25:02 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [None req-9e088f75-6d85-4cdb-9b4e-fa013fe9933e tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] Calling method '.version_select at 0x7f119de26290>' {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:25:02 user devstack@n-api.service[72088]: DEBUG dbcounter [-] [72088] Writing DB stats nova_api:SELECT=11 {{(pid=72088) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:25:02 user devstack@n-api.service[72088]: DEBUG dbcounter [-] [72088] Writing DB stats nova_cell1:SELECT=68,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=72088) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:25:02 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [None req-9e088f75-6d85-4cdb-9b4e-fa013fe9933e tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-791454951" status: 204 len: 0 microversion: 2.42 time: 0.029082 Apr 11 19:25:02 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 88/266] 10.0.0.210 () {64 vars in 1336 bytes} [Tue Apr 11 19:25:02 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-791454951 => generated 0 bytes in 30 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 11 19:25:05 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [None req-65370891-1cdf-43c6-854e-aecef0e92276 tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] Calling method '>' {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:25:05 user devstack@n-api.service[72090]: DEBUG nova.compute.api [None req-65370891-1cdf-43c6-854e-aecef0e92276 tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] [instance: 8e449d09-f632-4f57-b304-430734096596] Fetching instance by UUID {{(pid=72090) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:25:05 user devstack@n-api.service[72090]: DEBUG dbcounter [-] [72090] Writing DB stats nova_cell0:SELECT=2 {{(pid=72090) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:25:05 user devstack@n-api.service[72090]: DEBUG dbcounter [-] [72090] Writing DB stats nova_api:SELECT=15 {{(pid=72090) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:25:05 user devstack@n-api.service[72090]: DEBUG dbcounter [-] [72090] Writing DB stats nova_cell1:SELECT=22,nova_cell1:INSERT=1 {{(pid=72090) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:25:05 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-65370891-1cdf-43c6-854e-aecef0e92276 tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:25:05 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-65370891-1cdf-43c6-854e-aecef0e92276 tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:25:05 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-65370891-1cdf-43c6-854e-aecef0e92276 tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:25:05 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-65370891-1cdf-43c6-854e-aecef0e92276 tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:25:05 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-65370891-1cdf-43c6-854e-aecef0e92276 tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:25:05 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-65370891-1cdf-43c6-854e-aecef0e92276 tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:25:05 user devstack@n-api.service[72090]: INFO nova.api.openstack.wsgi [None req-65370891-1cdf-43c6-854e-aecef0e92276 tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] HTTP exception thrown: Instance 8e449d09-f632-4f57-b304-430734096596 could not be found. Apr 11 19:25:05 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [None req-65370891-1cdf-43c6-854e-aecef0e92276 tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] Request method failure captured: Apr 11 19:25:05 user devstack@n-api.service[72090]: request: GET /compute/v2.1/servers/8e449d09-f632-4f57-b304-430734096596 HTTP/1.1 Apr 11 19:25:05 user devstack@n-api.service[72090]: Accept: application/json Apr 11 19:25:05 user devstack@n-api.service[72090]: Accept-Encoding: identity Apr 11 19:25:05 user devstack@n-api.service[72090]: Connection: close Apr 11 19:25:05 user devstack@n-api.service[72090]: Content-Length: 0 Apr 11 19:25:05 user devstack@n-api.service[72090]: Content-Type: application/json Apr 11 19:25:05 user devstack@n-api.service[72090]: Host: 10.0.0.210 Apr 11 19:25:05 user devstack@n-api.service[72090]: Openstack-System-Scope: None Apr 11 19:25:05 user devstack@n-api.service[72090]: User-Agent: python-urllib3/1.26.15 Apr 11 19:25:05 user devstack@n-api.service[72090]: X-Auth-Token: gAAAAABkNbNssWeW5lBXgEzyBx-Vjb8Ttkfyn1j_WiXhLp2AkyHxAuIaz9lQtAEypBexf7LpEidcAOU79EqZjAkQHeP9iLR0rXVFmB6W9Q_s1Ek9r7UHOto1ZteB50mRtwpnUHelyUMzQcbH-Giz5k67LiMRuL9CkxuW6muRa5gAv_3CiHsBdJI Apr 11 19:25:05 user devstack@n-api.service[72090]: X-Domain-Id: None Apr 11 19:25:05 user devstack@n-api.service[72090]: X-Domain-Name: None Apr 11 19:25:05 user devstack@n-api.service[72090]: X-Identity-Status: Confirmed Apr 11 19:25:05 user devstack@n-api.service[72090]: X-Is-Admin-Project: True Apr 11 19:25:05 user devstack@n-api.service[72090]: X-Project-Domain-Id: default Apr 11 19:25:05 user devstack@n-api.service[72090]: X-Project-Domain-Name: Default Apr 11 19:25:05 user devstack@n-api.service[72090]: X-Project-Id: 7543456a70d04d7f8c50f37e64b7ee9c Apr 11 19:25:05 user devstack@n-api.service[72090]: X-Project-Name: tempest-VolumesActionsTest-2124197416 Apr 11 19:25:05 user devstack@n-api.service[72090]: X-Role: reader,member Apr 11 19:25:05 user devstack@n-api.service[72090]: X-Roles: reader,member Apr 11 19:25:05 user devstack@n-api.service[72090]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/7543456a70d04d7f8c50f37e64b7ee9c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/7543456a70d04d7f8c50f37e64b7ee9c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/7543456a70d04d7f8c50f37e64b7ee9c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 11 19:25:05 user devstack@n-api.service[72090]: X-Tenant: tempest-VolumesActionsTest-2124197416 Apr 11 19:25:05 user devstack@n-api.service[72090]: X-Tenant-Id: 7543456a70d04d7f8c50f37e64b7ee9c Apr 11 19:25:05 user devstack@n-api.service[72090]: X-Tenant-Name: tempest-VolumesActionsTest-2124197416 Apr 11 19:25:05 user devstack@n-api.service[72090]: X-User: tempest-VolumesActionsTest-2124197416-project-member Apr 11 19:25:05 user devstack@n-api.service[72090]: X-User-Domain-Id: default Apr 11 19:25:05 user devstack@n-api.service[72090]: X-User-Domain-Name: Default Apr 11 19:25:05 user devstack@n-api.service[72090]: X-User-Id: 7c9641ceb17e4914b1cdf061c5bdc79f Apr 11 19:25:05 user devstack@n-api.service[72090]: X-User-Name: tempest-VolumesActionsTest-2124197416-project-member Apr 11 19:25:05 user devstack@n-api.service[72090]: method: > Apr 11 19:25:05 user devstack@n-api.service[72090]: exception: Instance 8e449d09-f632-4f57-b304-430734096596 could not be found. Apr 11 19:25:05 user devstack@n-api.service[72090]: action_args: {'id': '8e449d09-f632-4f57-b304-430734096596'} Apr 11 19:25:05 user devstack@n-api.service[72090]: {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 19:25:05 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:25:05 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 19:25:05 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 19:25:05 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 19:25:05 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 19:25:05 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 19:25:05 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 19:25:05 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 19:25:05 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 19:25:05 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8e449d09-f632-4f57-b304-430734096596 could not be found. Apr 11 19:25:05 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi Apr 11 19:25:05 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 19:25:05 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi Apr 11 19:25:05 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:25:05 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 19:25:05 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 19:25:05 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 19:25:05 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 19:25:05 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 19:25:05 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 19:25:05 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 19:25:05 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 19:25:05 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 19:25:05 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 19:25:05 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 19:25:05 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 19:25:05 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8e449d09-f632-4f57-b304-430734096596 could not be found. Apr 11 19:25:05 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi Apr 11 19:25:05 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 19:25:05 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi Apr 11 19:25:05 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:25:05 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 19:25:05 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 19:25:05 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 19:25:05 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 19:25:05 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8e449d09-f632-4f57-b304-430734096596 could not be found. Apr 11 19:25:05 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi Apr 11 19:25:05 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [None req-65370891-1cdf-43c6-854e-aecef0e92276 tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] Returning 404 to user: Instance 8e449d09-f632-4f57-b304-430734096596 could not be found. {{(pid=72090) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 19:25:05 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [None req-65370891-1cdf-43c6-854e-aecef0e92276 tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8e449d09-f632-4f57-b304-430734096596" status: 404 len: 111 microversion: 2.1 time: 0.040123 Apr 11 19:25:05 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 86/267] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 19:25:05 2023] GET /compute/v2.1/servers/8e449d09-f632-4f57-b304-430734096596 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 19:25:05 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [None req-80a61453-e6e8-432a-b514-c7d283feccbd tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1079797334", "imageRef": "4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b", "flavorRef": "42", "networks": [{"uuid": "93340493-e74d-43fd-9b4c-ddd0217720be"}]}} {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:25:05 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [None req-09abf39b-4c26-46eb-92e3-52c9b2b41f2c tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] Calling method '>' {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:25:05 user devstack@n-api.service[72088]: DEBUG nova.compute.api [None req-09abf39b-4c26-46eb-92e3-52c9b2b41f2c tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] [instance: dde6b4d2-9288-474c-b400-ce3b6f393b24] Fetching instance by UUID {{(pid=72088) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:25:05 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-09abf39b-4c26-46eb-92e3-52c9b2b41f2c tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:25:05 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-09abf39b-4c26-46eb-92e3-52c9b2b41f2c tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:25:05 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-09abf39b-4c26-46eb-92e3-52c9b2b41f2c tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:25:05 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-09abf39b-4c26-46eb-92e3-52c9b2b41f2c tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:25:05 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-09abf39b-4c26-46eb-92e3-52c9b2b41f2c tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:25:05 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-09abf39b-4c26-46eb-92e3-52c9b2b41f2c tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:25:05 user devstack@n-api.service[72088]: INFO nova.api.openstack.wsgi [None req-09abf39b-4c26-46eb-92e3-52c9b2b41f2c tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] HTTP exception thrown: Instance dde6b4d2-9288-474c-b400-ce3b6f393b24 could not be found. Apr 11 19:25:05 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [None req-09abf39b-4c26-46eb-92e3-52c9b2b41f2c tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] Request method failure captured: Apr 11 19:25:05 user devstack@n-api.service[72088]: request: DELETE /compute/v2.1/servers/dde6b4d2-9288-474c-b400-ce3b6f393b24 HTTP/1.1 Apr 11 19:25:05 user devstack@n-api.service[72088]: Accept: application/json Apr 11 19:25:05 user devstack@n-api.service[72088]: Accept-Encoding: identity Apr 11 19:25:05 user devstack@n-api.service[72088]: Connection: close Apr 11 19:25:05 user devstack@n-api.service[72088]: Content-Length: 0 Apr 11 19:25:05 user devstack@n-api.service[72088]: Content-Type: application/json Apr 11 19:25:05 user devstack@n-api.service[72088]: Host: 10.0.0.210 Apr 11 19:25:05 user devstack@n-api.service[72088]: Openstack-System-Scope: None Apr 11 19:25:05 user devstack@n-api.service[72088]: User-Agent: python-urllib3/1.26.15 Apr 11 19:25:05 user devstack@n-api.service[72088]: X-Auth-Token: gAAAAABkNbM8Vsqqe8dNH64RIo-f1nvoYcew7Q9GbjqCkmUyLkKtKrODZSpC2Mxxng1EJJjtaGxIZp4dL_NRsI1aqGxIpHzb1qGh45vg9gGgcbsnka9g7A1DJ0AWfGAovmO-FT2SQsh1WwzRAxPO02QmCG6IC7BPoiGCkrPyuuNHQEDkrBI7ppY Apr 11 19:25:05 user devstack@n-api.service[72088]: X-Domain-Id: None Apr 11 19:25:05 user devstack@n-api.service[72088]: X-Domain-Name: None Apr 11 19:25:05 user devstack@n-api.service[72088]: X-Identity-Status: Confirmed Apr 11 19:25:05 user devstack@n-api.service[72088]: X-Is-Admin-Project: True Apr 11 19:25:05 user devstack@n-api.service[72088]: X-Openstack-Nova-Api-Version: 2.42 Apr 11 19:25:05 user devstack@n-api.service[72088]: X-Project-Domain-Id: default Apr 11 19:25:05 user devstack@n-api.service[72088]: X-Project-Domain-Name: Default Apr 11 19:25:05 user devstack@n-api.service[72088]: X-Project-Id: 1afa97b49ae647c899a05d54b7f0f16b Apr 11 19:25:05 user devstack@n-api.service[72088]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-1381679461 Apr 11 19:25:05 user devstack@n-api.service[72088]: X-Role: reader,member Apr 11 19:25:05 user devstack@n-api.service[72088]: X-Roles: reader,member Apr 11 19:25:05 user devstack@n-api.service[72088]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/1afa97b49ae647c899a05d54b7f0f16b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/1afa97b49ae647c899a05d54b7f0f16b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/1afa97b49ae647c899a05d54b7f0f16b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 11 19:25:05 user devstack@n-api.service[72088]: X-Tenant: tempest-TaggedBootDevicesTest_v242-1381679461 Apr 11 19:25:05 user devstack@n-api.service[72088]: X-Tenant-Id: 1afa97b49ae647c899a05d54b7f0f16b Apr 11 19:25:05 user devstack@n-api.service[72088]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-1381679461 Apr 11 19:25:05 user devstack@n-api.service[72088]: X-User: tempest-TaggedBootDevicesTest_v242-1381679461-project-member Apr 11 19:25:05 user devstack@n-api.service[72088]: X-User-Domain-Id: default Apr 11 19:25:05 user devstack@n-api.service[72088]: X-User-Domain-Name: Default Apr 11 19:25:05 user devstack@n-api.service[72088]: X-User-Id: 2f44f0d0807342ba9b851e7530a82294 Apr 11 19:25:05 user devstack@n-api.service[72088]: X-User-Name: tempest-TaggedBootDevicesTest_v242-1381679461-project-member Apr 11 19:25:05 user devstack@n-api.service[72088]: method: > Apr 11 19:25:05 user devstack@n-api.service[72088]: exception: Instance dde6b4d2-9288-474c-b400-ce3b6f393b24 could not be found. Apr 11 19:25:05 user devstack@n-api.service[72088]: action_args: {'id': 'dde6b4d2-9288-474c-b400-ce3b6f393b24'} Apr 11 19:25:05 user devstack@n-api.service[72088]: {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 19:25:05 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:25:05 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 19:25:05 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 19:25:05 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 19:25:05 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 19:25:05 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 19:25:05 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 19:25:05 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 19:25:05 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 19:25:05 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dde6b4d2-9288-474c-b400-ce3b6f393b24 could not be found. Apr 11 19:25:05 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi Apr 11 19:25:05 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 19:25:05 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi Apr 11 19:25:05 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:25:05 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 19:25:05 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 19:25:05 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 19:25:05 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 19:25:05 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 19:25:05 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 19:25:05 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 11 19:25:05 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 11 19:25:05 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 11 19:25:05 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 11 19:25:05 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 19:25:05 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 19:25:05 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 19:25:05 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 19:25:05 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dde6b4d2-9288-474c-b400-ce3b6f393b24 could not be found. Apr 11 19:25:05 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi Apr 11 19:25:05 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 19:25:05 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi Apr 11 19:25:05 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:25:05 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 19:25:05 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 19:25:05 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 19:25:05 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 19:25:05 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dde6b4d2-9288-474c-b400-ce3b6f393b24 could not be found. Apr 11 19:25:05 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi Apr 11 19:25:05 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [None req-09abf39b-4c26-46eb-92e3-52c9b2b41f2c tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] Returning 404 to user: Instance dde6b4d2-9288-474c-b400-ce3b6f393b24 could not be found. {{(pid=72088) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 19:25:05 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [None req-09abf39b-4c26-46eb-92e3-52c9b2b41f2c tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/dde6b4d2-9288-474c-b400-ce3b6f393b24" status: 404 len: 111 microversion: 2.42 time: 0.038029 Apr 11 19:25:05 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 89/268] 10.0.0.210 () {64 vars in 1357 bytes} [Tue Apr 11 19:25:05 2023] DELETE /compute/v2.1/servers/dde6b4d2-9288-474c-b400-ce3b6f393b24 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 11 19:25:05 user devstack@n-api.service[72089]: DEBUG nova.network.neutron [None req-80a61453-e6e8-432a-b514-c7d283feccbd tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] validate_networks() for [('93340493-e74d-43fd-9b4c-ddd0217720be', None, None, None, None, None)] {{(pid=72089) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 11 19:25:05 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [None req-b83b596f-8a88-49f5-9662-4d801ffda8ff tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] Calling method '>' {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:25:05 user devstack@n-api.service[72090]: DEBUG nova.compute.api [None req-b83b596f-8a88-49f5-9662-4d801ffda8ff tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] [instance: dde6b4d2-9288-474c-b400-ce3b6f393b24] Fetching instance by UUID {{(pid=72090) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:25:05 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-b83b596f-8a88-49f5-9662-4d801ffda8ff tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:25:05 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-b83b596f-8a88-49f5-9662-4d801ffda8ff tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:25:05 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-b83b596f-8a88-49f5-9662-4d801ffda8ff tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:25:05 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-b83b596f-8a88-49f5-9662-4d801ffda8ff tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:25:05 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-b83b596f-8a88-49f5-9662-4d801ffda8ff tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:25:05 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-b83b596f-8a88-49f5-9662-4d801ffda8ff tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:25:05 user devstack@n-api.service[72090]: INFO nova.api.openstack.wsgi [None req-b83b596f-8a88-49f5-9662-4d801ffda8ff tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] HTTP exception thrown: Instance dde6b4d2-9288-474c-b400-ce3b6f393b24 could not be found. Apr 11 19:25:05 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [None req-b83b596f-8a88-49f5-9662-4d801ffda8ff tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] Request method failure captured: Apr 11 19:25:05 user devstack@n-api.service[72090]: request: GET /compute/v2.1/servers/dde6b4d2-9288-474c-b400-ce3b6f393b24 HTTP/1.1 Apr 11 19:25:05 user devstack@n-api.service[72090]: Accept: application/json Apr 11 19:25:05 user devstack@n-api.service[72090]: Accept-Encoding: identity Apr 11 19:25:05 user devstack@n-api.service[72090]: Connection: close Apr 11 19:25:05 user devstack@n-api.service[72090]: Content-Length: 0 Apr 11 19:25:05 user devstack@n-api.service[72090]: Content-Type: application/json Apr 11 19:25:05 user devstack@n-api.service[72090]: Host: 10.0.0.210 Apr 11 19:25:05 user devstack@n-api.service[72090]: Openstack-System-Scope: None Apr 11 19:25:05 user devstack@n-api.service[72090]: User-Agent: python-urllib3/1.26.15 Apr 11 19:25:05 user devstack@n-api.service[72090]: X-Auth-Token: gAAAAABkNbM8Vsqqe8dNH64RIo-f1nvoYcew7Q9GbjqCkmUyLkKtKrODZSpC2Mxxng1EJJjtaGxIZp4dL_NRsI1aqGxIpHzb1qGh45vg9gGgcbsnka9g7A1DJ0AWfGAovmO-FT2SQsh1WwzRAxPO02QmCG6IC7BPoiGCkrPyuuNHQEDkrBI7ppY Apr 11 19:25:05 user devstack@n-api.service[72090]: X-Domain-Id: None Apr 11 19:25:05 user devstack@n-api.service[72090]: X-Domain-Name: None Apr 11 19:25:05 user devstack@n-api.service[72090]: X-Identity-Status: Confirmed Apr 11 19:25:05 user devstack@n-api.service[72090]: X-Is-Admin-Project: True Apr 11 19:25:05 user devstack@n-api.service[72090]: X-Openstack-Nova-Api-Version: 2.42 Apr 11 19:25:05 user devstack@n-api.service[72090]: X-Project-Domain-Id: default Apr 11 19:25:05 user devstack@n-api.service[72090]: X-Project-Domain-Name: Default Apr 11 19:25:05 user devstack@n-api.service[72090]: X-Project-Id: 1afa97b49ae647c899a05d54b7f0f16b Apr 11 19:25:05 user devstack@n-api.service[72090]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-1381679461 Apr 11 19:25:05 user devstack@n-api.service[72090]: X-Role: reader,member Apr 11 19:25:05 user devstack@n-api.service[72090]: X-Roles: reader,member Apr 11 19:25:05 user devstack@n-api.service[72090]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/1afa97b49ae647c899a05d54b7f0f16b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/1afa97b49ae647c899a05d54b7f0f16b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/1afa97b49ae647c899a05d54b7f0f16b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 11 19:25:05 user devstack@n-api.service[72090]: X-Tenant: tempest-TaggedBootDevicesTest_v242-1381679461 Apr 11 19:25:05 user devstack@n-api.service[72090]: X-Tenant-Id: 1afa97b49ae647c899a05d54b7f0f16b Apr 11 19:25:05 user devstack@n-api.service[72090]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-1381679461 Apr 11 19:25:05 user devstack@n-api.service[72090]: X-User: tempest-TaggedBootDevicesTest_v242-1381679461-project-member Apr 11 19:25:05 user devstack@n-api.service[72090]: X-User-Domain-Id: default Apr 11 19:25:05 user devstack@n-api.service[72090]: X-User-Domain-Name: Default Apr 11 19:25:05 user devstack@n-api.service[72090]: X-User-Id: 2f44f0d0807342ba9b851e7530a82294 Apr 11 19:25:05 user devstack@n-api.service[72090]: X-User-Name: tempest-TaggedBootDevicesTest_v242-1381679461-project-member Apr 11 19:25:05 user devstack@n-api.service[72090]: method: > Apr 11 19:25:05 user devstack@n-api.service[72090]: exception: Instance dde6b4d2-9288-474c-b400-ce3b6f393b24 could not be found. Apr 11 19:25:05 user devstack@n-api.service[72090]: action_args: {'id': 'dde6b4d2-9288-474c-b400-ce3b6f393b24'} Apr 11 19:25:05 user devstack@n-api.service[72090]: {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 19:25:05 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:25:05 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 19:25:05 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 19:25:05 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 19:25:05 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 19:25:05 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 19:25:05 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 19:25:05 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 19:25:05 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 19:25:05 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dde6b4d2-9288-474c-b400-ce3b6f393b24 could not be found. Apr 11 19:25:05 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi Apr 11 19:25:05 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 19:25:05 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi Apr 11 19:25:05 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:25:05 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 19:25:05 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 19:25:05 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 19:25:05 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 19:25:05 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 19:25:05 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 19:25:05 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 19:25:05 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 19:25:05 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 19:25:05 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 19:25:05 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 19:25:05 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 19:25:05 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dde6b4d2-9288-474c-b400-ce3b6f393b24 could not be found. Apr 11 19:25:05 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi Apr 11 19:25:05 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 19:25:05 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi Apr 11 19:25:05 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:25:05 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 19:25:05 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 19:25:05 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 19:25:05 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 19:25:05 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dde6b4d2-9288-474c-b400-ce3b6f393b24 could not be found. Apr 11 19:25:05 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi Apr 11 19:25:05 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [None req-b83b596f-8a88-49f5-9662-4d801ffda8ff tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] Returning 404 to user: Instance dde6b4d2-9288-474c-b400-ce3b6f393b24 could not be found. {{(pid=72090) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 19:25:05 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [None req-b83b596f-8a88-49f5-9662-4d801ffda8ff tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] 10.0.0.210 "GET /compute/v2.1/servers/dde6b4d2-9288-474c-b400-ce3b6f393b24" status: 404 len: 111 microversion: 2.42 time: 0.036226 Apr 11 19:25:05 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 87/269] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 19:25:05 2023] GET /compute/v2.1/servers/dde6b4d2-9288-474c-b400-ce3b6f393b24 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 11 19:25:06 user devstack@n-api.service[72089]: DEBUG nova.virt.hardware [None req-80a61453-e6e8-432a-b514-c7d283feccbd tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] Flavor limits 0:0:0 {{(pid=72089) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 19:25:06 user devstack@n-api.service[72089]: DEBUG nova.virt.hardware [None req-80a61453-e6e8-432a-b514-c7d283feccbd tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] Image limits 0:0:0 {{(pid=72089) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 19:25:06 user devstack@n-api.service[72089]: DEBUG nova.virt.hardware [None req-80a61453-e6e8-432a-b514-c7d283feccbd tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] Flavor pref 0:0:0 {{(pid=72089) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 19:25:06 user devstack@n-api.service[72089]: DEBUG nova.virt.hardware [None req-80a61453-e6e8-432a-b514-c7d283feccbd tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] Image pref 0:0:0 {{(pid=72089) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 19:25:06 user devstack@n-api.service[72089]: DEBUG nova.virt.hardware [None req-80a61453-e6e8-432a-b514-c7d283feccbd tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72089) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 19:25:06 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-80a61453-e6e8-432a-b514-c7d283feccbd tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:25:06 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-80a61453-e6e8-432a-b514-c7d283feccbd tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:25:06 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-80a61453-e6e8-432a-b514-c7d283feccbd tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:25:06 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-80a61453-e6e8-432a-b514-c7d283feccbd tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:25:06 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-80a61453-e6e8-432a-b514-c7d283feccbd tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:25:06 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-80a61453-e6e8-432a-b514-c7d283feccbd tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:25:06 user devstack@n-api.service[72089]: DEBUG nova.quota [None req-80a61453-e6e8-432a-b514-c7d283feccbd tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] Getting quotas for project 7543456a70d04d7f8c50f37e64b7ee9c. Resources: {'ram', 'instances', 'cores'} {{(pid=72089) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 19:25:06 user devstack@n-api.service[72089]: DEBUG nova.quota [None req-80a61453-e6e8-432a-b514-c7d283feccbd tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] Getting quotas for user 7c9641ceb17e4914b1cdf061c5bdc79f and project 7543456a70d04d7f8c50f37e64b7ee9c. Resources: {'ram', 'instances', 'cores'} {{(pid=72089) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 19:25:06 user devstack@n-api.service[72089]: DEBUG nova.compute.api [None req-80a61453-e6e8-432a-b514-c7d283feccbd tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] Going to run 1 instances... {{(pid=72089) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 11 19:25:06 user devstack@n-api.service[72089]: DEBUG nova.compute.api [None req-80a61453-e6e8-432a-b514-c7d283feccbd tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] [instance: ac961841-1fc4-4cec-89bd-8f932270441a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=72089) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 11 19:25:06 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [None req-80a61453-e6e8-432a-b514-c7d283feccbd tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.580569 Apr 11 19:25:06 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 94/270] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 11 19:25:05 2023] POST /compute/v2.1/servers => generated 378 bytes in 583 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 11 19:25:06 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [None req-edd03d4e-48a5-43fb-b7c7-96b2b5720a3c tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] Calling method '>' {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:25:06 user devstack@n-api.service[72088]: DEBUG nova.compute.api [None req-edd03d4e-48a5-43fb-b7c7-96b2b5720a3c tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] [instance: ac961841-1fc4-4cec-89bd-8f932270441a] Fetching instance by UUID {{(pid=72088) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:25:06 user devstack@n-api.service[72088]: DEBUG nova.policy [None req-edd03d4e-48a5-43fb-b7c7-96b2b5720a3c tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c9641ceb17e4914b1cdf061c5bdc79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7543456a70d04d7f8c50f37e64b7ee9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72088) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:25:06 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [None req-edd03d4e-48a5-43fb-b7c7-96b2b5720a3c tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ac961841-1fc4-4cec-89bd-8f932270441a" status: 200 len: 1208 microversion: 2.1 time: 0.070006 Apr 11 19:25:06 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 90/271] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 19:25:06 2023] GET /compute/v2.1/servers/ac961841-1fc4-4cec-89bd-8f932270441a => generated 1208 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:25:08 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [None req-ee0c642f-fd1c-4f55-a5d9-902bf6df5d82 tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] Calling method '>' {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:25:08 user devstack@n-api.service[72090]: DEBUG nova.compute.api [None req-ee0c642f-fd1c-4f55-a5d9-902bf6df5d82 tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] [instance: 9941d033-15c2-4069-b9a6-f80840e95a38] Fetching instance by UUID {{(pid=72090) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:25:08 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-ee0c642f-fd1c-4f55-a5d9-902bf6df5d82 tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:25:08 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-ee0c642f-fd1c-4f55-a5d9-902bf6df5d82 tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:25:08 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-ee0c642f-fd1c-4f55-a5d9-902bf6df5d82 tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:25:08 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-ee0c642f-fd1c-4f55-a5d9-902bf6df5d82 tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:25:08 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-ee0c642f-fd1c-4f55-a5d9-902bf6df5d82 tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:25:08 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-ee0c642f-fd1c-4f55-a5d9-902bf6df5d82 tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:25:08 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [None req-ee0c642f-fd1c-4f55-a5d9-902bf6df5d82 tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9941d033-15c2-4069-b9a6-f80840e95a38/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044864 Apr 11 19:25:08 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 88/272] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Apr 11 19:25:08 2023] GET /compute/v2.1/servers/9941d033-15c2-4069-b9a6-f80840e95a38/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 11 19:25:08 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [None req-54376e9c-41f4-477b-9b99-65535bdfc1ff tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-522187297", "imageRef": "4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b", "flavorRef": "42", "networks": [{"uuid": "c4faff63-06aa-4a91-8681-e5d654e5da93"}]}} {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:25:08 user devstack@n-api.service[72089]: DEBUG nova.network.neutron [None req-54376e9c-41f4-477b-9b99-65535bdfc1ff tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] validate_networks() for [('c4faff63-06aa-4a91-8681-e5d654e5da93', None, None, None, None, None)] {{(pid=72089) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 11 19:25:09 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [req-304f0ad9-afa3-429c-aec5-3d389ae8d60a req-aae54e93-71af-44d7-b22d-4b061deb4714 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ac961841-1fc4-4cec-89bd-8f932270441a", "tag": "c48d7fec-727d-409c-8285-6ae0da5ff14d"}]} {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:25:09 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-304f0ad9-afa3-429c-aec5-3d389ae8d60a req-aae54e93-71af-44d7-b22d-4b061deb4714 service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:25:09 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-304f0ad9-afa3-429c-aec5-3d389ae8d60a req-aae54e93-71af-44d7-b22d-4b061deb4714 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:25:09 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-304f0ad9-afa3-429c-aec5-3d389ae8d60a req-aae54e93-71af-44d7-b22d-4b061deb4714 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:25:09 user devstack@n-api.service[72088]: INFO nova.api.openstack.compute.server_external_events [req-304f0ad9-afa3-429c-aec5-3d389ae8d60a req-aae54e93-71af-44d7-b22d-4b061deb4714 service nova] Creating event network-changed:c48d7fec-727d-409c-8285-6ae0da5ff14d for instance ac961841-1fc4-4cec-89bd-8f932270441a on user Apr 11 19:25:09 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [req-304f0ad9-afa3-429c-aec5-3d389ae8d60a req-aae54e93-71af-44d7-b22d-4b061deb4714 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034366 Apr 11 19:25:09 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 91/273] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:25:09 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:25:09 user devstack@n-api.service[72089]: DEBUG nova.virt.hardware [None req-54376e9c-41f4-477b-9b99-65535bdfc1ff tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] Flavor limits 0:0:0 {{(pid=72089) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 19:25:09 user devstack@n-api.service[72089]: DEBUG nova.virt.hardware [None req-54376e9c-41f4-477b-9b99-65535bdfc1ff tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] Image limits 0:0:0 {{(pid=72089) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 19:25:09 user devstack@n-api.service[72089]: DEBUG nova.virt.hardware [None req-54376e9c-41f4-477b-9b99-65535bdfc1ff tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] Flavor pref 0:0:0 {{(pid=72089) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 19:25:09 user devstack@n-api.service[72089]: DEBUG nova.virt.hardware [None req-54376e9c-41f4-477b-9b99-65535bdfc1ff tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] Image pref 0:0:0 {{(pid=72089) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 19:25:09 user devstack@n-api.service[72089]: DEBUG nova.virt.hardware [None req-54376e9c-41f4-477b-9b99-65535bdfc1ff tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72089) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 19:25:09 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-54376e9c-41f4-477b-9b99-65535bdfc1ff tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:25:09 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-54376e9c-41f4-477b-9b99-65535bdfc1ff tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:25:09 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-54376e9c-41f4-477b-9b99-65535bdfc1ff tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:25:09 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-54376e9c-41f4-477b-9b99-65535bdfc1ff tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:25:09 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-54376e9c-41f4-477b-9b99-65535bdfc1ff tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:25:09 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-54376e9c-41f4-477b-9b99-65535bdfc1ff tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:25:09 user devstack@n-api.service[72089]: DEBUG nova.quota [None req-54376e9c-41f4-477b-9b99-65535bdfc1ff tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] Getting quotas for project f153e6b272924b8fa0ef28fb5f0970bb. Resources: {'ram', 'instances', 'cores'} {{(pid=72089) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 19:25:09 user devstack@n-api.service[72089]: DEBUG nova.quota [None req-54376e9c-41f4-477b-9b99-65535bdfc1ff tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] Getting quotas for user 54b4a383f04d4269a0099a738e14807e and project f153e6b272924b8fa0ef28fb5f0970bb. Resources: {'ram', 'instances', 'cores'} {{(pid=72089) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 19:25:09 user devstack@n-api.service[72089]: DEBUG nova.compute.api [None req-54376e9c-41f4-477b-9b99-65535bdfc1ff tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] Going to run 1 instances... {{(pid=72089) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 11 19:25:09 user devstack@n-api.service[72089]: DEBUG nova.compute.api [None req-54376e9c-41f4-477b-9b99-65535bdfc1ff tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] [instance: 083108da-0a96-4177-8866-66131d77c39b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=72089) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 11 19:25:09 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [None req-54376e9c-41f4-477b-9b99-65535bdfc1ff tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.530708 Apr 11 19:25:09 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 95/274] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 11 19:25:08 2023] POST /compute/v2.1/servers => generated 378 bytes in 533 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 11 19:25:09 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [None req-b29cc213-b475-490c-8dd8-7d68c7d9c6c4 tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] Calling method '>' {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:25:09 user devstack@n-api.service[72090]: DEBUG nova.compute.api [None req-b29cc213-b475-490c-8dd8-7d68c7d9c6c4 tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] [instance: 083108da-0a96-4177-8866-66131d77c39b] Fetching instance by UUID {{(pid=72090) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:25:09 user devstack@n-api.service[72090]: DEBUG nova.policy [None req-b29cc213-b475-490c-8dd8-7d68c7d9c6c4 tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b4a383f04d4269a0099a738e14807e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f153e6b272924b8fa0ef28fb5f0970bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72090) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:25:09 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [None req-b29cc213-b475-490c-8dd8-7d68c7d9c6c4 tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] 10.0.0.210 "GET /compute/v2.1/servers/083108da-0a96-4177-8866-66131d77c39b" status: 200 len: 1211 microversion: 2.1 time: 0.062680 Apr 11 19:25:09 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 89/275] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 19:25:09 2023] GET /compute/v2.1/servers/083108da-0a96-4177-8866-66131d77c39b => generated 1211 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:25:11 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [req-22c66e5a-7616-489f-a0bd-f797e1c8a6bf req-a826c9a1-2d06-4fea-b7ae-f144dc26c070 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac961841-1fc4-4cec-89bd-8f932270441a", "name": "network-vif-plugged", "status": "completed", "tag": "c48d7fec-727d-409c-8285-6ae0da5ff14d"}]} {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:25:11 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-22c66e5a-7616-489f-a0bd-f797e1c8a6bf req-a826c9a1-2d06-4fea-b7ae-f144dc26c070 service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:25:11 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-22c66e5a-7616-489f-a0bd-f797e1c8a6bf req-a826c9a1-2d06-4fea-b7ae-f144dc26c070 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:25:11 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-22c66e5a-7616-489f-a0bd-f797e1c8a6bf req-a826c9a1-2d06-4fea-b7ae-f144dc26c070 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:25:11 user devstack@n-api.service[72088]: INFO nova.api.openstack.compute.server_external_events [req-22c66e5a-7616-489f-a0bd-f797e1c8a6bf req-a826c9a1-2d06-4fea-b7ae-f144dc26c070 service nova] Creating event network-vif-plugged:c48d7fec-727d-409c-8285-6ae0da5ff14d for instance ac961841-1fc4-4cec-89bd-8f932270441a on user Apr 11 19:25:11 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [req-22c66e5a-7616-489f-a0bd-f797e1c8a6bf req-a826c9a1-2d06-4fea-b7ae-f144dc26c070 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031750 Apr 11 19:25:11 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 92/276] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:25:11 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:25:13 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [req-af43d2b0-f88f-4b6f-b986-449a46d2a6bb req-79137981-4f60-416c-ab44-a32fd877998b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac961841-1fc4-4cec-89bd-8f932270441a", "name": "network-vif-plugged", "status": "completed", "tag": "c48d7fec-727d-409c-8285-6ae0da5ff14d"}, {"name": "network-changed", "server_uuid": "083108da-0a96-4177-8866-66131d77c39b", "tag": "44671174-415b-41e7-964a-8c37ccb6a82d"}]} {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:25:13 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-af43d2b0-f88f-4b6f-b986-449a46d2a6bb req-79137981-4f60-416c-ab44-a32fd877998b service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:25:13 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-af43d2b0-f88f-4b6f-b986-449a46d2a6bb req-79137981-4f60-416c-ab44-a32fd877998b service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:25:13 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-af43d2b0-f88f-4b6f-b986-449a46d2a6bb req-79137981-4f60-416c-ab44-a32fd877998b service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:25:13 user devstack@n-api.service[72089]: INFO nova.api.openstack.compute.server_external_events [req-af43d2b0-f88f-4b6f-b986-449a46d2a6bb req-79137981-4f60-416c-ab44-a32fd877998b service nova] Creating event network-vif-plugged:c48d7fec-727d-409c-8285-6ae0da5ff14d for instance ac961841-1fc4-4cec-89bd-8f932270441a on user Apr 11 19:25:13 user devstack@n-api.service[72089]: INFO nova.api.openstack.compute.server_external_events [req-af43d2b0-f88f-4b6f-b986-449a46d2a6bb req-79137981-4f60-416c-ab44-a32fd877998b service nova] Creating event network-changed:44671174-415b-41e7-964a-8c37ccb6a82d for instance 083108da-0a96-4177-8866-66131d77c39b on user Apr 11 19:25:13 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [req-af43d2b0-f88f-4b6f-b986-449a46d2a6bb req-79137981-4f60-416c-ab44-a32fd877998b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.038498 Apr 11 19:25:13 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 96/277] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:25:13 2023] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:25:14 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [None req-4bac5476-4e3b-415c-8d49-ec9a1715c70a tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] Calling method '>' {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:25:14 user devstack@n-api.service[72090]: DEBUG nova.compute.api [None req-4bac5476-4e3b-415c-8d49-ec9a1715c70a tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] [instance: 1ded3918-3bae-465c-a53c-e88011914c50] Fetching instance by UUID {{(pid=72090) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:25:14 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-4bac5476-4e3b-415c-8d49-ec9a1715c70a tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:25:14 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-4bac5476-4e3b-415c-8d49-ec9a1715c70a tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:25:14 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-4bac5476-4e3b-415c-8d49-ec9a1715c70a tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:25:14 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-4bac5476-4e3b-415c-8d49-ec9a1715c70a tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:25:14 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-4bac5476-4e3b-415c-8d49-ec9a1715c70a tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:25:14 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-4bac5476-4e3b-415c-8d49-ec9a1715c70a tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:25:14 user devstack@n-api.service[72090]: INFO nova.api.openstack.wsgi [None req-4bac5476-4e3b-415c-8d49-ec9a1715c70a tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] HTTP exception thrown: Instance 1ded3918-3bae-465c-a53c-e88011914c50 could not be found. Apr 11 19:25:14 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [None req-4bac5476-4e3b-415c-8d49-ec9a1715c70a tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] Request method failure captured: Apr 11 19:25:14 user devstack@n-api.service[72090]: request: GET /compute/v2.1/servers/1ded3918-3bae-465c-a53c-e88011914c50 HTTP/1.1 Apr 11 19:25:14 user devstack@n-api.service[72090]: Accept: application/json Apr 11 19:25:14 user devstack@n-api.service[72090]: Accept-Encoding: identity Apr 11 19:25:14 user devstack@n-api.service[72090]: Connection: close Apr 11 19:25:14 user devstack@n-api.service[72090]: Content-Length: 0 Apr 11 19:25:14 user devstack@n-api.service[72090]: Content-Type: application/json Apr 11 19:25:14 user devstack@n-api.service[72090]: Host: 10.0.0.210 Apr 11 19:25:14 user devstack@n-api.service[72090]: Openstack-System-Scope: None Apr 11 19:25:14 user devstack@n-api.service[72090]: User-Agent: python-urllib3/1.26.15 Apr 11 19:25:14 user devstack@n-api.service[72090]: X-Auth-Token: gAAAAABkNbNDAPk8Q-nN3pceOHYFet7xhJKdIDZpIy15vEhvqFwlBjYYYSroNCBLHbDx9L0HiTXNJTCK5Yqmasj-hVM5SZ4-dErJbdgBabPJNiMFpC9M1NFJgaWEts7feRwmE9I3mUZwtzQRLbbERLRKyj28XIBUF9WgaXusMWgmOS50N-zY2Yg Apr 11 19:25:14 user devstack@n-api.service[72090]: X-Domain-Id: None Apr 11 19:25:14 user devstack@n-api.service[72090]: X-Domain-Name: None Apr 11 19:25:14 user devstack@n-api.service[72090]: X-Identity-Status: Confirmed Apr 11 19:25:14 user devstack@n-api.service[72090]: X-Is-Admin-Project: True Apr 11 19:25:14 user devstack@n-api.service[72090]: X-Project-Domain-Id: default Apr 11 19:25:14 user devstack@n-api.service[72090]: X-Project-Domain-Name: Default Apr 11 19:25:14 user devstack@n-api.service[72090]: X-Project-Id: f4c6f64ecc104480a149bcfd0610dfef Apr 11 19:25:14 user devstack@n-api.service[72090]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-1532830376 Apr 11 19:25:14 user devstack@n-api.service[72090]: X-Role: reader,member Apr 11 19:25:14 user devstack@n-api.service[72090]: X-Roles: reader,member Apr 11 19:25:14 user devstack@n-api.service[72090]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f4c6f64ecc104480a149bcfd0610dfef"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/f4c6f64ecc104480a149bcfd0610dfef"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f4c6f64ecc104480a149bcfd0610dfef"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 11 19:25:14 user devstack@n-api.service[72090]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-1532830376 Apr 11 19:25:14 user devstack@n-api.service[72090]: X-Tenant-Id: f4c6f64ecc104480a149bcfd0610dfef Apr 11 19:25:14 user devstack@n-api.service[72090]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-1532830376 Apr 11 19:25:14 user devstack@n-api.service[72090]: X-User: tempest-AttachSCSIVolumeTestJSON-1532830376-project-member Apr 11 19:25:14 user devstack@n-api.service[72090]: X-User-Domain-Id: default Apr 11 19:25:14 user devstack@n-api.service[72090]: X-User-Domain-Name: Default Apr 11 19:25:14 user devstack@n-api.service[72090]: X-User-Id: 26555f273c374f9ba0ed151d2f1cbaef Apr 11 19:25:14 user devstack@n-api.service[72090]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-1532830376-project-member Apr 11 19:25:14 user devstack@n-api.service[72090]: method: > Apr 11 19:25:14 user devstack@n-api.service[72090]: exception: Instance 1ded3918-3bae-465c-a53c-e88011914c50 could not be found. Apr 11 19:25:14 user devstack@n-api.service[72090]: action_args: {'id': '1ded3918-3bae-465c-a53c-e88011914c50'} Apr 11 19:25:14 user devstack@n-api.service[72090]: {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 19:25:14 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:25:14 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 19:25:14 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 19:25:14 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 19:25:14 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 19:25:14 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 19:25:14 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 19:25:14 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 19:25:14 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 19:25:14 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1ded3918-3bae-465c-a53c-e88011914c50 could not be found. Apr 11 19:25:14 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi Apr 11 19:25:14 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 19:25:14 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi Apr 11 19:25:14 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:25:14 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 19:25:14 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 19:25:14 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 19:25:14 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 19:25:14 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 19:25:14 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 19:25:14 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 19:25:14 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 19:25:14 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 19:25:14 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 19:25:14 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 19:25:14 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 19:25:14 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1ded3918-3bae-465c-a53c-e88011914c50 could not be found. Apr 11 19:25:14 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi Apr 11 19:25:14 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 19:25:14 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi Apr 11 19:25:14 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:25:14 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 19:25:14 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 19:25:14 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 19:25:14 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 19:25:14 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1ded3918-3bae-465c-a53c-e88011914c50 could not be found. Apr 11 19:25:14 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi Apr 11 19:25:14 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [None req-4bac5476-4e3b-415c-8d49-ec9a1715c70a tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] Returning 404 to user: Instance 1ded3918-3bae-465c-a53c-e88011914c50 could not be found. {{(pid=72090) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 19:25:14 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [None req-4bac5476-4e3b-415c-8d49-ec9a1715c70a tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1ded3918-3bae-465c-a53c-e88011914c50" status: 404 len: 111 microversion: 2.1 time: 0.039234 Apr 11 19:25:14 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 90/278] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 19:25:14 2023] GET /compute/v2.1/servers/1ded3918-3bae-465c-a53c-e88011914c50 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 19:25:14 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [None req-35300b01-7fc8-4570-93ee-8201962e7b24 tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] Calling method '.version_select at 0x7f119db07010>' {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:25:14 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [None req-35300b01-7fc8-4570-93ee-8201962e7b24 tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1434827992" status: 202 len: 0 microversion: 2.1 time: 0.025761 Apr 11 19:25:14 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 93/279] 10.0.0.210 () {62 vars in 1298 bytes} [Tue Apr 11 19:25:14 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1434827992 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 19:25:16 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [req-58af6902-1274-48b6-9d85-474ced3e2fc1 req-7b1a2fb0-651c-4ce9-bb57-b314f7e331e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "083108da-0a96-4177-8866-66131d77c39b", "name": "network-vif-plugged", "status": "completed", "tag": "44671174-415b-41e7-964a-8c37ccb6a82d"}]} {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:25:16 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-58af6902-1274-48b6-9d85-474ced3e2fc1 req-7b1a2fb0-651c-4ce9-bb57-b314f7e331e6 service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:25:16 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-58af6902-1274-48b6-9d85-474ced3e2fc1 req-7b1a2fb0-651c-4ce9-bb57-b314f7e331e6 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:25:16 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-58af6902-1274-48b6-9d85-474ced3e2fc1 req-7b1a2fb0-651c-4ce9-bb57-b314f7e331e6 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:25:16 user devstack@n-api.service[72089]: INFO nova.api.openstack.compute.server_external_events [req-58af6902-1274-48b6-9d85-474ced3e2fc1 req-7b1a2fb0-651c-4ce9-bb57-b314f7e331e6 service nova] Creating event network-vif-plugged:44671174-415b-41e7-964a-8c37ccb6a82d for instance 083108da-0a96-4177-8866-66131d77c39b on user Apr 11 19:25:16 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [req-58af6902-1274-48b6-9d85-474ced3e2fc1 req-7b1a2fb0-651c-4ce9-bb57-b314f7e331e6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042240 Apr 11 19:25:16 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 97/280] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:25:16 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:25:16 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [None req-959016b2-7604-41e3-9395-c6e6ef846c52 tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] Calling method '>' {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:25:16 user devstack@n-api.service[72090]: DEBUG nova.compute.api [None req-959016b2-7604-41e3-9395-c6e6ef846c52 tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] [instance: 1ded3918-3bae-465c-a53c-e88011914c50] Fetching instance by UUID {{(pid=72090) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:25:16 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-959016b2-7604-41e3-9395-c6e6ef846c52 tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:25:16 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-959016b2-7604-41e3-9395-c6e6ef846c52 tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:25:16 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-959016b2-7604-41e3-9395-c6e6ef846c52 tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:25:16 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-959016b2-7604-41e3-9395-c6e6ef846c52 tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:25:16 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-959016b2-7604-41e3-9395-c6e6ef846c52 tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:25:16 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-959016b2-7604-41e3-9395-c6e6ef846c52 tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:25:16 user devstack@n-api.service[72090]: INFO nova.api.openstack.wsgi [None req-959016b2-7604-41e3-9395-c6e6ef846c52 tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] HTTP exception thrown: Instance 1ded3918-3bae-465c-a53c-e88011914c50 could not be found. Apr 11 19:25:16 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [None req-959016b2-7604-41e3-9395-c6e6ef846c52 tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] Request method failure captured: Apr 11 19:25:16 user devstack@n-api.service[72090]: request: DELETE /compute/v2.1/servers/1ded3918-3bae-465c-a53c-e88011914c50 HTTP/1.1 Apr 11 19:25:16 user devstack@n-api.service[72090]: Accept: application/json Apr 11 19:25:16 user devstack@n-api.service[72090]: Accept-Encoding: identity Apr 11 19:25:16 user devstack@n-api.service[72090]: Connection: close Apr 11 19:25:16 user devstack@n-api.service[72090]: Content-Length: 0 Apr 11 19:25:16 user devstack@n-api.service[72090]: Content-Type: application/json Apr 11 19:25:16 user devstack@n-api.service[72090]: Host: 10.0.0.210 Apr 11 19:25:16 user devstack@n-api.service[72090]: Openstack-System-Scope: None Apr 11 19:25:16 user devstack@n-api.service[72090]: User-Agent: python-urllib3/1.26.15 Apr 11 19:25:16 user devstack@n-api.service[72090]: X-Auth-Token: gAAAAABkNbNDAPk8Q-nN3pceOHYFet7xhJKdIDZpIy15vEhvqFwlBjYYYSroNCBLHbDx9L0HiTXNJTCK5Yqmasj-hVM5SZ4-dErJbdgBabPJNiMFpC9M1NFJgaWEts7feRwmE9I3mUZwtzQRLbbERLRKyj28XIBUF9WgaXusMWgmOS50N-zY2Yg Apr 11 19:25:16 user devstack@n-api.service[72090]: X-Domain-Id: None Apr 11 19:25:16 user devstack@n-api.service[72090]: X-Domain-Name: None Apr 11 19:25:16 user devstack@n-api.service[72090]: X-Identity-Status: Confirmed Apr 11 19:25:16 user devstack@n-api.service[72090]: X-Is-Admin-Project: True Apr 11 19:25:16 user devstack@n-api.service[72090]: X-Project-Domain-Id: default Apr 11 19:25:16 user devstack@n-api.service[72090]: X-Project-Domain-Name: Default Apr 11 19:25:16 user devstack@n-api.service[72090]: X-Project-Id: f4c6f64ecc104480a149bcfd0610dfef Apr 11 19:25:16 user devstack@n-api.service[72090]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-1532830376 Apr 11 19:25:16 user devstack@n-api.service[72090]: X-Role: reader,member Apr 11 19:25:16 user devstack@n-api.service[72090]: X-Roles: reader,member Apr 11 19:25:16 user devstack@n-api.service[72090]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f4c6f64ecc104480a149bcfd0610dfef"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/f4c6f64ecc104480a149bcfd0610dfef"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f4c6f64ecc104480a149bcfd0610dfef"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 11 19:25:16 user devstack@n-api.service[72090]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-1532830376 Apr 11 19:25:16 user devstack@n-api.service[72090]: X-Tenant-Id: f4c6f64ecc104480a149bcfd0610dfef Apr 11 19:25:16 user devstack@n-api.service[72090]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-1532830376 Apr 11 19:25:16 user devstack@n-api.service[72090]: X-User: tempest-AttachSCSIVolumeTestJSON-1532830376-project-member Apr 11 19:25:16 user devstack@n-api.service[72090]: X-User-Domain-Id: default Apr 11 19:25:16 user devstack@n-api.service[72090]: X-User-Domain-Name: Default Apr 11 19:25:16 user devstack@n-api.service[72090]: X-User-Id: 26555f273c374f9ba0ed151d2f1cbaef Apr 11 19:25:16 user devstack@n-api.service[72090]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-1532830376-project-member Apr 11 19:25:16 user devstack@n-api.service[72090]: method: > Apr 11 19:25:16 user devstack@n-api.service[72090]: exception: Instance 1ded3918-3bae-465c-a53c-e88011914c50 could not be found. Apr 11 19:25:16 user devstack@n-api.service[72090]: action_args: {'id': '1ded3918-3bae-465c-a53c-e88011914c50'} Apr 11 19:25:16 user devstack@n-api.service[72090]: {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 19:25:16 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:25:16 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 19:25:16 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 19:25:16 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 19:25:16 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 19:25:16 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 19:25:16 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 19:25:16 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 19:25:16 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 19:25:16 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1ded3918-3bae-465c-a53c-e88011914c50 could not be found. Apr 11 19:25:16 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi Apr 11 19:25:16 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 19:25:16 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi Apr 11 19:25:16 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:25:16 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 19:25:16 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 19:25:16 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 19:25:16 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 19:25:16 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 19:25:16 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 19:25:16 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 11 19:25:16 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 11 19:25:16 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 11 19:25:16 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 11 19:25:16 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 19:25:16 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 19:25:16 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 19:25:16 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 19:25:16 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1ded3918-3bae-465c-a53c-e88011914c50 could not be found. Apr 11 19:25:16 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi Apr 11 19:25:16 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 19:25:16 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi Apr 11 19:25:16 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:25:16 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 19:25:16 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 19:25:16 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 19:25:16 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 19:25:16 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1ded3918-3bae-465c-a53c-e88011914c50 could not be found. Apr 11 19:25:16 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi Apr 11 19:25:16 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [None req-959016b2-7604-41e3-9395-c6e6ef846c52 tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] Returning 404 to user: Instance 1ded3918-3bae-465c-a53c-e88011914c50 could not be found. {{(pid=72090) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 19:25:16 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [None req-959016b2-7604-41e3-9395-c6e6ef846c52 tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/1ded3918-3bae-465c-a53c-e88011914c50" status: 404 len: 111 microversion: 2.1 time: 0.036613 Apr 11 19:25:16 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 91/281] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 19:25:16 2023] DELETE /compute/v2.1/servers/1ded3918-3bae-465c-a53c-e88011914c50 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 19:25:16 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [None req-90d36f80-3811-4025-9ed0-d54ed4ee0405 tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] Calling method '>' {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:25:16 user devstack@n-api.service[72088]: DEBUG nova.compute.api [None req-90d36f80-3811-4025-9ed0-d54ed4ee0405 tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] [instance: 1ded3918-3bae-465c-a53c-e88011914c50] Fetching instance by UUID {{(pid=72088) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:25:16 user devstack@n-api.service[72088]: DEBUG dbcounter [-] [72088] Writing DB stats nova_cell0:SELECT=2 {{(pid=72088) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:25:16 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-90d36f80-3811-4025-9ed0-d54ed4ee0405 tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:25:16 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-90d36f80-3811-4025-9ed0-d54ed4ee0405 tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:25:16 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-90d36f80-3811-4025-9ed0-d54ed4ee0405 tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:25:16 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-90d36f80-3811-4025-9ed0-d54ed4ee0405 tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:25:16 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-90d36f80-3811-4025-9ed0-d54ed4ee0405 tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:25:16 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-90d36f80-3811-4025-9ed0-d54ed4ee0405 tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:25:16 user devstack@n-api.service[72088]: INFO nova.api.openstack.wsgi [None req-90d36f80-3811-4025-9ed0-d54ed4ee0405 tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] HTTP exception thrown: Instance 1ded3918-3bae-465c-a53c-e88011914c50 could not be found. Apr 11 19:25:16 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [None req-90d36f80-3811-4025-9ed0-d54ed4ee0405 tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] Request method failure captured: Apr 11 19:25:16 user devstack@n-api.service[72088]: request: GET /compute/v2.1/servers/1ded3918-3bae-465c-a53c-e88011914c50 HTTP/1.1 Apr 11 19:25:16 user devstack@n-api.service[72088]: Accept: application/json Apr 11 19:25:16 user devstack@n-api.service[72088]: Accept-Encoding: identity Apr 11 19:25:16 user devstack@n-api.service[72088]: Connection: close Apr 11 19:25:16 user devstack@n-api.service[72088]: Content-Length: 0 Apr 11 19:25:16 user devstack@n-api.service[72088]: Content-Type: application/json Apr 11 19:25:16 user devstack@n-api.service[72088]: Host: 10.0.0.210 Apr 11 19:25:16 user devstack@n-api.service[72088]: Openstack-System-Scope: None Apr 11 19:25:16 user devstack@n-api.service[72088]: User-Agent: python-urllib3/1.26.15 Apr 11 19:25:16 user devstack@n-api.service[72088]: X-Auth-Token: gAAAAABkNbNDAPk8Q-nN3pceOHYFet7xhJKdIDZpIy15vEhvqFwlBjYYYSroNCBLHbDx9L0HiTXNJTCK5Yqmasj-hVM5SZ4-dErJbdgBabPJNiMFpC9M1NFJgaWEts7feRwmE9I3mUZwtzQRLbbERLRKyj28XIBUF9WgaXusMWgmOS50N-zY2Yg Apr 11 19:25:16 user devstack@n-api.service[72088]: X-Domain-Id: None Apr 11 19:25:16 user devstack@n-api.service[72088]: X-Domain-Name: None Apr 11 19:25:16 user devstack@n-api.service[72088]: X-Identity-Status: Confirmed Apr 11 19:25:16 user devstack@n-api.service[72088]: X-Is-Admin-Project: True Apr 11 19:25:16 user devstack@n-api.service[72088]: X-Project-Domain-Id: default Apr 11 19:25:16 user devstack@n-api.service[72088]: X-Project-Domain-Name: Default Apr 11 19:25:16 user devstack@n-api.service[72088]: X-Project-Id: f4c6f64ecc104480a149bcfd0610dfef Apr 11 19:25:16 user devstack@n-api.service[72088]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-1532830376 Apr 11 19:25:16 user devstack@n-api.service[72088]: X-Role: reader,member Apr 11 19:25:16 user devstack@n-api.service[72088]: X-Roles: reader,member Apr 11 19:25:16 user devstack@n-api.service[72088]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f4c6f64ecc104480a149bcfd0610dfef"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/f4c6f64ecc104480a149bcfd0610dfef"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f4c6f64ecc104480a149bcfd0610dfef"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 11 19:25:16 user devstack@n-api.service[72088]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-1532830376 Apr 11 19:25:16 user devstack@n-api.service[72088]: X-Tenant-Id: f4c6f64ecc104480a149bcfd0610dfef Apr 11 19:25:16 user devstack@n-api.service[72088]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-1532830376 Apr 11 19:25:16 user devstack@n-api.service[72088]: X-User: tempest-AttachSCSIVolumeTestJSON-1532830376-project-member Apr 11 19:25:16 user devstack@n-api.service[72088]: X-User-Domain-Id: default Apr 11 19:25:16 user devstack@n-api.service[72088]: X-User-Domain-Name: Default Apr 11 19:25:16 user devstack@n-api.service[72088]: X-User-Id: 26555f273c374f9ba0ed151d2f1cbaef Apr 11 19:25:16 user devstack@n-api.service[72088]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-1532830376-project-member Apr 11 19:25:16 user devstack@n-api.service[72088]: method: > Apr 11 19:25:16 user devstack@n-api.service[72088]: exception: Instance 1ded3918-3bae-465c-a53c-e88011914c50 could not be found. Apr 11 19:25:16 user devstack@n-api.service[72088]: action_args: {'id': '1ded3918-3bae-465c-a53c-e88011914c50'} Apr 11 19:25:16 user devstack@n-api.service[72088]: {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 19:25:16 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:25:16 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 19:25:16 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 19:25:16 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 19:25:16 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 19:25:16 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 19:25:16 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 19:25:16 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 19:25:16 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 19:25:16 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1ded3918-3bae-465c-a53c-e88011914c50 could not be found. Apr 11 19:25:16 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi Apr 11 19:25:16 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 19:25:16 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi Apr 11 19:25:16 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:25:16 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 19:25:16 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 19:25:16 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 19:25:16 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 19:25:16 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 19:25:16 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 19:25:16 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 19:25:16 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 19:25:16 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 19:25:16 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 19:25:16 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 19:25:16 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 19:25:16 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1ded3918-3bae-465c-a53c-e88011914c50 could not be found. Apr 11 19:25:16 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi Apr 11 19:25:16 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 19:25:16 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi Apr 11 19:25:16 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:25:16 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 19:25:16 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 19:25:16 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 19:25:16 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 19:25:16 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1ded3918-3bae-465c-a53c-e88011914c50 could not be found. Apr 11 19:25:16 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi Apr 11 19:25:16 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [None req-90d36f80-3811-4025-9ed0-d54ed4ee0405 tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] Returning 404 to user: Instance 1ded3918-3bae-465c-a53c-e88011914c50 could not be found. {{(pid=72088) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 19:25:16 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [None req-90d36f80-3811-4025-9ed0-d54ed4ee0405 tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1ded3918-3bae-465c-a53c-e88011914c50" status: 404 len: 111 microversion: 2.1 time: 0.086727 Apr 11 19:25:16 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 94/282] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 19:25:16 2023] GET /compute/v2.1/servers/1ded3918-3bae-465c-a53c-e88011914c50 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 19:25:18 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [req-03bedef0-76ae-4789-8713-f7ad48495788 req-38c46521-c343-47ca-8f75-e90f70f72b42 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "083108da-0a96-4177-8866-66131d77c39b", "name": "network-vif-plugged", "status": "completed", "tag": "44671174-415b-41e7-964a-8c37ccb6a82d"}]} {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:25:18 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-03bedef0-76ae-4789-8713-f7ad48495788 req-38c46521-c343-47ca-8f75-e90f70f72b42 service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:25:18 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-03bedef0-76ae-4789-8713-f7ad48495788 req-38c46521-c343-47ca-8f75-e90f70f72b42 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:25:18 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-03bedef0-76ae-4789-8713-f7ad48495788 req-38c46521-c343-47ca-8f75-e90f70f72b42 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:25:18 user devstack@n-api.service[72089]: INFO nova.api.openstack.compute.server_external_events [req-03bedef0-76ae-4789-8713-f7ad48495788 req-38c46521-c343-47ca-8f75-e90f70f72b42 service nova] Creating event network-vif-plugged:44671174-415b-41e7-964a-8c37ccb6a82d for instance 083108da-0a96-4177-8866-66131d77c39b on user Apr 11 19:25:18 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [req-03bedef0-76ae-4789-8713-f7ad48495788 req-38c46521-c343-47ca-8f75-e90f70f72b42 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036294 Apr 11 19:25:18 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 98/283] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:25:18 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:25:18 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [None req-df7c30b9-084c-4efa-9e78-0b0c247b6abc tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] Calling method '>' {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:25:18 user devstack@n-api.service[72090]: DEBUG nova.compute.api [None req-df7c30b9-084c-4efa-9e78-0b0c247b6abc tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] [instance: 75a4ef96-a6c3-4ccd-9503-bab0d4174b2b] Fetching instance by UUID {{(pid=72090) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:25:18 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-df7c30b9-084c-4efa-9e78-0b0c247b6abc tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:25:18 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-df7c30b9-084c-4efa-9e78-0b0c247b6abc tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:25:18 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-df7c30b9-084c-4efa-9e78-0b0c247b6abc tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:25:18 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-df7c30b9-084c-4efa-9e78-0b0c247b6abc tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:25:18 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-df7c30b9-084c-4efa-9e78-0b0c247b6abc tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:25:18 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-df7c30b9-084c-4efa-9e78-0b0c247b6abc tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:25:18 user devstack@n-api.service[72090]: INFO nova.api.openstack.wsgi [None req-df7c30b9-084c-4efa-9e78-0b0c247b6abc tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] HTTP exception thrown: Instance 75a4ef96-a6c3-4ccd-9503-bab0d4174b2b could not be found. Apr 11 19:25:18 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [None req-df7c30b9-084c-4efa-9e78-0b0c247b6abc tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] Request method failure captured: Apr 11 19:25:18 user devstack@n-api.service[72090]: request: GET /compute/v2.1/servers/75a4ef96-a6c3-4ccd-9503-bab0d4174b2b HTTP/1.1 Apr 11 19:25:18 user devstack@n-api.service[72090]: Accept: application/json Apr 11 19:25:18 user devstack@n-api.service[72090]: Accept-Encoding: identity Apr 11 19:25:18 user devstack@n-api.service[72090]: Connection: close Apr 11 19:25:18 user devstack@n-api.service[72090]: Content-Length: 0 Apr 11 19:25:18 user devstack@n-api.service[72090]: Content-Type: application/json Apr 11 19:25:18 user devstack@n-api.service[72090]: Host: 10.0.0.210 Apr 11 19:25:18 user devstack@n-api.service[72090]: Openstack-System-Scope: None Apr 11 19:25:18 user devstack@n-api.service[72090]: User-Agent: python-urllib3/1.26.15 Apr 11 19:25:18 user devstack@n-api.service[72090]: X-Auth-Token: gAAAAABkNbNC-FRYlOU9oDrrdgc34IfF_E_LkDBrjAvUlQWKoRP_Hl59NF_phSiVPLMfUXMWDRa3BW95_Mr8qpjRXU3ncDIryf6Qj4BZdEqXKXZe27j0Y08eYcdJCGdnfzjA7wFlx96Rm6qUh9zfbANXKHlBaEfgF1fuXblnvIr0owElQl7bf7o Apr 11 19:25:18 user devstack@n-api.service[72090]: X-Domain-Id: None Apr 11 19:25:18 user devstack@n-api.service[72090]: X-Domain-Name: None Apr 11 19:25:18 user devstack@n-api.service[72090]: X-Identity-Status: Confirmed Apr 11 19:25:18 user devstack@n-api.service[72090]: X-Is-Admin-Project: True Apr 11 19:25:18 user devstack@n-api.service[72090]: X-Openstack-Nova-Api-Version: 2.32 Apr 11 19:25:18 user devstack@n-api.service[72090]: X-Project-Domain-Id: default Apr 11 19:25:18 user devstack@n-api.service[72090]: X-Project-Domain-Name: Default Apr 11 19:25:18 user devstack@n-api.service[72090]: X-Project-Id: 5ac81630b23345679b841ea2c3fe28f6 Apr 11 19:25:18 user devstack@n-api.service[72090]: X-Project-Name: tempest-TaggedBootDevicesTest-673790428 Apr 11 19:25:18 user devstack@n-api.service[72090]: X-Role: reader,member Apr 11 19:25:18 user devstack@n-api.service[72090]: X-Roles: reader,member Apr 11 19:25:18 user devstack@n-api.service[72090]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5ac81630b23345679b841ea2c3fe28f6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/5ac81630b23345679b841ea2c3fe28f6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5ac81630b23345679b841ea2c3fe28f6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 11 19:25:18 user devstack@n-api.service[72090]: X-Tenant: tempest-TaggedBootDevicesTest-673790428 Apr 11 19:25:18 user devstack@n-api.service[72090]: X-Tenant-Id: 5ac81630b23345679b841ea2c3fe28f6 Apr 11 19:25:18 user devstack@n-api.service[72090]: X-Tenant-Name: tempest-TaggedBootDevicesTest-673790428 Apr 11 19:25:18 user devstack@n-api.service[72090]: X-User: tempest-TaggedBootDevicesTest-673790428-project-member Apr 11 19:25:18 user devstack@n-api.service[72090]: X-User-Domain-Id: default Apr 11 19:25:18 user devstack@n-api.service[72090]: X-User-Domain-Name: Default Apr 11 19:25:18 user devstack@n-api.service[72090]: X-User-Id: bb69b26bc5af47069cdd00b39db75375 Apr 11 19:25:18 user devstack@n-api.service[72090]: X-User-Name: tempest-TaggedBootDevicesTest-673790428-project-member Apr 11 19:25:18 user devstack@n-api.service[72090]: method: > Apr 11 19:25:18 user devstack@n-api.service[72090]: exception: Instance 75a4ef96-a6c3-4ccd-9503-bab0d4174b2b could not be found. Apr 11 19:25:18 user devstack@n-api.service[72090]: action_args: {'id': '75a4ef96-a6c3-4ccd-9503-bab0d4174b2b'} Apr 11 19:25:18 user devstack@n-api.service[72090]: {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 19:25:18 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:25:18 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 19:25:18 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 19:25:18 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 19:25:18 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 19:25:18 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 19:25:18 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 19:25:18 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 19:25:18 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 19:25:18 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 75a4ef96-a6c3-4ccd-9503-bab0d4174b2b could not be found. Apr 11 19:25:18 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi Apr 11 19:25:18 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 19:25:18 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi Apr 11 19:25:18 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:25:18 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 19:25:18 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 19:25:18 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 19:25:18 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 19:25:18 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 19:25:18 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 19:25:18 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 19:25:18 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 19:25:18 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 19:25:18 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 19:25:18 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 19:25:18 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 19:25:18 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 75a4ef96-a6c3-4ccd-9503-bab0d4174b2b could not be found. Apr 11 19:25:18 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi Apr 11 19:25:18 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 19:25:18 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi Apr 11 19:25:18 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:25:18 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 19:25:18 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 19:25:18 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 19:25:18 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 19:25:18 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 75a4ef96-a6c3-4ccd-9503-bab0d4174b2b could not be found. Apr 11 19:25:18 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi Apr 11 19:25:18 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [None req-df7c30b9-084c-4efa-9e78-0b0c247b6abc tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] Returning 404 to user: Instance 75a4ef96-a6c3-4ccd-9503-bab0d4174b2b could not be found. {{(pid=72090) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 19:25:18 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [None req-df7c30b9-084c-4efa-9e78-0b0c247b6abc tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] 10.0.0.210 "GET /compute/v2.1/servers/75a4ef96-a6c3-4ccd-9503-bab0d4174b2b" status: 404 len: 111 microversion: 2.32 time: 0.039865 Apr 11 19:25:18 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 92/284] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 19:25:18 2023] GET /compute/v2.1/servers/75a4ef96-a6c3-4ccd-9503-bab0d4174b2b => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 11 19:25:18 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [None req-fbbce5c3-04e3-4af4-a715-7b3142e3095e tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] Calling method '.version_select at 0x7f119db06560>' {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:25:18 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [None req-fbbce5c3-04e3-4af4-a715-7b3142e3095e tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1484668240" status: 204 len: 0 microversion: 2.32 time: 0.030130 Apr 11 19:25:18 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 95/285] 10.0.0.210 () {64 vars in 1339 bytes} [Tue Apr 11 19:25:18 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1484668240 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 11 19:25:18 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [None req-1a949e73-29e2-492f-a8d0-e08120b8b016 tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] Calling method '>' {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:25:18 user devstack@n-api.service[72089]: DEBUG nova.compute.api [None req-1a949e73-29e2-492f-a8d0-e08120b8b016 tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] [instance: e84ad0e4-a65b-404c-adbf-c49d5f0b3cca] Fetching instance by UUID {{(pid=72089) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:25:18 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-1a949e73-29e2-492f-a8d0-e08120b8b016 tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:25:18 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-1a949e73-29e2-492f-a8d0-e08120b8b016 tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:25:18 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-1a949e73-29e2-492f-a8d0-e08120b8b016 tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:25:18 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-1a949e73-29e2-492f-a8d0-e08120b8b016 tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:25:18 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-1a949e73-29e2-492f-a8d0-e08120b8b016 tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:25:18 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-1a949e73-29e2-492f-a8d0-e08120b8b016 tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:25:18 user devstack@n-api.service[72089]: DEBUG nova.compute.api [None req-1a949e73-29e2-492f-a8d0-e08120b8b016 tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] [instance: e84ad0e4-a65b-404c-adbf-c49d5f0b3cca] Going to try to terminate instance {{(pid=72089) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 11 19:25:19 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [None req-1a949e73-29e2-492f-a8d0-e08120b8b016 tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/e84ad0e4-a65b-404c-adbf-c49d5f0b3cca" status: 204 len: 0 microversion: 2.1 time: 0.397822 Apr 11 19:25:19 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 99/286] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 19:25:18 2023] DELETE /compute/v2.1/servers/e84ad0e4-a65b-404c-adbf-c49d5f0b3cca => generated 0 bytes in 400 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 11 19:25:19 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [None req-b29969b9-4a26-4d18-a22f-69cf8f3cdfb6 tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] Calling method '>' {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:25:19 user devstack@n-api.service[72090]: DEBUG nova.compute.api [None req-b29969b9-4a26-4d18-a22f-69cf8f3cdfb6 tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] [instance: e84ad0e4-a65b-404c-adbf-c49d5f0b3cca] Fetching instance by UUID {{(pid=72090) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:25:19 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-b29969b9-4a26-4d18-a22f-69cf8f3cdfb6 tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:25:19 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-b29969b9-4a26-4d18-a22f-69cf8f3cdfb6 tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:25:19 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-b29969b9-4a26-4d18-a22f-69cf8f3cdfb6 tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:25:19 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-b29969b9-4a26-4d18-a22f-69cf8f3cdfb6 tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:25:19 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-b29969b9-4a26-4d18-a22f-69cf8f3cdfb6 tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:25:19 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-b29969b9-4a26-4d18-a22f-69cf8f3cdfb6 tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:25:19 user devstack@n-api.service[72090]: DEBUG dbcounter [-] [72090] Writing DB stats nova_cell0:SELECT=2 {{(pid=72090) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:25:19 user devstack@n-api.service[72090]: DEBUG nova.policy [None req-b29969b9-4a26-4d18-a22f-69cf8f3cdfb6 tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f44dfa2528b4540a81f4eb7c3f3f2f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5d7769df1e4974b295cb30407151dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72090) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:25:19 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [None req-b29969b9-4a26-4d18-a22f-69cf8f3cdfb6 tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e84ad0e4-a65b-404c-adbf-c49d5f0b3cca" status: 200 len: 1499 microversion: 2.1 time: 0.331217 Apr 11 19:25:19 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 93/287] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 19:25:19 2023] GET /compute/v2.1/servers/e84ad0e4-a65b-404c-adbf-c49d5f0b3cca => generated 1499 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:25:20 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [req-d33c83b8-b458-4ed4-8687-0a1c66a8597d req-f847289a-b747-4d07-afca-c36472d6596f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e84ad0e4-a65b-404c-adbf-c49d5f0b3cca", "name": "network-vif-unplugged", "status": "completed", "tag": "27172120-33d2-4fbe-9af2-e8376499f9bc"}, {"server_uuid": "e84ad0e4-a65b-404c-adbf-c49d5f0b3cca", "name": "network-vif-plugged", "status": "completed", "tag": "27172120-33d2-4fbe-9af2-e8376499f9bc"}]} {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:25:20 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-d33c83b8-b458-4ed4-8687-0a1c66a8597d req-f847289a-b747-4d07-afca-c36472d6596f service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:25:20 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-d33c83b8-b458-4ed4-8687-0a1c66a8597d req-f847289a-b747-4d07-afca-c36472d6596f service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:25:20 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-d33c83b8-b458-4ed4-8687-0a1c66a8597d req-f847289a-b747-4d07-afca-c36472d6596f service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:25:20 user devstack@n-api.service[72089]: DEBUG dbcounter [-] [72089] Writing DB stats nova_cell0:SELECT=4 {{(pid=72089) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:25:20 user devstack@n-api.service[72089]: DEBUG dbcounter [-] [72089] Writing DB stats nova_cell0:SELECT=12 {{(pid=72089) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:25:20 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [None req-b2dae7c8-d52c-434d-ba66-c87a2fa1d704 tempest-TaggedAttachmentsTest-326619538 tempest-TaggedAttachmentsTest-326619538-project-admin] Calling method '>' {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:25:20 user devstack@n-api.service[72088]: INFO nova.api.openstack.compute.server_external_events [req-d33c83b8-b458-4ed4-8687-0a1c66a8597d req-f847289a-b747-4d07-afca-c36472d6596f service nova] Creating event network-vif-unplugged:27172120-33d2-4fbe-9af2-e8376499f9bc for instance e84ad0e4-a65b-404c-adbf-c49d5f0b3cca on user Apr 11 19:25:20 user devstack@n-api.service[72088]: INFO nova.api.openstack.compute.server_external_events [req-d33c83b8-b458-4ed4-8687-0a1c66a8597d req-f847289a-b747-4d07-afca-c36472d6596f service nova] Creating event network-vif-plugged:27172120-33d2-4fbe-9af2-e8376499f9bc for instance e84ad0e4-a65b-404c-adbf-c49d5f0b3cca on user Apr 11 19:25:20 user devstack@n-api.service[72089]: DEBUG nova.compute.api [None req-b2dae7c8-d52c-434d-ba66-c87a2fa1d704 tempest-TaggedAttachmentsTest-326619538 tempest-TaggedAttachmentsTest-326619538-project-admin] [instance: b71d95ed-728d-4386-b7c6-50b252718ca9] Fetching instance by UUID {{(pid=72089) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:25:20 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [req-d33c83b8-b458-4ed4-8687-0a1c66a8597d req-f847289a-b747-4d07-afca-c36472d6596f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.054633 Apr 11 19:25:20 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 96/288] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:25:20 2023] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:25:20 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-b2dae7c8-d52c-434d-ba66-c87a2fa1d704 tempest-TaggedAttachmentsTest-326619538 tempest-TaggedAttachmentsTest-326619538-project-admin] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:25:20 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-b2dae7c8-d52c-434d-ba66-c87a2fa1d704 tempest-TaggedAttachmentsTest-326619538 tempest-TaggedAttachmentsTest-326619538-project-admin] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:25:20 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-b2dae7c8-d52c-434d-ba66-c87a2fa1d704 tempest-TaggedAttachmentsTest-326619538 tempest-TaggedAttachmentsTest-326619538-project-admin] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:25:20 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-b2dae7c8-d52c-434d-ba66-c87a2fa1d704 tempest-TaggedAttachmentsTest-326619538 tempest-TaggedAttachmentsTest-326619538-project-admin] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:25:20 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-b2dae7c8-d52c-434d-ba66-c87a2fa1d704 tempest-TaggedAttachmentsTest-326619538 tempest-TaggedAttachmentsTest-326619538-project-admin] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:25:20 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-b2dae7c8-d52c-434d-ba66-c87a2fa1d704 tempest-TaggedAttachmentsTest-326619538 tempest-TaggedAttachmentsTest-326619538-project-admin] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:25:20 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [None req-b2dae7c8-d52c-434d-ba66-c87a2fa1d704 tempest-TaggedAttachmentsTest-326619538 tempest-TaggedAttachmentsTest-326619538-project-admin] 10.0.0.210 "GET /compute/v2.1/servers/b71d95ed-728d-4386-b7c6-50b252718ca9/os-instance-actions/req-9913b844-137a-403a-a75f-bb43d1cf1163" status: 200 len: 503 microversion: 2.49 time: 0.125623 Apr 11 19:25:20 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 100/289] 10.0.0.210 () {64 vars in 1537 bytes} [Tue Apr 11 19:25:20 2023] GET /compute/v2.1/servers/b71d95ed-728d-4386-b7c6-50b252718ca9/os-instance-actions/req-9913b844-137a-403a-a75f-bb43d1cf1163 => generated 503 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:25:20 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [None req-bf7cd49c-437a-4a11-95de-6a0efa1f3566 tempest-TaggedAttachmentsTest-326619538 tempest-TaggedAttachmentsTest-326619538-project-admin] Calling method '>' {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:25:20 user devstack@n-api.service[72090]: DEBUG nova.compute.api [None req-bf7cd49c-437a-4a11-95de-6a0efa1f3566 tempest-TaggedAttachmentsTest-326619538 tempest-TaggedAttachmentsTest-326619538-project-admin] [instance: b71d95ed-728d-4386-b7c6-50b252718ca9] Fetching instance by UUID {{(pid=72090) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:25:20 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-bf7cd49c-437a-4a11-95de-6a0efa1f3566 tempest-TaggedAttachmentsTest-326619538 tempest-TaggedAttachmentsTest-326619538-project-admin] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:25:20 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-bf7cd49c-437a-4a11-95de-6a0efa1f3566 tempest-TaggedAttachmentsTest-326619538 tempest-TaggedAttachmentsTest-326619538-project-admin] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:25:20 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-bf7cd49c-437a-4a11-95de-6a0efa1f3566 tempest-TaggedAttachmentsTest-326619538 tempest-TaggedAttachmentsTest-326619538-project-admin] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:25:20 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-bf7cd49c-437a-4a11-95de-6a0efa1f3566 tempest-TaggedAttachmentsTest-326619538 tempest-TaggedAttachmentsTest-326619538-project-admin] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:25:20 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-bf7cd49c-437a-4a11-95de-6a0efa1f3566 tempest-TaggedAttachmentsTest-326619538 tempest-TaggedAttachmentsTest-326619538-project-admin] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:25:20 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-bf7cd49c-437a-4a11-95de-6a0efa1f3566 tempest-TaggedAttachmentsTest-326619538 tempest-TaggedAttachmentsTest-326619538-project-admin] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:25:20 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [None req-bf7cd49c-437a-4a11-95de-6a0efa1f3566 tempest-TaggedAttachmentsTest-326619538 tempest-TaggedAttachmentsTest-326619538-project-admin] 10.0.0.210 "GET /compute/v2.1/servers/b71d95ed-728d-4386-b7c6-50b252718ca9/os-instance-actions/req-9913b844-137a-403a-a75f-bb43d1cf1163" status: 200 len: 503 microversion: 2.49 time: 0.094607 Apr 11 19:25:20 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 94/290] 10.0.0.210 () {64 vars in 1537 bytes} [Tue Apr 11 19:25:20 2023] GET /compute/v2.1/servers/b71d95ed-728d-4386-b7c6-50b252718ca9/os-instance-actions/req-9913b844-137a-403a-a75f-bb43d1cf1163 => generated 503 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:25:20 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [None req-a5d1b258-4c48-46ce-9feb-573140a8234f tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] Calling method '>' {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:25:20 user devstack@n-api.service[72088]: DEBUG nova.compute.api [None req-a5d1b258-4c48-46ce-9feb-573140a8234f tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] [instance: b71d95ed-728d-4386-b7c6-50b252718ca9] Fetching instance by UUID {{(pid=72088) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:25:20 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-a5d1b258-4c48-46ce-9feb-573140a8234f tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:25:20 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-a5d1b258-4c48-46ce-9feb-573140a8234f tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:25:20 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-a5d1b258-4c48-46ce-9feb-573140a8234f tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:25:20 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-a5d1b258-4c48-46ce-9feb-573140a8234f tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:25:20 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-a5d1b258-4c48-46ce-9feb-573140a8234f tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:25:20 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-a5d1b258-4c48-46ce-9feb-573140a8234f tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:25:20 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [None req-a5d1b258-4c48-46ce-9feb-573140a8234f tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b71d95ed-728d-4386-b7c6-50b252718ca9/os-volume_attachments" status: 200 len: 25 microversion: 2.49 time: 0.092401 Apr 11 19:25:20 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 97/291] 10.0.0.210 () {64 vars in 1420 bytes} [Tue Apr 11 19:25:20 2023] GET /compute/v2.1/servers/b71d95ed-728d-4386-b7c6-50b252718ca9/os-volume_attachments => generated 25 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:25:20 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [None req-8d86829e-c473-43d8-8509-72a692d42da7 tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] Calling method '>' {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:25:20 user devstack@n-api.service[72089]: DEBUG nova.compute.api [None req-8d86829e-c473-43d8-8509-72a692d42da7 tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] [instance: b71d95ed-728d-4386-b7c6-50b252718ca9] Fetching instance by UUID {{(pid=72089) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:25:20 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-8d86829e-c473-43d8-8509-72a692d42da7 tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:25:20 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-8d86829e-c473-43d8-8509-72a692d42da7 tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:25:20 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-8d86829e-c473-43d8-8509-72a692d42da7 tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:25:20 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-8d86829e-c473-43d8-8509-72a692d42da7 tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:25:20 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-8d86829e-c473-43d8-8509-72a692d42da7 tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:25:20 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-8d86829e-c473-43d8-8509-72a692d42da7 tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:25:20 user devstack@n-api.service[72089]: DEBUG nova.compute.api [None req-8d86829e-c473-43d8-8509-72a692d42da7 tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] [instance: b71d95ed-728d-4386-b7c6-50b252718ca9] Going to try to terminate instance {{(pid=72089) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 11 19:25:20 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [None req-8d86829e-c473-43d8-8509-72a692d42da7 tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/b71d95ed-728d-4386-b7c6-50b252718ca9" status: 204 len: 0 microversion: 2.49 time: 0.130383 Apr 11 19:25:20 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 101/292] 10.0.0.210 () {64 vars in 1357 bytes} [Tue Apr 11 19:25:20 2023] DELETE /compute/v2.1/servers/b71d95ed-728d-4386-b7c6-50b252718ca9 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 11 19:25:20 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [None req-68a5b416-9e52-4ea6-a527-fdfa32138ccb tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] Calling method '>' {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:25:20 user devstack@n-api.service[72090]: DEBUG nova.compute.api [None req-68a5b416-9e52-4ea6-a527-fdfa32138ccb tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] [instance: b71d95ed-728d-4386-b7c6-50b252718ca9] Fetching instance by UUID {{(pid=72090) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:25:20 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-68a5b416-9e52-4ea6-a527-fdfa32138ccb tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:25:20 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-68a5b416-9e52-4ea6-a527-fdfa32138ccb tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:25:20 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-68a5b416-9e52-4ea6-a527-fdfa32138ccb tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:25:20 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-68a5b416-9e52-4ea6-a527-fdfa32138ccb tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:25:20 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-68a5b416-9e52-4ea6-a527-fdfa32138ccb tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:25:20 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-68a5b416-9e52-4ea6-a527-fdfa32138ccb tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:25:21 user devstack@n-api.service[72090]: DEBUG nova.policy [None req-68a5b416-9e52-4ea6-a527-fdfa32138ccb tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f84e7cbdf6a4e588753fea907beba0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f39e7fdf571442b0a6f136020a99f7fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72090) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:25:21 user devstack@n-api.service[72090]: DEBUG nova.policy [None req-68a5b416-9e52-4ea6-a527-fdfa32138ccb tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f84e7cbdf6a4e588753fea907beba0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f39e7fdf571442b0a6f136020a99f7fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72090) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:25:21 user devstack@n-api.service[72090]: DEBUG nova.policy [None req-68a5b416-9e52-4ea6-a527-fdfa32138ccb tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f84e7cbdf6a4e588753fea907beba0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f39e7fdf571442b0a6f136020a99f7fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72090) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:25:21 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [None req-68a5b416-9e52-4ea6-a527-fdfa32138ccb tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b71d95ed-728d-4386-b7c6-50b252718ca9" status: 200 len: 1751 microversion: 2.49 time: 0.319114 Apr 11 19:25:21 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 95/293] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 19:25:20 2023] GET /compute/v2.1/servers/b71d95ed-728d-4386-b7c6-50b252718ca9 => generated 1751 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 19:25:22 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [req-60366133-05d3-4120-b5e2-74b557f5e0f2 req-cd82ddaf-17de-41c5-9915-2d61616c9e60 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e84ad0e4-a65b-404c-adbf-c49d5f0b3cca", "name": "network-vif-deleted", "tag": "27172120-33d2-4fbe-9af2-e8376499f9bc"}, {"server_uuid": "b71d95ed-728d-4386-b7c6-50b252718ca9", "name": "network-vif-unplugged", "status": "completed", "tag": "64bd141d-04e6-46e6-bb46-e997d3234fa1"}, {"server_uuid": "b71d95ed-728d-4386-b7c6-50b252718ca9", "name": "network-vif-plugged", "status": "completed", "tag": "64bd141d-04e6-46e6-bb46-e997d3234fa1"}]} {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:25:22 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-60366133-05d3-4120-b5e2-74b557f5e0f2 req-cd82ddaf-17de-41c5-9915-2d61616c9e60 service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:25:22 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-60366133-05d3-4120-b5e2-74b557f5e0f2 req-cd82ddaf-17de-41c5-9915-2d61616c9e60 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:25:22 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-60366133-05d3-4120-b5e2-74b557f5e0f2 req-cd82ddaf-17de-41c5-9915-2d61616c9e60 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:25:22 user devstack@n-api.service[72088]: INFO nova.api.openstack.compute.server_external_events [req-60366133-05d3-4120-b5e2-74b557f5e0f2 req-cd82ddaf-17de-41c5-9915-2d61616c9e60 service nova] Creating event network-vif-deleted:27172120-33d2-4fbe-9af2-e8376499f9bc for instance e84ad0e4-a65b-404c-adbf-c49d5f0b3cca on user Apr 11 19:25:22 user devstack@n-api.service[72088]: INFO nova.api.openstack.compute.server_external_events [req-60366133-05d3-4120-b5e2-74b557f5e0f2 req-cd82ddaf-17de-41c5-9915-2d61616c9e60 service nova] Creating event network-vif-unplugged:64bd141d-04e6-46e6-bb46-e997d3234fa1 for instance b71d95ed-728d-4386-b7c6-50b252718ca9 on user Apr 11 19:25:22 user devstack@n-api.service[72088]: INFO nova.api.openstack.compute.server_external_events [req-60366133-05d3-4120-b5e2-74b557f5e0f2 req-cd82ddaf-17de-41c5-9915-2d61616c9e60 service nova] Creating event network-vif-plugged:64bd141d-04e6-46e6-bb46-e997d3234fa1 for instance b71d95ed-728d-4386-b7c6-50b252718ca9 on user Apr 11 19:25:22 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [req-60366133-05d3-4120-b5e2-74b557f5e0f2 req-cd82ddaf-17de-41c5-9915-2d61616c9e60 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 527 microversion: 2.1 time: 0.072639 Apr 11 19:25:22 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 98/294] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:25:22 2023] POST /compute/v2.1/os-server-external-events => generated 527 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:25:24 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [None req-3b2b02d6-03eb-4abb-9bf6-e37f1bc5641e tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] Calling method '>' {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:25:24 user devstack@n-api.service[72089]: DEBUG nova.compute.api [None req-3b2b02d6-03eb-4abb-9bf6-e37f1bc5641e tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] [instance: 75a4ef96-a6c3-4ccd-9503-bab0d4174b2b] Fetching instance by UUID {{(pid=72089) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:25:24 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-3b2b02d6-03eb-4abb-9bf6-e37f1bc5641e tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:25:24 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-3b2b02d6-03eb-4abb-9bf6-e37f1bc5641e tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:25:24 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-3b2b02d6-03eb-4abb-9bf6-e37f1bc5641e tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:25:24 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-3b2b02d6-03eb-4abb-9bf6-e37f1bc5641e tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:25:24 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-3b2b02d6-03eb-4abb-9bf6-e37f1bc5641e tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:25:24 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-3b2b02d6-03eb-4abb-9bf6-e37f1bc5641e tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:25:24 user devstack@n-api.service[72089]: INFO nova.api.openstack.wsgi [None req-3b2b02d6-03eb-4abb-9bf6-e37f1bc5641e tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] HTTP exception thrown: Instance 75a4ef96-a6c3-4ccd-9503-bab0d4174b2b could not be found. Apr 11 19:25:24 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [None req-3b2b02d6-03eb-4abb-9bf6-e37f1bc5641e tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] Request method failure captured: Apr 11 19:25:24 user devstack@n-api.service[72089]: request: DELETE /compute/v2.1/servers/75a4ef96-a6c3-4ccd-9503-bab0d4174b2b HTTP/1.1 Apr 11 19:25:24 user devstack@n-api.service[72089]: Accept: application/json Apr 11 19:25:24 user devstack@n-api.service[72089]: Accept-Encoding: identity Apr 11 19:25:24 user devstack@n-api.service[72089]: Connection: close Apr 11 19:25:24 user devstack@n-api.service[72089]: Content-Length: 0 Apr 11 19:25:24 user devstack@n-api.service[72089]: Content-Type: application/json Apr 11 19:25:24 user devstack@n-api.service[72089]: Host: 10.0.0.210 Apr 11 19:25:24 user devstack@n-api.service[72089]: Openstack-System-Scope: None Apr 11 19:25:24 user devstack@n-api.service[72089]: User-Agent: python-urllib3/1.26.15 Apr 11 19:25:24 user devstack@n-api.service[72089]: X-Auth-Token: gAAAAABkNbNC-FRYlOU9oDrrdgc34IfF_E_LkDBrjAvUlQWKoRP_Hl59NF_phSiVPLMfUXMWDRa3BW95_Mr8qpjRXU3ncDIryf6Qj4BZdEqXKXZe27j0Y08eYcdJCGdnfzjA7wFlx96Rm6qUh9zfbANXKHlBaEfgF1fuXblnvIr0owElQl7bf7o Apr 11 19:25:24 user devstack@n-api.service[72089]: X-Domain-Id: None Apr 11 19:25:24 user devstack@n-api.service[72089]: X-Domain-Name: None Apr 11 19:25:24 user devstack@n-api.service[72089]: X-Identity-Status: Confirmed Apr 11 19:25:24 user devstack@n-api.service[72089]: X-Is-Admin-Project: True Apr 11 19:25:24 user devstack@n-api.service[72089]: X-Openstack-Nova-Api-Version: 2.32 Apr 11 19:25:24 user devstack@n-api.service[72089]: X-Project-Domain-Id: default Apr 11 19:25:24 user devstack@n-api.service[72089]: X-Project-Domain-Name: Default Apr 11 19:25:24 user devstack@n-api.service[72089]: X-Project-Id: 5ac81630b23345679b841ea2c3fe28f6 Apr 11 19:25:24 user devstack@n-api.service[72089]: X-Project-Name: tempest-TaggedBootDevicesTest-673790428 Apr 11 19:25:24 user devstack@n-api.service[72089]: X-Role: reader,member Apr 11 19:25:24 user devstack@n-api.service[72089]: X-Roles: reader,member Apr 11 19:25:24 user devstack@n-api.service[72089]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5ac81630b23345679b841ea2c3fe28f6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/5ac81630b23345679b841ea2c3fe28f6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5ac81630b23345679b841ea2c3fe28f6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 11 19:25:24 user devstack@n-api.service[72089]: X-Tenant: tempest-TaggedBootDevicesTest-673790428 Apr 11 19:25:24 user devstack@n-api.service[72089]: X-Tenant-Id: 5ac81630b23345679b841ea2c3fe28f6 Apr 11 19:25:24 user devstack@n-api.service[72089]: X-Tenant-Name: tempest-TaggedBootDevicesTest-673790428 Apr 11 19:25:24 user devstack@n-api.service[72089]: X-User: tempest-TaggedBootDevicesTest-673790428-project-member Apr 11 19:25:24 user devstack@n-api.service[72089]: X-User-Domain-Id: default Apr 11 19:25:24 user devstack@n-api.service[72089]: X-User-Domain-Name: Default Apr 11 19:25:24 user devstack@n-api.service[72089]: X-User-Id: bb69b26bc5af47069cdd00b39db75375 Apr 11 19:25:24 user devstack@n-api.service[72089]: X-User-Name: tempest-TaggedBootDevicesTest-673790428-project-member Apr 11 19:25:24 user devstack@n-api.service[72089]: method: > Apr 11 19:25:24 user devstack@n-api.service[72089]: exception: Instance 75a4ef96-a6c3-4ccd-9503-bab0d4174b2b could not be found. Apr 11 19:25:24 user devstack@n-api.service[72089]: action_args: {'id': '75a4ef96-a6c3-4ccd-9503-bab0d4174b2b'} Apr 11 19:25:24 user devstack@n-api.service[72089]: {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 19:25:24 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:25:24 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 19:25:24 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 19:25:24 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 19:25:24 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 19:25:24 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 19:25:24 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 19:25:24 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 19:25:24 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 19:25:24 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 75a4ef96-a6c3-4ccd-9503-bab0d4174b2b could not be found. Apr 11 19:25:24 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi Apr 11 19:25:24 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 19:25:24 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi Apr 11 19:25:24 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:25:24 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 19:25:24 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 19:25:24 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 19:25:24 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 19:25:24 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 19:25:24 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 19:25:24 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 11 19:25:24 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 11 19:25:24 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 11 19:25:24 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 11 19:25:24 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 19:25:24 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 19:25:24 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 19:25:24 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 19:25:24 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 75a4ef96-a6c3-4ccd-9503-bab0d4174b2b could not be found. Apr 11 19:25:24 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi Apr 11 19:25:24 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 19:25:24 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi Apr 11 19:25:24 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:25:24 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 19:25:24 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 19:25:24 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 19:25:24 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 19:25:24 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 75a4ef96-a6c3-4ccd-9503-bab0d4174b2b could not be found. Apr 11 19:25:24 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi Apr 11 19:25:24 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [None req-3b2b02d6-03eb-4abb-9bf6-e37f1bc5641e tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] Returning 404 to user: Instance 75a4ef96-a6c3-4ccd-9503-bab0d4174b2b could not be found. {{(pid=72089) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 19:25:24 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [None req-3b2b02d6-03eb-4abb-9bf6-e37f1bc5641e tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/75a4ef96-a6c3-4ccd-9503-bab0d4174b2b" status: 404 len: 111 microversion: 2.32 time: 0.042208 Apr 11 19:25:24 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 102/295] 10.0.0.210 () {64 vars in 1357 bytes} [Tue Apr 11 19:25:24 2023] DELETE /compute/v2.1/servers/75a4ef96-a6c3-4ccd-9503-bab0d4174b2b => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 11 19:25:24 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [None req-5a081407-fe80-4870-aee6-272591fedab8 tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] Calling method '>' {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:25:24 user devstack@n-api.service[72090]: DEBUG nova.compute.api [None req-5a081407-fe80-4870-aee6-272591fedab8 tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] [instance: 75a4ef96-a6c3-4ccd-9503-bab0d4174b2b] Fetching instance by UUID {{(pid=72090) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:25:24 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-5a081407-fe80-4870-aee6-272591fedab8 tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:25:24 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-5a081407-fe80-4870-aee6-272591fedab8 tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:25:24 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-5a081407-fe80-4870-aee6-272591fedab8 tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:25:24 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-5a081407-fe80-4870-aee6-272591fedab8 tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:25:24 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-5a081407-fe80-4870-aee6-272591fedab8 tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:25:24 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-5a081407-fe80-4870-aee6-272591fedab8 tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:25:24 user devstack@n-api.service[72090]: INFO nova.api.openstack.wsgi [None req-5a081407-fe80-4870-aee6-272591fedab8 tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] HTTP exception thrown: Instance 75a4ef96-a6c3-4ccd-9503-bab0d4174b2b could not be found. Apr 11 19:25:24 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [None req-5a081407-fe80-4870-aee6-272591fedab8 tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] Request method failure captured: Apr 11 19:25:24 user devstack@n-api.service[72090]: request: GET /compute/v2.1/servers/75a4ef96-a6c3-4ccd-9503-bab0d4174b2b HTTP/1.1 Apr 11 19:25:24 user devstack@n-api.service[72090]: Accept: application/json Apr 11 19:25:24 user devstack@n-api.service[72090]: Accept-Encoding: identity Apr 11 19:25:24 user devstack@n-api.service[72090]: Connection: close Apr 11 19:25:24 user devstack@n-api.service[72090]: Content-Length: 0 Apr 11 19:25:24 user devstack@n-api.service[72090]: Content-Type: application/json Apr 11 19:25:24 user devstack@n-api.service[72090]: Host: 10.0.0.210 Apr 11 19:25:24 user devstack@n-api.service[72090]: Openstack-System-Scope: None Apr 11 19:25:24 user devstack@n-api.service[72090]: User-Agent: python-urllib3/1.26.15 Apr 11 19:25:24 user devstack@n-api.service[72090]: X-Auth-Token: gAAAAABkNbNC-FRYlOU9oDrrdgc34IfF_E_LkDBrjAvUlQWKoRP_Hl59NF_phSiVPLMfUXMWDRa3BW95_Mr8qpjRXU3ncDIryf6Qj4BZdEqXKXZe27j0Y08eYcdJCGdnfzjA7wFlx96Rm6qUh9zfbANXKHlBaEfgF1fuXblnvIr0owElQl7bf7o Apr 11 19:25:24 user devstack@n-api.service[72090]: X-Domain-Id: None Apr 11 19:25:24 user devstack@n-api.service[72090]: X-Domain-Name: None Apr 11 19:25:24 user devstack@n-api.service[72090]: X-Identity-Status: Confirmed Apr 11 19:25:24 user devstack@n-api.service[72090]: X-Is-Admin-Project: True Apr 11 19:25:24 user devstack@n-api.service[72090]: X-Openstack-Nova-Api-Version: 2.32 Apr 11 19:25:24 user devstack@n-api.service[72090]: X-Project-Domain-Id: default Apr 11 19:25:24 user devstack@n-api.service[72090]: X-Project-Domain-Name: Default Apr 11 19:25:24 user devstack@n-api.service[72090]: X-Project-Id: 5ac81630b23345679b841ea2c3fe28f6 Apr 11 19:25:24 user devstack@n-api.service[72090]: X-Project-Name: tempest-TaggedBootDevicesTest-673790428 Apr 11 19:25:24 user devstack@n-api.service[72090]: X-Role: reader,member Apr 11 19:25:24 user devstack@n-api.service[72090]: X-Roles: reader,member Apr 11 19:25:24 user devstack@n-api.service[72090]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5ac81630b23345679b841ea2c3fe28f6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/5ac81630b23345679b841ea2c3fe28f6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5ac81630b23345679b841ea2c3fe28f6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 11 19:25:24 user devstack@n-api.service[72090]: X-Tenant: tempest-TaggedBootDevicesTest-673790428 Apr 11 19:25:24 user devstack@n-api.service[72090]: X-Tenant-Id: 5ac81630b23345679b841ea2c3fe28f6 Apr 11 19:25:24 user devstack@n-api.service[72090]: X-Tenant-Name: tempest-TaggedBootDevicesTest-673790428 Apr 11 19:25:24 user devstack@n-api.service[72090]: X-User: tempest-TaggedBootDevicesTest-673790428-project-member Apr 11 19:25:24 user devstack@n-api.service[72090]: X-User-Domain-Id: default Apr 11 19:25:24 user devstack@n-api.service[72090]: X-User-Domain-Name: Default Apr 11 19:25:24 user devstack@n-api.service[72090]: X-User-Id: bb69b26bc5af47069cdd00b39db75375 Apr 11 19:25:24 user devstack@n-api.service[72090]: X-User-Name: tempest-TaggedBootDevicesTest-673790428-project-member Apr 11 19:25:24 user devstack@n-api.service[72090]: method: > Apr 11 19:25:24 user devstack@n-api.service[72090]: exception: Instance 75a4ef96-a6c3-4ccd-9503-bab0d4174b2b could not be found. Apr 11 19:25:24 user devstack@n-api.service[72090]: action_args: {'id': '75a4ef96-a6c3-4ccd-9503-bab0d4174b2b'} Apr 11 19:25:24 user devstack@n-api.service[72090]: {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 19:25:24 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:25:24 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 19:25:24 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 19:25:24 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 19:25:24 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 19:25:24 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 19:25:24 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 19:25:24 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 19:25:24 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 19:25:24 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 75a4ef96-a6c3-4ccd-9503-bab0d4174b2b could not be found. Apr 11 19:25:24 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi Apr 11 19:25:24 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 19:25:24 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi Apr 11 19:25:24 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:25:24 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 19:25:24 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 19:25:24 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 19:25:24 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 19:25:24 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 19:25:24 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 19:25:24 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 19:25:24 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 19:25:24 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 19:25:24 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 19:25:24 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 19:25:24 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 19:25:24 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 75a4ef96-a6c3-4ccd-9503-bab0d4174b2b could not be found. Apr 11 19:25:24 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi Apr 11 19:25:24 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 19:25:24 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi Apr 11 19:25:24 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:25:24 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 19:25:24 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 19:25:24 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 19:25:24 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 19:25:24 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 75a4ef96-a6c3-4ccd-9503-bab0d4174b2b could not be found. Apr 11 19:25:24 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi Apr 11 19:25:24 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [None req-5a081407-fe80-4870-aee6-272591fedab8 tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] Returning 404 to user: Instance 75a4ef96-a6c3-4ccd-9503-bab0d4174b2b could not be found. {{(pid=72090) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 19:25:24 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [None req-5a081407-fe80-4870-aee6-272591fedab8 tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] 10.0.0.210 "GET /compute/v2.1/servers/75a4ef96-a6c3-4ccd-9503-bab0d4174b2b" status: 404 len: 111 microversion: 2.32 time: 0.033109 Apr 11 19:25:24 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 96/296] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 19:25:24 2023] GET /compute/v2.1/servers/75a4ef96-a6c3-4ccd-9503-bab0d4174b2b => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 11 19:25:24 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [req-5c37b274-48af-4225-9d19-69a36eb6576d req-46905a7b-2903-4a16-957e-11bf7aa5326c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b71d95ed-728d-4386-b7c6-50b252718ca9", "name": "network-vif-deleted", "tag": "64bd141d-04e6-46e6-bb46-e997d3234fa1"}]} {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:25:24 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-5c37b274-48af-4225-9d19-69a36eb6576d req-46905a7b-2903-4a16-957e-11bf7aa5326c service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:25:24 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-5c37b274-48af-4225-9d19-69a36eb6576d req-46905a7b-2903-4a16-957e-11bf7aa5326c service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:25:24 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-5c37b274-48af-4225-9d19-69a36eb6576d req-46905a7b-2903-4a16-957e-11bf7aa5326c service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:25:24 user devstack@n-api.service[72088]: INFO nova.api.openstack.compute.server_external_events [req-5c37b274-48af-4225-9d19-69a36eb6576d req-46905a7b-2903-4a16-957e-11bf7aa5326c service nova] Creating event network-vif-deleted:64bd141d-04e6-46e6-bb46-e997d3234fa1 for instance b71d95ed-728d-4386-b7c6-50b252718ca9 on user Apr 11 19:25:24 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [req-5c37b274-48af-4225-9d19-69a36eb6576d req-46905a7b-2903-4a16-957e-11bf7aa5326c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033869 Apr 11 19:25:24 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 99/297] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:25:24 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:25:28 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [None req-8e262b2f-f3cb-4e1b-ad2e-cf795f8603e6 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerBootFromVolumeStableRescueTest-server-309051286", "imageRef": "4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b", "flavorRef": "42", "networks": [{"uuid": "eeacad54-05f6-4aba-aed7-13baddfb50e2"}]}} {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:25:28 user devstack@n-api.service[72089]: DEBUG nova.network.neutron [None req-8e262b2f-f3cb-4e1b-ad2e-cf795f8603e6 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] validate_networks() for [('eeacad54-05f6-4aba-aed7-13baddfb50e2', None, None, None, None, None)] {{(pid=72089) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 11 19:25:28 user devstack@n-api.service[72089]: DEBUG nova.virt.hardware [None req-8e262b2f-f3cb-4e1b-ad2e-cf795f8603e6 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Flavor limits 0:0:0 {{(pid=72089) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 19:25:28 user devstack@n-api.service[72089]: DEBUG nova.virt.hardware [None req-8e262b2f-f3cb-4e1b-ad2e-cf795f8603e6 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Image limits 0:0:0 {{(pid=72089) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 19:25:28 user devstack@n-api.service[72089]: DEBUG nova.virt.hardware [None req-8e262b2f-f3cb-4e1b-ad2e-cf795f8603e6 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Flavor pref 0:0:0 {{(pid=72089) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 19:25:28 user devstack@n-api.service[72089]: DEBUG nova.virt.hardware [None req-8e262b2f-f3cb-4e1b-ad2e-cf795f8603e6 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Image pref 0:0:0 {{(pid=72089) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 19:25:28 user devstack@n-api.service[72089]: DEBUG nova.virt.hardware [None req-8e262b2f-f3cb-4e1b-ad2e-cf795f8603e6 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72089) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 19:25:28 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-8e262b2f-f3cb-4e1b-ad2e-cf795f8603e6 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:25:28 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-8e262b2f-f3cb-4e1b-ad2e-cf795f8603e6 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:25:28 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-8e262b2f-f3cb-4e1b-ad2e-cf795f8603e6 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:25:28 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-8e262b2f-f3cb-4e1b-ad2e-cf795f8603e6 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:25:28 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-8e262b2f-f3cb-4e1b-ad2e-cf795f8603e6 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:25:28 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-8e262b2f-f3cb-4e1b-ad2e-cf795f8603e6 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:25:28 user devstack@n-api.service[72089]: DEBUG nova.quota [None req-8e262b2f-f3cb-4e1b-ad2e-cf795f8603e6 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Getting quotas for project eb91586feb3f4a4c84fa8c2183baaf8c. Resources: {'ram', 'instances', 'cores'} {{(pid=72089) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 19:25:28 user devstack@n-api.service[72089]: DEBUG nova.quota [None req-8e262b2f-f3cb-4e1b-ad2e-cf795f8603e6 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Getting quotas for user 1b3adca432b04d70818a51d1366f5c6d and project eb91586feb3f4a4c84fa8c2183baaf8c. Resources: {'ram', 'instances', 'cores'} {{(pid=72089) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 19:25:28 user devstack@n-api.service[72089]: DEBUG nova.compute.api [None req-8e262b2f-f3cb-4e1b-ad2e-cf795f8603e6 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Going to run 1 instances... {{(pid=72089) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 11 19:25:28 user devstack@n-api.service[72089]: DEBUG nova.compute.api [None req-8e262b2f-f3cb-4e1b-ad2e-cf795f8603e6 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] [instance: 9e2d23e8-2d2e-4b3e-94d8-01b17242dac5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=72089) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 11 19:25:28 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [None req-8e262b2f-f3cb-4e1b-ad2e-cf795f8603e6 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.87 time: 0.722076 Apr 11 19:25:28 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 103/298] 10.0.0.210 () {66 vars in 1265 bytes} [Tue Apr 11 19:25:28 2023] POST /compute/v2.1/servers => generated 378 bytes in 725 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 11 19:25:28 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [None req-0b533165-3067-4e27-a69b-f92b04bc68f9 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Calling method '>' {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:25:28 user devstack@n-api.service[72090]: DEBUG nova.compute.api [None req-0b533165-3067-4e27-a69b-f92b04bc68f9 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] [instance: 9e2d23e8-2d2e-4b3e-94d8-01b17242dac5] Fetching instance by UUID {{(pid=72090) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:25:28 user devstack@n-api.service[72090]: DEBUG nova.policy [None req-0b533165-3067-4e27-a69b-f92b04bc68f9 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b3adca432b04d70818a51d1366f5c6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb91586feb3f4a4c84fa8c2183baaf8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72090) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:25:28 user devstack@n-api.service[72090]: DEBUG nova.policy [None req-0b533165-3067-4e27-a69b-f92b04bc68f9 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b3adca432b04d70818a51d1366f5c6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb91586feb3f4a4c84fa8c2183baaf8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72090) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:25:28 user devstack@n-api.service[72090]: DEBUG nova.policy [None req-0b533165-3067-4e27-a69b-f92b04bc68f9 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b3adca432b04d70818a51d1366f5c6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb91586feb3f4a4c84fa8c2183baaf8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72090) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:25:28 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [None req-0b533165-3067-4e27-a69b-f92b04bc68f9 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9e2d23e8-2d2e-4b3e-94d8-01b17242dac5" status: 200 len: 1394 microversion: 2.87 time: 0.109078 Apr 11 19:25:28 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 97/299] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 19:25:28 2023] GET /compute/v2.1/servers/9e2d23e8-2d2e-4b3e-94d8-01b17242dac5 => generated 1394 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 11 19:25:31 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [req-50706c73-cd2d-49d9-b4a1-4efdd3398096 req-20324a93-199c-4f4e-b90d-2743d927b5c2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9e2d23e8-2d2e-4b3e-94d8-01b17242dac5", "tag": "8c77eb6a-6186-4c87-9e30-48420d525f90"}]} {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:25:31 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-50706c73-cd2d-49d9-b4a1-4efdd3398096 req-20324a93-199c-4f4e-b90d-2743d927b5c2 service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:25:31 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-50706c73-cd2d-49d9-b4a1-4efdd3398096 req-20324a93-199c-4f4e-b90d-2743d927b5c2 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:25:31 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-50706c73-cd2d-49d9-b4a1-4efdd3398096 req-20324a93-199c-4f4e-b90d-2743d927b5c2 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:25:31 user devstack@n-api.service[72088]: INFO nova.api.openstack.compute.server_external_events [req-50706c73-cd2d-49d9-b4a1-4efdd3398096 req-20324a93-199c-4f4e-b90d-2743d927b5c2 service nova] Creating event network-changed:8c77eb6a-6186-4c87-9e30-48420d525f90 for instance 9e2d23e8-2d2e-4b3e-94d8-01b17242dac5 on user Apr 11 19:25:31 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [req-50706c73-cd2d-49d9-b4a1-4efdd3398096 req-20324a93-199c-4f4e-b90d-2743d927b5c2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044826 Apr 11 19:25:31 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 100/300] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:25:31 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:25:33 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [req-20eb0cc2-ec97-46b0-a425-c2c3861cc379 req-f019c566-988c-4536-b4ec-8af626c4aefa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e2d23e8-2d2e-4b3e-94d8-01b17242dac5", "name": "network-vif-plugged", "status": "completed", "tag": "8c77eb6a-6186-4c87-9e30-48420d525f90"}]} {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:25:33 user devstack@n-api.service[72089]: DEBUG dbcounter [-] [72089] Writing DB stats nova_api:SELECT=66,nova_api:INSERT=9,nova_api:UPDATE=2 {{(pid=72089) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:25:33 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-20eb0cc2-ec97-46b0-a425-c2c3861cc379 req-f019c566-988c-4536-b4ec-8af626c4aefa service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:25:33 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-20eb0cc2-ec97-46b0-a425-c2c3861cc379 req-f019c566-988c-4536-b4ec-8af626c4aefa service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:25:33 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-20eb0cc2-ec97-46b0-a425-c2c3861cc379 req-f019c566-988c-4536-b4ec-8af626c4aefa service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:25:33 user devstack@n-api.service[72089]: DEBUG dbcounter [-] [72089] Writing DB stats nova_cell1:SELECT=55,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=72089) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:25:33 user devstack@n-api.service[72089]: INFO nova.api.openstack.compute.server_external_events [req-20eb0cc2-ec97-46b0-a425-c2c3861cc379 req-f019c566-988c-4536-b4ec-8af626c4aefa service nova] Creating event network-vif-plugged:8c77eb6a-6186-4c87-9e30-48420d525f90 for instance 9e2d23e8-2d2e-4b3e-94d8-01b17242dac5 on user Apr 11 19:25:33 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [req-20eb0cc2-ec97-46b0-a425-c2c3861cc379 req-f019c566-988c-4536-b4ec-8af626c4aefa service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057225 Apr 11 19:25:33 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 104/301] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:25:33 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:25:34 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [None req-49487699-a310-4c7c-8e4b-61603a5b7124 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] Calling method '>' {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:25:34 user devstack@n-api.service[72090]: DEBUG nova.compute.api [None req-49487699-a310-4c7c-8e4b-61603a5b7124 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] [instance: aa0bb9aa-a93d-45bc-9f90-46eeb6416365] Fetching instance by UUID {{(pid=72090) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:25:34 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-49487699-a310-4c7c-8e4b-61603a5b7124 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:25:34 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-49487699-a310-4c7c-8e4b-61603a5b7124 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:25:34 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-49487699-a310-4c7c-8e4b-61603a5b7124 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:25:34 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-49487699-a310-4c7c-8e4b-61603a5b7124 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:25:34 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-49487699-a310-4c7c-8e4b-61603a5b7124 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:25:34 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-49487699-a310-4c7c-8e4b-61603a5b7124 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:25:34 user devstack@n-api.service[72090]: DEBUG nova.policy [None req-49487699-a310-4c7c-8e4b-61603a5b7124 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26f091a1508b4d2689005b660f6a1380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ee7c68b277420ba524c2a99cd444ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72090) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:25:34 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [None req-49487699-a310-4c7c-8e4b-61603a5b7124 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] 10.0.0.210 "GET /compute/v2.1/servers/aa0bb9aa-a93d-45bc-9f90-46eeb6416365" status: 200 len: 1671 microversion: 2.1 time: 0.308661 Apr 11 19:25:34 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 98/302] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 19:25:34 2023] GET /compute/v2.1/servers/aa0bb9aa-a93d-45bc-9f90-46eeb6416365 => generated 1671 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:25:35 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [req-2e55a8f1-3649-4b62-86f8-0db35198b780 req-636578d3-2d0d-48b5-9c69-291ef4c97b08 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e2d23e8-2d2e-4b3e-94d8-01b17242dac5", "name": "network-vif-plugged", "status": "completed", "tag": "8c77eb6a-6186-4c87-9e30-48420d525f90"}]} {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:25:35 user devstack@n-api.service[72088]: DEBUG dbcounter [-] [72088] Writing DB stats nova_api:SELECT=32,nova_api:DELETE=3 {{(pid=72088) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:25:35 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-2e55a8f1-3649-4b62-86f8-0db35198b780 req-636578d3-2d0d-48b5-9c69-291ef4c97b08 service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:25:35 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-2e55a8f1-3649-4b62-86f8-0db35198b780 req-636578d3-2d0d-48b5-9c69-291ef4c97b08 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:25:35 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-2e55a8f1-3649-4b62-86f8-0db35198b780 req-636578d3-2d0d-48b5-9c69-291ef4c97b08 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:25:35 user devstack@n-api.service[72088]: DEBUG dbcounter [-] [72088] Writing DB stats nova_cell1:SELECT=23 {{(pid=72088) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:25:35 user devstack@n-api.service[72088]: INFO nova.api.openstack.compute.server_external_events [req-2e55a8f1-3649-4b62-86f8-0db35198b780 req-636578d3-2d0d-48b5-9c69-291ef4c97b08 service nova] Creating event network-vif-plugged:8c77eb6a-6186-4c87-9e30-48420d525f90 for instance 9e2d23e8-2d2e-4b3e-94d8-01b17242dac5 on user Apr 11 19:25:35 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [req-2e55a8f1-3649-4b62-86f8-0db35198b780 req-636578d3-2d0d-48b5-9c69-291ef4c97b08 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037951 Apr 11 19:25:35 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 101/303] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:25:35 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 11 19:25:35 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [None req-a709ec49-7e2c-41da-a3f1-a45c9733d8d0 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f2d4810b-a6fe-4903-813a-a0562018f061"}} {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:25:35 user devstack@n-api.service[72089]: DEBUG nova.compute.api [None req-a709ec49-7e2c-41da-a3f1-a45c9733d8d0 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] [instance: aa0bb9aa-a93d-45bc-9f90-46eeb6416365] Fetching instance by UUID {{(pid=72089) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:25:36 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-a709ec49-7e2c-41da-a3f1-a45c9733d8d0 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:25:36 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-a709ec49-7e2c-41da-a3f1-a45c9733d8d0 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:25:36 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-a709ec49-7e2c-41da-a3f1-a45c9733d8d0 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:25:36 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-a709ec49-7e2c-41da-a3f1-a45c9733d8d0 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:25:36 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-a709ec49-7e2c-41da-a3f1-a45c9733d8d0 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:25:36 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-a709ec49-7e2c-41da-a3f1-a45c9733d8d0 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:25:36 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [None req-a709ec49-7e2c-41da-a3f1-a45c9733d8d0 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] 10.0.0.210 "POST /compute/v2.1/servers/aa0bb9aa-a93d-45bc-9f90-46eeb6416365/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.320407 Apr 11 19:25:36 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 105/304] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Apr 11 19:25:35 2023] POST /compute/v2.1/servers/aa0bb9aa-a93d-45bc-9f90-46eeb6416365/os-volume_attachments => generated 194 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:25:36 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [None req-21327d3b-7a4e-4e86-aa97-67180fc8746e tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] Calling method '>' {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:25:36 user devstack@n-api.service[72090]: DEBUG nova.compute.api [None req-21327d3b-7a4e-4e86-aa97-67180fc8746e tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] [instance: a49d379e-3976-4d68-b6df-f572a922107c] Fetching instance by UUID {{(pid=72090) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:25:36 user devstack@n-api.service[72090]: DEBUG dbcounter [-] [72090] Writing DB stats nova_api:SELECT=33 {{(pid=72090) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:25:36 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-21327d3b-7a4e-4e86-aa97-67180fc8746e tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:25:36 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-21327d3b-7a4e-4e86-aa97-67180fc8746e tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:25:36 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-21327d3b-7a4e-4e86-aa97-67180fc8746e tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:25:36 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-21327d3b-7a4e-4e86-aa97-67180fc8746e tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:25:36 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-21327d3b-7a4e-4e86-aa97-67180fc8746e tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:25:36 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-21327d3b-7a4e-4e86-aa97-67180fc8746e tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:25:36 user devstack@n-api.service[72090]: DEBUG dbcounter [-] [72090] Writing DB stats nova_cell1:SELECT=45 {{(pid=72090) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:25:36 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [None req-21327d3b-7a4e-4e86-aa97-67180fc8746e tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a49d379e-3976-4d68-b6df-f572a922107c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.059927 Apr 11 19:25:36 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 99/305] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Apr 11 19:25:36 2023] GET /compute/v2.1/servers/a49d379e-3976-4d68-b6df-f572a922107c/os-volume_attachments => generated 25 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 11 19:25:36 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [None req-66ba5d29-ef1c-490d-b2ae-f2ad518ae56c tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] Calling method '>' {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:25:36 user devstack@n-api.service[72088]: DEBUG nova.compute.api [None req-66ba5d29-ef1c-490d-b2ae-f2ad518ae56c tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] [instance: a49d379e-3976-4d68-b6df-f572a922107c] Fetching instance by UUID {{(pid=72088) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:25:36 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-66ba5d29-ef1c-490d-b2ae-f2ad518ae56c tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:25:36 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-66ba5d29-ef1c-490d-b2ae-f2ad518ae56c tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:25:36 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-66ba5d29-ef1c-490d-b2ae-f2ad518ae56c tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:25:36 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-66ba5d29-ef1c-490d-b2ae-f2ad518ae56c tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:25:36 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-66ba5d29-ef1c-490d-b2ae-f2ad518ae56c tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:25:36 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-66ba5d29-ef1c-490d-b2ae-f2ad518ae56c tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:25:36 user devstack@n-api.service[72088]: DEBUG nova.compute.api [None req-66ba5d29-ef1c-490d-b2ae-f2ad518ae56c tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] [instance: a49d379e-3976-4d68-b6df-f572a922107c] Going to try to terminate instance {{(pid=72088) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 11 19:25:36 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [None req-57d9b02a-c975-4954-910d-6793f1ba4352 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Calling method '>' {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:25:36 user devstack@n-api.service[72089]: DEBUG nova.compute.api [None req-57d9b02a-c975-4954-910d-6793f1ba4352 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] [instance: 6802f099-9236-4c79-a892-2963f1b15b0e] Fetching instance by UUID {{(pid=72089) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:25:36 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-57d9b02a-c975-4954-910d-6793f1ba4352 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:25:36 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-57d9b02a-c975-4954-910d-6793f1ba4352 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:25:36 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-57d9b02a-c975-4954-910d-6793f1ba4352 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:25:36 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [None req-66ba5d29-ef1c-490d-b2ae-f2ad518ae56c tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/a49d379e-3976-4d68-b6df-f572a922107c" status: 204 len: 0 microversion: 2.1 time: 0.157459 Apr 11 19:25:36 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-57d9b02a-c975-4954-910d-6793f1ba4352 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:25:36 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 102/306] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 19:25:36 2023] DELETE /compute/v2.1/servers/a49d379e-3976-4d68-b6df-f572a922107c => generated 0 bytes in 160 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 11 19:25:36 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-57d9b02a-c975-4954-910d-6793f1ba4352 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:25:36 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-57d9b02a-c975-4954-910d-6793f1ba4352 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:25:36 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [None req-f0f7db11-772b-49ae-bea3-1a11ce09bdf9 tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] Calling method '>' {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:25:36 user devstack@n-api.service[72090]: DEBUG nova.compute.api [None req-f0f7db11-772b-49ae-bea3-1a11ce09bdf9 tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] [instance: a49d379e-3976-4d68-b6df-f572a922107c] Fetching instance by UUID {{(pid=72090) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:25:36 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-f0f7db11-772b-49ae-bea3-1a11ce09bdf9 tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:25:36 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-f0f7db11-772b-49ae-bea3-1a11ce09bdf9 tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:25:36 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-f0f7db11-772b-49ae-bea3-1a11ce09bdf9 tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:25:36 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-f0f7db11-772b-49ae-bea3-1a11ce09bdf9 tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:25:36 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-f0f7db11-772b-49ae-bea3-1a11ce09bdf9 tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:25:36 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-f0f7db11-772b-49ae-bea3-1a11ce09bdf9 tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:25:37 user devstack@n-api.service[72090]: DEBUG nova.policy [None req-f0f7db11-772b-49ae-bea3-1a11ce09bdf9 tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e95f55f8f9497592320a19f2ca7fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9f8ee2edca748e0bd03ace6f93be649', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72090) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:25:37 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [None req-f0f7db11-772b-49ae-bea3-1a11ce09bdf9 tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a49d379e-3976-4d68-b6df-f572a922107c" status: 200 len: 1650 microversion: 2.1 time: 0.312775 Apr 11 19:25:37 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 100/307] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 19:25:36 2023] GET /compute/v2.1/servers/a49d379e-3976-4d68-b6df-f572a922107c => generated 1650 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:25:37 user devstack@n-api.service[72089]: DEBUG nova.policy [None req-57d9b02a-c975-4954-910d-6793f1ba4352 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31c237e142784bd6aa460d6f1bf33400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd886d2ec5fc946b49af3c8ca7c8556c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72089) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:25:37 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [None req-57d9b02a-c975-4954-910d-6793f1ba4352 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6802f099-9236-4c79-a892-2963f1b15b0e" status: 200 len: 1538 microversion: 2.1 time: 0.369348 Apr 11 19:25:37 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 106/308] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 19:25:36 2023] GET /compute/v2.1/servers/6802f099-9236-4c79-a892-2963f1b15b0e => generated 1538 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:25:37 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [req-5d63a407-d552-4410-b6c4-f009f6d0086b req-861dc99e-c90a-48e8-8274-d626d030acd0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a49d379e-3976-4d68-b6df-f572a922107c", "name": "network-vif-unplugged", "status": "completed", "tag": "936e8263-dbb3-4e76-8f6d-0e3269dc6066"}]} {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:25:37 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-5d63a407-d552-4410-b6c4-f009f6d0086b req-861dc99e-c90a-48e8-8274-d626d030acd0 service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:25:37 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-5d63a407-d552-4410-b6c4-f009f6d0086b req-861dc99e-c90a-48e8-8274-d626d030acd0 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:25:37 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-5d63a407-d552-4410-b6c4-f009f6d0086b req-861dc99e-c90a-48e8-8274-d626d030acd0 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:25:37 user devstack@n-api.service[72088]: INFO nova.api.openstack.compute.server_external_events [req-5d63a407-d552-4410-b6c4-f009f6d0086b req-861dc99e-c90a-48e8-8274-d626d030acd0 service nova] Creating event network-vif-unplugged:936e8263-dbb3-4e76-8f6d-0e3269dc6066 for instance a49d379e-3976-4d68-b6df-f572a922107c on user Apr 11 19:25:37 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [req-5d63a407-d552-4410-b6c4-f009f6d0086b req-861dc99e-c90a-48e8-8274-d626d030acd0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.040926 Apr 11 19:25:37 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 103/309] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:25:37 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:25:38 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [req-d78386b2-2e69-4754-a85e-9573884183c3 req-8094c5bc-e39b-4dca-a4ec-995961d37963 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a49d379e-3976-4d68-b6df-f572a922107c", "name": "network-vif-deleted", "tag": "936e8263-dbb3-4e76-8f6d-0e3269dc6066"}]} {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:25:38 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-d78386b2-2e69-4754-a85e-9573884183c3 req-8094c5bc-e39b-4dca-a4ec-995961d37963 service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:25:38 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-d78386b2-2e69-4754-a85e-9573884183c3 req-8094c5bc-e39b-4dca-a4ec-995961d37963 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:25:38 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-d78386b2-2e69-4754-a85e-9573884183c3 req-8094c5bc-e39b-4dca-a4ec-995961d37963 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:25:38 user devstack@n-api.service[72090]: INFO nova.api.openstack.compute.server_external_events [req-d78386b2-2e69-4754-a85e-9573884183c3 req-8094c5bc-e39b-4dca-a4ec-995961d37963 service nova] Creating event network-vif-deleted:936e8263-dbb3-4e76-8f6d-0e3269dc6066 for instance a49d379e-3976-4d68-b6df-f572a922107c on user Apr 11 19:25:38 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [req-d78386b2-2e69-4754-a85e-9573884183c3 req-8094c5bc-e39b-4dca-a4ec-995961d37963 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056762 Apr 11 19:25:38 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 101/310] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:25:38 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:25:39 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [req-1b867779-6a13-4d12-9ccb-36ffde6e097b req-020ca99a-bfad-4362-be7a-199da2af7346 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a49d379e-3976-4d68-b6df-f572a922107c", "name": "network-vif-plugged", "status": "completed", "tag": "936e8263-dbb3-4e76-8f6d-0e3269dc6066"}]} {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:25:39 user devstack@n-api.service[72089]: DEBUG dbcounter [-] [72089] Writing DB stats nova_cell0:SELECT=2 {{(pid=72089) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:25:39 user devstack@n-api.service[72089]: DEBUG dbcounter [-] [72089] Writing DB stats nova_cell0:SELECT=6 {{(pid=72089) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:25:39 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-1b867779-6a13-4d12-9ccb-36ffde6e097b req-020ca99a-bfad-4362-be7a-199da2af7346 service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:25:39 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-1b867779-6a13-4d12-9ccb-36ffde6e097b req-020ca99a-bfad-4362-be7a-199da2af7346 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:25:39 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-1b867779-6a13-4d12-9ccb-36ffde6e097b req-020ca99a-bfad-4362-be7a-199da2af7346 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:25:39 user devstack@n-api.service[72089]: INFO nova.api.openstack.compute.server_external_events [req-1b867779-6a13-4d12-9ccb-36ffde6e097b req-020ca99a-bfad-4362-be7a-199da2af7346 service nova] Creating event network-vif-plugged:936e8263-dbb3-4e76-8f6d-0e3269dc6066 for instance a49d379e-3976-4d68-b6df-f572a922107c on user Apr 11 19:25:39 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [req-1b867779-6a13-4d12-9ccb-36ffde6e097b req-020ca99a-bfad-4362-be7a-199da2af7346 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068824 Apr 11 19:25:39 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 107/311] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:25:39 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:25:40 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [None req-779cfa10-9c3c-4b4f-a5b9-ab0a1869b9b0 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Calling method '>' {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:25:40 user devstack@n-api.service[72088]: DEBUG nova.compute.api [None req-779cfa10-9c3c-4b4f-a5b9-ab0a1869b9b0 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] [instance: 53ccc829-6323-48ec-b63f-9de9bc607456] Fetching instance by UUID {{(pid=72088) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:25:40 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-779cfa10-9c3c-4b4f-a5b9-ab0a1869b9b0 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:25:40 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-779cfa10-9c3c-4b4f-a5b9-ab0a1869b9b0 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:25:40 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-779cfa10-9c3c-4b4f-a5b9-ab0a1869b9b0 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:25:40 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-779cfa10-9c3c-4b4f-a5b9-ab0a1869b9b0 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:25:40 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-779cfa10-9c3c-4b4f-a5b9-ab0a1869b9b0 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:25:40 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-779cfa10-9c3c-4b4f-a5b9-ab0a1869b9b0 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:25:40 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [None req-779cfa10-9c3c-4b4f-a5b9-ab0a1869b9b0 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] 10.0.0.210 "GET /compute/v2.1/servers/53ccc829-6323-48ec-b63f-9de9bc607456/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.119325 Apr 11 19:25:40 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 104/312] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Apr 11 19:25:40 2023] GET /compute/v2.1/servers/53ccc829-6323-48ec-b63f-9de9bc607456/os-interface => generated 282 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:25:41 user devstack@n-api.service[72090]: DEBUG dbcounter [-] [72090] Writing DB stats nova_cell0:SELECT=2 {{(pid=72090) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:25:41 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [req-2f42dd2f-d81e-43ad-a7ad-7013fa173fa8 req-f421096e-0bf0-4610-a36d-c7ba61f2b1b2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "53ccc829-6323-48ec-b63f-9de9bc607456", "tag": "dfba7f5a-ea64-4504-8547-47f354d6a6ef"}]} {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:25:41 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-2f42dd2f-d81e-43ad-a7ad-7013fa173fa8 req-f421096e-0bf0-4610-a36d-c7ba61f2b1b2 service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:25:41 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-2f42dd2f-d81e-43ad-a7ad-7013fa173fa8 req-f421096e-0bf0-4610-a36d-c7ba61f2b1b2 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:25:41 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-2f42dd2f-d81e-43ad-a7ad-7013fa173fa8 req-f421096e-0bf0-4610-a36d-c7ba61f2b1b2 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:25:41 user devstack@n-api.service[72090]: INFO nova.api.openstack.compute.server_external_events [req-2f42dd2f-d81e-43ad-a7ad-7013fa173fa8 req-f421096e-0bf0-4610-a36d-c7ba61f2b1b2 service nova] Creating event network-changed:dfba7f5a-ea64-4504-8547-47f354d6a6ef for instance 53ccc829-6323-48ec-b63f-9de9bc607456 on user Apr 11 19:25:41 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [req-2f42dd2f-d81e-43ad-a7ad-7013fa173fa8 req-f421096e-0bf0-4610-a36d-c7ba61f2b1b2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054395 Apr 11 19:25:41 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 102/313] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:25:41 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:25:41 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [None req-f9d611c1-944d-4e70-a9bc-7b278fbfbc7e tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Calling method '>' {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:25:41 user devstack@n-api.service[72089]: DEBUG nova.compute.api [None req-f9d611c1-944d-4e70-a9bc-7b278fbfbc7e tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] [instance: 53ccc829-6323-48ec-b63f-9de9bc607456] Fetching instance by UUID {{(pid=72089) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:25:41 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-f9d611c1-944d-4e70-a9bc-7b278fbfbc7e tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:25:41 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-f9d611c1-944d-4e70-a9bc-7b278fbfbc7e tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:25:41 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-f9d611c1-944d-4e70-a9bc-7b278fbfbc7e tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:25:41 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-f9d611c1-944d-4e70-a9bc-7b278fbfbc7e tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:25:41 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-f9d611c1-944d-4e70-a9bc-7b278fbfbc7e tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:25:41 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-f9d611c1-944d-4e70-a9bc-7b278fbfbc7e tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:25:41 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [None req-f9d611c1-944d-4e70-a9bc-7b278fbfbc7e tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] 10.0.0.210 "GET /compute/v2.1/servers/53ccc829-6323-48ec-b63f-9de9bc607456/ips" status: 200 len: 107 microversion: 2.1 time: 0.049797 Apr 11 19:25:41 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 108/314] 10.0.0.210 () {62 vars in 1325 bytes} [Tue Apr 11 19:25:41 2023] GET /compute/v2.1/servers/53ccc829-6323-48ec-b63f-9de9bc607456/ips => generated 107 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:25:41 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [None req-5b2f5dac-6e30-44d5-bccc-8e4a66b2d696 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4940d74f-b60a-49aa-bf74-4e000efa8dc5"}} {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:25:41 user devstack@n-api.service[72088]: DEBUG nova.compute.api [None req-5b2f5dac-6e30-44d5-bccc-8e4a66b2d696 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] [instance: 53ccc829-6323-48ec-b63f-9de9bc607456] Fetching instance by UUID {{(pid=72088) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:25:41 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-5b2f5dac-6e30-44d5-bccc-8e4a66b2d696 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:25:41 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-5b2f5dac-6e30-44d5-bccc-8e4a66b2d696 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:25:41 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-5b2f5dac-6e30-44d5-bccc-8e4a66b2d696 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:25:41 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-5b2f5dac-6e30-44d5-bccc-8e4a66b2d696 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:25:41 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-5b2f5dac-6e30-44d5-bccc-8e4a66b2d696 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:25:41 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-5b2f5dac-6e30-44d5-bccc-8e4a66b2d696 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:25:41 user devstack@n-api.service[72088]: INFO nova.api.openstack.wsgi [None req-5b2f5dac-6e30-44d5-bccc-8e4a66b2d696 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] HTTP exception thrown: Invalid volume: volume 4940d74f-b60a-49aa-bf74-4e000efa8dc5 is already attached to instances: bed4001c-02c2-4c6b-84c8-61654df66d8b Apr 11 19:25:41 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [None req-5b2f5dac-6e30-44d5-bccc-8e4a66b2d696 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Request method failure captured: Apr 11 19:25:41 user devstack@n-api.service[72088]: request: POST /compute/v2.1/servers/53ccc829-6323-48ec-b63f-9de9bc607456/os-volume_attachments HTTP/1.1 Apr 11 19:25:41 user devstack@n-api.service[72088]: Accept: application/json Apr 11 19:25:41 user devstack@n-api.service[72088]: Accept-Encoding: identity Apr 11 19:25:41 user devstack@n-api.service[72088]: Connection: close Apr 11 19:25:41 user devstack@n-api.service[72088]: Content-Length: 74 Apr 11 19:25:41 user devstack@n-api.service[72088]: Content-Type: application/json Apr 11 19:25:41 user devstack@n-api.service[72088]: Host: 10.0.0.210 Apr 11 19:25:41 user devstack@n-api.service[72088]: Openstack-System-Scope: None Apr 11 19:25:41 user devstack@n-api.service[72088]: User-Agent: python-urllib3/1.26.15 Apr 11 19:25:41 user devstack@n-api.service[72088]: X-Auth-Token: gAAAAABkNbM9PPhjuxFro365bgGlzXmEeNXBFjH7B9DXRG846ZOMZNO8rjcHBUXZkmUpO9G06QygHvaEJVpRlrFcJIyDYtH16p4qIRFo8lVfjRkqkJh8soUAdF5jsPsH_hjCF2czbYEFIUpkQBo9PM7kG8byL_cnEa6VpD9RmxIaxcGcdobg_-U Apr 11 19:25:41 user devstack@n-api.service[72088]: X-Domain-Id: None Apr 11 19:25:41 user devstack@n-api.service[72088]: X-Domain-Name: None Apr 11 19:25:41 user devstack@n-api.service[72088]: X-Identity-Status: Confirmed Apr 11 19:25:41 user devstack@n-api.service[72088]: X-Is-Admin-Project: True Apr 11 19:25:41 user devstack@n-api.service[72088]: X-Project-Domain-Id: default Apr 11 19:25:41 user devstack@n-api.service[72088]: X-Project-Domain-Name: Default Apr 11 19:25:41 user devstack@n-api.service[72088]: X-Project-Id: 06966e2f4d3a4dec92282c7ad348635d Apr 11 19:25:41 user devstack@n-api.service[72088]: X-Project-Name: tempest-AttachVolumeNegativeTest-303418642 Apr 11 19:25:41 user devstack@n-api.service[72088]: X-Role: reader,member Apr 11 19:25:41 user devstack@n-api.service[72088]: X-Roles: reader,member Apr 11 19:25:41 user devstack@n-api.service[72088]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/06966e2f4d3a4dec92282c7ad348635d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/06966e2f4d3a4dec92282c7ad348635d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/06966e2f4d3a4dec92282c7ad348635d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 11 19:25:41 user devstack@n-api.service[72088]: X-Tenant: tempest-AttachVolumeNegativeTest-303418642 Apr 11 19:25:41 user devstack@n-api.service[72088]: X-Tenant-Id: 06966e2f4d3a4dec92282c7ad348635d Apr 11 19:25:41 user devstack@n-api.service[72088]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-303418642 Apr 11 19:25:41 user devstack@n-api.service[72088]: X-User: tempest-AttachVolumeNegativeTest-303418642-project-member Apr 11 19:25:41 user devstack@n-api.service[72088]: X-User-Domain-Id: default Apr 11 19:25:41 user devstack@n-api.service[72088]: X-User-Domain-Name: Default Apr 11 19:25:41 user devstack@n-api.service[72088]: X-User-Id: d5d405421ceb4d99967ef2e7f55e7809 Apr 11 19:25:41 user devstack@n-api.service[72088]: X-User-Name: tempest-AttachVolumeNegativeTest-303418642-project-member Apr 11 19:25:41 user devstack@n-api.service[72088]: Apr 11 19:25:41 user devstack@n-api.service[72088]: {"volumeAttachment": {"volumeId": "4940d74f-b60a-49aa-bf74-4e000efa8dc5"}} Apr 11 19:25:41 user devstack@n-api.service[72088]: method: > Apr 11 19:25:41 user devstack@n-api.service[72088]: exception: Invalid volume: volume 4940d74f-b60a-49aa-bf74-4e000efa8dc5 is already attached to instances: bed4001c-02c2-4c6b-84c8-61654df66d8b Apr 11 19:25:41 user devstack@n-api.service[72088]: action_args: {'server_id': '53ccc829-6323-48ec-b63f-9de9bc607456', 'body': {'volumeAttachment': {'volumeId': '4940d74f-b60a-49aa-bf74-4e000efa8dc5'}}} Apr 11 19:25:41 user devstack@n-api.service[72088]: {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 19:25:41 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:25:41 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Apr 11 19:25:41 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Apr 11 19:25:41 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Apr 11 19:25:41 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Apr 11 19:25:41 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Apr 11 19:25:41 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Apr 11 19:25:41 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5139, in attach_volume Apr 11 19:25:41 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Apr 11 19:25:41 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4979, in _check_volume_already_attached Apr 11 19:25:41 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Apr 11 19:25:41 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 4940d74f-b60a-49aa-bf74-4e000efa8dc5 is already attached to instances: bed4001c-02c2-4c6b-84c8-61654df66d8b Apr 11 19:25:41 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi Apr 11 19:25:41 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 19:25:41 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi Apr 11 19:25:41 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:25:41 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 19:25:41 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 19:25:41 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 19:25:41 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 19:25:41 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 19:25:41 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 19:25:41 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 11 19:25:41 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 11 19:25:41 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 11 19:25:41 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 11 19:25:41 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 11 19:25:41 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 11 19:25:41 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Apr 11 19:25:41 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Apr 11 19:25:41 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 4940d74f-b60a-49aa-bf74-4e000efa8dc5 is already attached to instances: bed4001c-02c2-4c6b-84c8-61654df66d8b Apr 11 19:25:41 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi Apr 11 19:25:41 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 19:25:41 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi Apr 11 19:25:41 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:25:41 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 19:25:41 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 19:25:41 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 19:25:41 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 19:25:41 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 4940d74f-b60a-49aa-bf74-4e000efa8dc5 is already attached to instances: bed4001c-02c2-4c6b-84c8-61654df66d8b Apr 11 19:25:41 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi Apr 11 19:25:41 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [None req-5b2f5dac-6e30-44d5-bccc-8e4a66b2d696 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Returning 400 to user: Invalid volume: volume 4940d74f-b60a-49aa-bf74-4e000efa8dc5 is already attached to instances: bed4001c-02c2-4c6b-84c8-61654df66d8b {{(pid=72088) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 19:25:41 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [None req-5b2f5dac-6e30-44d5-bccc-8e4a66b2d696 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] 10.0.0.210 "POST /compute/v2.1/servers/53ccc829-6323-48ec-b63f-9de9bc607456/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.135663 Apr 11 19:25:41 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 105/315] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Apr 11 19:25:41 2023] POST /compute/v2.1/servers/53ccc829-6323-48ec-b63f-9de9bc607456/os-volume_attachments => generated 174 bytes in 137 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 11 19:25:41 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [None req-8d0002c6-e57e-442d-826c-63473c616659 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Calling method '>' {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:25:41 user devstack@n-api.service[72090]: DEBUG nova.compute.api [None req-8d0002c6-e57e-442d-826c-63473c616659 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] [instance: 53ccc829-6323-48ec-b63f-9de9bc607456] Fetching instance by UUID {{(pid=72090) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:25:41 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-8d0002c6-e57e-442d-826c-63473c616659 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:25:41 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-8d0002c6-e57e-442d-826c-63473c616659 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:25:41 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-8d0002c6-e57e-442d-826c-63473c616659 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:25:41 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-8d0002c6-e57e-442d-826c-63473c616659 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:25:41 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-8d0002c6-e57e-442d-826c-63473c616659 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:25:41 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-8d0002c6-e57e-442d-826c-63473c616659 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:25:41 user devstack@n-api.service[72090]: DEBUG nova.compute.api [None req-8d0002c6-e57e-442d-826c-63473c616659 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] [instance: 53ccc829-6323-48ec-b63f-9de9bc607456] Going to try to terminate instance {{(pid=72090) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 11 19:25:41 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [None req-8d0002c6-e57e-442d-826c-63473c616659 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/53ccc829-6323-48ec-b63f-9de9bc607456" status: 204 len: 0 microversion: 2.1 time: 0.163556 Apr 11 19:25:41 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 103/316] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 19:25:41 2023] DELETE /compute/v2.1/servers/53ccc829-6323-48ec-b63f-9de9bc607456 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 11 19:25:41 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [None req-60e926d8-3945-4b0c-9b8f-d0d48c23e515 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Calling method '>' {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:25:41 user devstack@n-api.service[72089]: DEBUG nova.compute.api [None req-60e926d8-3945-4b0c-9b8f-d0d48c23e515 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] [instance: 53ccc829-6323-48ec-b63f-9de9bc607456] Fetching instance by UUID {{(pid=72089) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:25:41 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-60e926d8-3945-4b0c-9b8f-d0d48c23e515 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:25:41 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-60e926d8-3945-4b0c-9b8f-d0d48c23e515 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:25:41 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-60e926d8-3945-4b0c-9b8f-d0d48c23e515 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:25:41 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-60e926d8-3945-4b0c-9b8f-d0d48c23e515 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:25:41 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-60e926d8-3945-4b0c-9b8f-d0d48c23e515 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:25:41 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-60e926d8-3945-4b0c-9b8f-d0d48c23e515 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:25:42 user devstack@n-api.service[72089]: DEBUG nova.policy [None req-60e926d8-3945-4b0c-9b8f-d0d48c23e515 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5d405421ceb4d99967ef2e7f55e7809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06966e2f4d3a4dec92282c7ad348635d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72089) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:25:42 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [None req-60e926d8-3945-4b0c-9b8f-d0d48c23e515 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] 10.0.0.210 "GET /compute/v2.1/servers/53ccc829-6323-48ec-b63f-9de9bc607456" status: 200 len: 1549 microversion: 2.1 time: 0.256660 Apr 11 19:25:42 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 109/317] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 19:25:41 2023] GET /compute/v2.1/servers/53ccc829-6323-48ec-b63f-9de9bc607456 => generated 1549 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:25:42 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [None req-12ffab2c-f846-4be7-9132-e2fc7ee40937 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Calling method '>' {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:25:42 user devstack@n-api.service[72088]: DEBUG nova.compute.api [None req-12ffab2c-f846-4be7-9132-e2fc7ee40937 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] [instance: d424f88d-5f82-4cac-aa0f-4f99624bd3e7] Fetching instance by UUID {{(pid=72088) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:25:42 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-12ffab2c-f846-4be7-9132-e2fc7ee40937 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:25:42 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-12ffab2c-f846-4be7-9132-e2fc7ee40937 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:25:42 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-12ffab2c-f846-4be7-9132-e2fc7ee40937 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:25:42 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-12ffab2c-f846-4be7-9132-e2fc7ee40937 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:25:42 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-12ffab2c-f846-4be7-9132-e2fc7ee40937 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:25:42 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-12ffab2c-f846-4be7-9132-e2fc7ee40937 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:25:42 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [None req-12ffab2c-f846-4be7-9132-e2fc7ee40937 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d424f88d-5f82-4cac-aa0f-4f99624bd3e7/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.058670 Apr 11 19:25:42 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 106/318] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Apr 11 19:25:42 2023] GET /compute/v2.1/servers/d424f88d-5f82-4cac-aa0f-4f99624bd3e7/os-volume_attachments => generated 25 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 11 19:25:43 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [req-14cc3d42-80dd-4c43-aee6-30024078fd98 req-ab4c4a03-5508-4317-9a77-d10871ba570a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "53ccc829-6323-48ec-b63f-9de9bc607456", "name": "network-vif-unplugged", "status": "completed", "tag": "dfba7f5a-ea64-4504-8547-47f354d6a6ef"}, {"server_uuid": "53ccc829-6323-48ec-b63f-9de9bc607456", "name": "network-vif-plugged", "status": "completed", "tag": "dfba7f5a-ea64-4504-8547-47f354d6a6ef"}]} {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:25:43 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-14cc3d42-80dd-4c43-aee6-30024078fd98 req-ab4c4a03-5508-4317-9a77-d10871ba570a service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:25:43 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-14cc3d42-80dd-4c43-aee6-30024078fd98 req-ab4c4a03-5508-4317-9a77-d10871ba570a service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:25:43 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-14cc3d42-80dd-4c43-aee6-30024078fd98 req-ab4c4a03-5508-4317-9a77-d10871ba570a service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:25:43 user devstack@n-api.service[72090]: INFO nova.api.openstack.compute.server_external_events [req-14cc3d42-80dd-4c43-aee6-30024078fd98 req-ab4c4a03-5508-4317-9a77-d10871ba570a service nova] Creating event network-vif-unplugged:dfba7f5a-ea64-4504-8547-47f354d6a6ef for instance 53ccc829-6323-48ec-b63f-9de9bc607456 on user Apr 11 19:25:43 user devstack@n-api.service[72090]: INFO nova.api.openstack.compute.server_external_events [req-14cc3d42-80dd-4c43-aee6-30024078fd98 req-ab4c4a03-5508-4317-9a77-d10871ba570a service nova] Creating event network-vif-plugged:dfba7f5a-ea64-4504-8547-47f354d6a6ef for instance 53ccc829-6323-48ec-b63f-9de9bc607456 on user Apr 11 19:25:43 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [req-14cc3d42-80dd-4c43-aee6-30024078fd98 req-ab4c4a03-5508-4317-9a77-d10871ba570a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.047342 Apr 11 19:25:43 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 104/319] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:25:43 2023] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 11 19:25:43 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [req-252f2cbe-79dd-4489-a796-d4e221b7c68f req-d8fead73-bc17-4f90-bad9-a6edb894802c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "53ccc829-6323-48ec-b63f-9de9bc607456", "name": "network-vif-deleted", "tag": "dfba7f5a-ea64-4504-8547-47f354d6a6ef"}]} {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:25:43 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-252f2cbe-79dd-4489-a796-d4e221b7c68f req-d8fead73-bc17-4f90-bad9-a6edb894802c service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:25:43 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-252f2cbe-79dd-4489-a796-d4e221b7c68f req-d8fead73-bc17-4f90-bad9-a6edb894802c service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:25:43 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-252f2cbe-79dd-4489-a796-d4e221b7c68f req-d8fead73-bc17-4f90-bad9-a6edb894802c service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:25:43 user devstack@n-api.service[72089]: INFO nova.api.openstack.compute.server_external_events [req-252f2cbe-79dd-4489-a796-d4e221b7c68f req-d8fead73-bc17-4f90-bad9-a6edb894802c service nova] Creating event network-vif-deleted:dfba7f5a-ea64-4504-8547-47f354d6a6ef for instance 53ccc829-6323-48ec-b63f-9de9bc607456 on user Apr 11 19:25:43 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [req-252f2cbe-79dd-4489-a796-d4e221b7c68f req-d8fead73-bc17-4f90-bad9-a6edb894802c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032938 Apr 11 19:25:43 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 110/320] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:25:43 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:25:43 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [None req-f0a898cc-2276-4347-95c5-a9d7a59e0350 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestStampPatternsnapshot-1444549245"}} {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:25:43 user devstack@n-api.service[72088]: DEBUG nova.compute.api [None req-f0a898cc-2276-4347-95c5-a9d7a59e0350 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] [instance: d424f88d-5f82-4cac-aa0f-4f99624bd3e7] Fetching instance by UUID {{(pid=72088) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:25:43 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-f0a898cc-2276-4347-95c5-a9d7a59e0350 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:25:43 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-f0a898cc-2276-4347-95c5-a9d7a59e0350 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:25:43 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-f0a898cc-2276-4347-95c5-a9d7a59e0350 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:25:43 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-f0a898cc-2276-4347-95c5-a9d7a59e0350 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:25:43 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-f0a898cc-2276-4347-95c5-a9d7a59e0350 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:25:43 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-f0a898cc-2276-4347-95c5-a9d7a59e0350 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:25:44 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [None req-6e06bae6-5ad5-44f7-888b-5ae0b27fe21c tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] Action: 'action', calling method: >, body: {"rescue": {"rescue_image_ref": "6a269858-cd4f-452f-ae3e-e35cf198749c"}} {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:25:44 user devstack@n-api.service[72090]: DEBUG nova.compute.api [None req-6e06bae6-5ad5-44f7-888b-5ae0b27fe21c tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] [instance: aa0bb9aa-a93d-45bc-9f90-46eeb6416365] Fetching instance by UUID {{(pid=72090) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:25:44 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-6e06bae6-5ad5-44f7-888b-5ae0b27fe21c tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:25:44 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-6e06bae6-5ad5-44f7-888b-5ae0b27fe21c tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:25:44 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-6e06bae6-5ad5-44f7-888b-5ae0b27fe21c tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:25:44 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-6e06bae6-5ad5-44f7-888b-5ae0b27fe21c tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:25:44 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-6e06bae6-5ad5-44f7-888b-5ae0b27fe21c tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:25:44 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-6e06bae6-5ad5-44f7-888b-5ae0b27fe21c tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:25:44 user devstack@n-api.service[72090]: DEBUG nova.objects.instance [None req-6e06bae6-5ad5-44f7-888b-5ae0b27fe21c tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] Lazy-loading 'flavor' on Instance uuid aa0bb9aa-a93d-45bc-9f90-46eeb6416365 {{(pid=72090) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 11 19:25:44 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [None req-6e06bae6-5ad5-44f7-888b-5ae0b27fe21c tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] 10.0.0.210 "POST /compute/v2.1/servers/aa0bb9aa-a93d-45bc-9f90-46eeb6416365/action" status: 200 len: 29 microversion: 2.1 time: 0.342222 Apr 11 19:25:44 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 105/321] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Apr 11 19:25:44 2023] POST /compute/v2.1/servers/aa0bb9aa-a93d-45bc-9f90-46eeb6416365/action => generated 29 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 11 19:25:44 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [None req-8e1c4cd1-3612-43d7-b26a-86e58c8ad6f9 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] Calling method '>' {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:25:44 user devstack@n-api.service[72089]: DEBUG nova.compute.api [None req-8e1c4cd1-3612-43d7-b26a-86e58c8ad6f9 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] [instance: aa0bb9aa-a93d-45bc-9f90-46eeb6416365] Fetching instance by UUID {{(pid=72089) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:25:44 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-8e1c4cd1-3612-43d7-b26a-86e58c8ad6f9 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:25:44 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-8e1c4cd1-3612-43d7-b26a-86e58c8ad6f9 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:25:44 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-8e1c4cd1-3612-43d7-b26a-86e58c8ad6f9 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:25:44 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-8e1c4cd1-3612-43d7-b26a-86e58c8ad6f9 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:25:44 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-8e1c4cd1-3612-43d7-b26a-86e58c8ad6f9 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:25:44 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-8e1c4cd1-3612-43d7-b26a-86e58c8ad6f9 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:25:44 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [None req-f0a898cc-2276-4347-95c5-a9d7a59e0350 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] 10.0.0.210 "POST /compute/v2.1/servers/d424f88d-5f82-4cac-aa0f-4f99624bd3e7/action" status: 202 len: 0 microversion: 2.1 time: 0.981627 Apr 11 19:25:44 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 107/322] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Apr 11 19:25:43 2023] POST /compute/v2.1/servers/d424f88d-5f82-4cac-aa0f-4f99624bd3e7/action => generated 0 bytes in 983 msecs (HTTP/1.1 202) 10 headers in 449 bytes (1 switches on core 0) Apr 11 19:25:44 user devstack@n-api.service[72089]: DEBUG nova.policy [None req-8e1c4cd1-3612-43d7-b26a-86e58c8ad6f9 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26f091a1508b4d2689005b660f6a1380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ee7c68b277420ba524c2a99cd444ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72089) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:25:44 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [None req-8e1c4cd1-3612-43d7-b26a-86e58c8ad6f9 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] 10.0.0.210 "GET /compute/v2.1/servers/aa0bb9aa-a93d-45bc-9f90-46eeb6416365" status: 200 len: 1723 microversion: 2.1 time: 0.167085 Apr 11 19:25:44 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 111/323] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 19:25:44 2023] GET /compute/v2.1/servers/aa0bb9aa-a93d-45bc-9f90-46eeb6416365 => generated 1723 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 19:25:46 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [req-79d5a192-a6df-4da5-b9b6-4ea8658e3560 req-49639e55-e237-4f8a-8cc1-945e18e11d87 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa0bb9aa-a93d-45bc-9f90-46eeb6416365", "name": "network-vif-unplugged", "status": "completed", "tag": "5a15e207-1839-4be5-80b2-fc995098dbbf"}]} {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:25:46 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-79d5a192-a6df-4da5-b9b6-4ea8658e3560 req-49639e55-e237-4f8a-8cc1-945e18e11d87 service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:25:46 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-79d5a192-a6df-4da5-b9b6-4ea8658e3560 req-49639e55-e237-4f8a-8cc1-945e18e11d87 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:25:46 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-79d5a192-a6df-4da5-b9b6-4ea8658e3560 req-49639e55-e237-4f8a-8cc1-945e18e11d87 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:25:46 user devstack@n-api.service[72090]: INFO nova.api.openstack.compute.server_external_events [req-79d5a192-a6df-4da5-b9b6-4ea8658e3560 req-49639e55-e237-4f8a-8cc1-945e18e11d87 service nova] Creating event network-vif-unplugged:5a15e207-1839-4be5-80b2-fc995098dbbf for instance aa0bb9aa-a93d-45bc-9f90-46eeb6416365 on user Apr 11 19:25:46 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [req-79d5a192-a6df-4da5-b9b6-4ea8658e3560 req-49639e55-e237-4f8a-8cc1-945e18e11d87 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.047863 Apr 11 19:25:46 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 106/324] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:25:46 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:25:48 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [req-55bd52ad-ef98-47df-836c-342456f7e17c req-dd012ceb-20d3-4c5b-a64e-9030203b0ff0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa0bb9aa-a93d-45bc-9f90-46eeb6416365", "name": "network-vif-plugged", "status": "completed", "tag": "5a15e207-1839-4be5-80b2-fc995098dbbf"}]} {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:25:48 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-55bd52ad-ef98-47df-836c-342456f7e17c req-dd012ceb-20d3-4c5b-a64e-9030203b0ff0 service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:25:48 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-55bd52ad-ef98-47df-836c-342456f7e17c req-dd012ceb-20d3-4c5b-a64e-9030203b0ff0 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:25:48 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-55bd52ad-ef98-47df-836c-342456f7e17c req-dd012ceb-20d3-4c5b-a64e-9030203b0ff0 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:25:48 user devstack@n-api.service[72088]: INFO nova.api.openstack.compute.server_external_events [req-55bd52ad-ef98-47df-836c-342456f7e17c req-dd012ceb-20d3-4c5b-a64e-9030203b0ff0 service nova] Creating event network-vif-plugged:5a15e207-1839-4be5-80b2-fc995098dbbf for instance aa0bb9aa-a93d-45bc-9f90-46eeb6416365 on user Apr 11 19:25:48 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [req-55bd52ad-ef98-47df-836c-342456f7e17c req-dd012ceb-20d3-4c5b-a64e-9030203b0ff0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.129592 Apr 11 19:25:48 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 108/325] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:25:48 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:25:52 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [req-eaebbff3-16e8-4d3b-85d6-667ce17bd280 req-7c10bf5a-cfa3-42b0-b0e6-252034436211 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa0bb9aa-a93d-45bc-9f90-46eeb6416365", "name": "network-vif-plugged", "status": "completed", "tag": "5a15e207-1839-4be5-80b2-fc995098dbbf"}]} {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:25:52 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-eaebbff3-16e8-4d3b-85d6-667ce17bd280 req-7c10bf5a-cfa3-42b0-b0e6-252034436211 service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:25:52 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-eaebbff3-16e8-4d3b-85d6-667ce17bd280 req-7c10bf5a-cfa3-42b0-b0e6-252034436211 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:25:52 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-eaebbff3-16e8-4d3b-85d6-667ce17bd280 req-7c10bf5a-cfa3-42b0-b0e6-252034436211 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:25:52 user devstack@n-api.service[72089]: INFO nova.api.openstack.compute.server_external_events [req-eaebbff3-16e8-4d3b-85d6-667ce17bd280 req-7c10bf5a-cfa3-42b0-b0e6-252034436211 service nova] Creating event network-vif-plugged:5a15e207-1839-4be5-80b2-fc995098dbbf for instance aa0bb9aa-a93d-45bc-9f90-46eeb6416365 on user Apr 11 19:25:52 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [req-eaebbff3-16e8-4d3b-85d6-667ce17bd280 req-7c10bf5a-cfa3-42b0-b0e6-252034436211 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047689 Apr 11 19:25:52 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 112/326] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:25:52 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:25:54 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [req-a19f2dd6-1820-4927-9ff0-9cac591b79d2 req-0308c9fa-b112-4d62-9538-b514d1a3c00b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa0bb9aa-a93d-45bc-9f90-46eeb6416365", "name": "network-vif-plugged", "status": "completed", "tag": "5a15e207-1839-4be5-80b2-fc995098dbbf"}]} {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:25:54 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-a19f2dd6-1820-4927-9ff0-9cac591b79d2 req-0308c9fa-b112-4d62-9538-b514d1a3c00b service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:25:54 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-a19f2dd6-1820-4927-9ff0-9cac591b79d2 req-0308c9fa-b112-4d62-9538-b514d1a3c00b service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:25:54 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-a19f2dd6-1820-4927-9ff0-9cac591b79d2 req-0308c9fa-b112-4d62-9538-b514d1a3c00b service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:25:54 user devstack@n-api.service[72090]: INFO nova.api.openstack.compute.server_external_events [req-a19f2dd6-1820-4927-9ff0-9cac591b79d2 req-0308c9fa-b112-4d62-9538-b514d1a3c00b service nova] Creating event network-vif-plugged:5a15e207-1839-4be5-80b2-fc995098dbbf for instance aa0bb9aa-a93d-45bc-9f90-46eeb6416365 on user Apr 11 19:25:54 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [req-a19f2dd6-1820-4927-9ff0-9cac591b79d2 req-0308c9fa-b112-4d62-9538-b514d1a3c00b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029861 Apr 11 19:25:54 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 107/327] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:25:54 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:25:54 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [None req-b7cce4d5-88dc-4a21-a230-299eb2190bd4 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestStampPattern-server-222957451", "imageRef": "d7d799c2-1b6d-4055-a3ab-a4130305113e", "flavorRef": "42", "key_name": "tempest-TestStampPattern-1385471309", "security_groups": [{"name": "tempest-secgroup-smoke-1850724180"}], "networks": [{"uuid": "1fb5e332-872b-4b2a-864b-eca71e3fb7cb"}]}} {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:25:54 user devstack@n-api.service[72088]: DEBUG nova.network.neutron [None req-b7cce4d5-88dc-4a21-a230-299eb2190bd4 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] validate_networks() for [('1fb5e332-872b-4b2a-864b-eca71e3fb7cb', None, None, None, None, None)] {{(pid=72088) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 11 19:25:55 user devstack@n-api.service[72088]: DEBUG nova.virt.hardware [None req-b7cce4d5-88dc-4a21-a230-299eb2190bd4 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Flavor limits 0:0:0 {{(pid=72088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 19:25:55 user devstack@n-api.service[72088]: DEBUG nova.virt.hardware [None req-b7cce4d5-88dc-4a21-a230-299eb2190bd4 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Image limits 0:0:0 {{(pid=72088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 19:25:55 user devstack@n-api.service[72088]: DEBUG nova.virt.hardware [None req-b7cce4d5-88dc-4a21-a230-299eb2190bd4 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Flavor pref 0:0:0 {{(pid=72088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 19:25:55 user devstack@n-api.service[72088]: DEBUG nova.virt.hardware [None req-b7cce4d5-88dc-4a21-a230-299eb2190bd4 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Image pref 0:0:0 {{(pid=72088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 19:25:55 user devstack@n-api.service[72088]: DEBUG nova.virt.hardware [None req-b7cce4d5-88dc-4a21-a230-299eb2190bd4 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 19:25:55 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-b7cce4d5-88dc-4a21-a230-299eb2190bd4 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:25:55 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-b7cce4d5-88dc-4a21-a230-299eb2190bd4 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:25:55 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-b7cce4d5-88dc-4a21-a230-299eb2190bd4 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:25:55 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-b7cce4d5-88dc-4a21-a230-299eb2190bd4 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:25:55 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-b7cce4d5-88dc-4a21-a230-299eb2190bd4 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:25:55 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-b7cce4d5-88dc-4a21-a230-299eb2190bd4 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:25:55 user devstack@n-api.service[72088]: DEBUG nova.quota [None req-b7cce4d5-88dc-4a21-a230-299eb2190bd4 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Getting quotas for project bceca6e3506e43f68f9cf8d0b56d141b. Resources: {'ram', 'instances', 'cores'} {{(pid=72088) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 19:25:55 user devstack@n-api.service[72088]: DEBUG nova.quota [None req-b7cce4d5-88dc-4a21-a230-299eb2190bd4 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Getting quotas for user 3a32a5d0547141a180f655e98567ed9a and project bceca6e3506e43f68f9cf8d0b56d141b. Resources: {'ram', 'instances', 'cores'} {{(pid=72088) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 19:25:55 user devstack@n-api.service[72088]: DEBUG nova.compute.api [None req-b7cce4d5-88dc-4a21-a230-299eb2190bd4 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Going to run 1 instances... {{(pid=72088) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 11 19:25:55 user devstack@n-api.service[72088]: DEBUG nova.compute.api [None req-b7cce4d5-88dc-4a21-a230-299eb2190bd4 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] [instance: f37ed08c-8c9a-4af7-ba5f-b8a942e54389] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d7d799c2-1b6d-4055-a3ab-a4130305113e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=72088) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 11 19:25:55 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [None req-b7cce4d5-88dc-4a21-a230-299eb2190bd4 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.611219 Apr 11 19:25:55 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 109/328] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 11 19:25:54 2023] POST /compute/v2.1/servers => generated 404 bytes in 613 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 11 19:25:55 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [None req-234cad8c-04b7-4bee-a8b7-13f94df2e1f8 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Calling method '>' {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:25:55 user devstack@n-api.service[72089]: DEBUG nova.compute.api [None req-234cad8c-04b7-4bee-a8b7-13f94df2e1f8 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] [instance: f37ed08c-8c9a-4af7-ba5f-b8a942e54389] Fetching instance by UUID {{(pid=72089) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:25:55 user devstack@n-api.service[72089]: DEBUG nova.policy [None req-234cad8c-04b7-4bee-a8b7-13f94df2e1f8 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a32a5d0547141a180f655e98567ed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bceca6e3506e43f68f9cf8d0b56d141b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72089) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:25:55 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [None req-234cad8c-04b7-4bee-a8b7-13f94df2e1f8 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f37ed08c-8c9a-4af7-ba5f-b8a942e54389" status: 200 len: 1236 microversion: 2.1 time: 0.071097 Apr 11 19:25:55 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 113/329] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 19:25:55 2023] GET /compute/v2.1/servers/f37ed08c-8c9a-4af7-ba5f-b8a942e54389 => generated 1236 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:25:56 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [None req-169ab6ae-c6dd-4f80-8979-35cb65eba12d tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] Calling method '>' {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:25:56 user devstack@n-api.service[72090]: DEBUG nova.compute.api [None req-169ab6ae-c6dd-4f80-8979-35cb65eba12d tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] [instance: ac961841-1fc4-4cec-89bd-8f932270441a] Fetching instance by UUID {{(pid=72090) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:25:56 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-169ab6ae-c6dd-4f80-8979-35cb65eba12d tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:25:56 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-169ab6ae-c6dd-4f80-8979-35cb65eba12d tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:25:56 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-169ab6ae-c6dd-4f80-8979-35cb65eba12d tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:25:56 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-169ab6ae-c6dd-4f80-8979-35cb65eba12d tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:25:56 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-169ab6ae-c6dd-4f80-8979-35cb65eba12d tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:25:56 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-169ab6ae-c6dd-4f80-8979-35cb65eba12d tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:25:56 user devstack@n-api.service[72090]: DEBUG nova.policy [None req-169ab6ae-c6dd-4f80-8979-35cb65eba12d tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c9641ceb17e4914b1cdf061c5bdc79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7543456a70d04d7f8c50f37e64b7ee9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72090) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:25:56 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [None req-169ab6ae-c6dd-4f80-8979-35cb65eba12d tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ac961841-1fc4-4cec-89bd-8f932270441a" status: 200 len: 1485 microversion: 2.1 time: 0.233103 Apr 11 19:25:56 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 108/330] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 19:25:56 2023] GET /compute/v2.1/servers/ac961841-1fc4-4cec-89bd-8f932270441a => generated 1485 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:25:58 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [req-bd6c051e-f996-4f5a-80f5-0194213b01cd req-6ddd064b-8535-4741-817e-8d570ccb08b7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f37ed08c-8c9a-4af7-ba5f-b8a942e54389", "tag": "77bd0f58-75d0-4cc3-ab98-4f4b31401482"}]} {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:25:58 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-bd6c051e-f996-4f5a-80f5-0194213b01cd req-6ddd064b-8535-4741-817e-8d570ccb08b7 service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:25:58 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-bd6c051e-f996-4f5a-80f5-0194213b01cd req-6ddd064b-8535-4741-817e-8d570ccb08b7 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:25:58 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-bd6c051e-f996-4f5a-80f5-0194213b01cd req-6ddd064b-8535-4741-817e-8d570ccb08b7 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:25:58 user devstack@n-api.service[72088]: INFO nova.api.openstack.compute.server_external_events [req-bd6c051e-f996-4f5a-80f5-0194213b01cd req-6ddd064b-8535-4741-817e-8d570ccb08b7 service nova] Creating event network-changed:77bd0f58-75d0-4cc3-ab98-4f4b31401482 for instance f37ed08c-8c9a-4af7-ba5f-b8a942e54389 on user Apr 11 19:25:58 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [req-bd6c051e-f996-4f5a-80f5-0194213b01cd req-6ddd064b-8535-4741-817e-8d570ccb08b7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037086 Apr 11 19:25:58 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 110/331] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:25:58 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 11 19:25:59 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [None req-ccf15061-88bf-4b88-9f95-35b8cffd440b tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] Calling method '>' {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:25:59 user devstack@n-api.service[72089]: DEBUG nova.compute.api [None req-ccf15061-88bf-4b88-9f95-35b8cffd440b tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] [instance: 083108da-0a96-4177-8866-66131d77c39b] Fetching instance by UUID {{(pid=72089) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:25:59 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-ccf15061-88bf-4b88-9f95-35b8cffd440b tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:25:59 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-ccf15061-88bf-4b88-9f95-35b8cffd440b tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:25:59 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-ccf15061-88bf-4b88-9f95-35b8cffd440b tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:25:59 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-ccf15061-88bf-4b88-9f95-35b8cffd440b tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:25:59 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-ccf15061-88bf-4b88-9f95-35b8cffd440b tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:25:59 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-ccf15061-88bf-4b88-9f95-35b8cffd440b tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:25:59 user devstack@n-api.service[72089]: DEBUG nova.policy [None req-ccf15061-88bf-4b88-9f95-35b8cffd440b tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b4a383f04d4269a0099a738e14807e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f153e6b272924b8fa0ef28fb5f0970bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72089) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:25:59 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [None req-ccf15061-88bf-4b88-9f95-35b8cffd440b tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] 10.0.0.210 "GET /compute/v2.1/servers/083108da-0a96-4177-8866-66131d77c39b" status: 200 len: 1494 microversion: 2.1 time: 0.166253 Apr 11 19:25:59 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 114/332] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 19:25:59 2023] GET /compute/v2.1/servers/083108da-0a96-4177-8866-66131d77c39b => generated 1494 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:26:00 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [req-3e97d7c3-df00-4096-9067-ff2799c27d4a req-629e1139-ee9a-48f7-9808-d32d36e9b3c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f37ed08c-8c9a-4af7-ba5f-b8a942e54389", "name": "network-vif-plugged", "status": "completed", "tag": "77bd0f58-75d0-4cc3-ab98-4f4b31401482"}]} {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:26:00 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-3e97d7c3-df00-4096-9067-ff2799c27d4a req-629e1139-ee9a-48f7-9808-d32d36e9b3c0 service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:26:00 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-3e97d7c3-df00-4096-9067-ff2799c27d4a req-629e1139-ee9a-48f7-9808-d32d36e9b3c0 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:26:00 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-3e97d7c3-df00-4096-9067-ff2799c27d4a req-629e1139-ee9a-48f7-9808-d32d36e9b3c0 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:26:00 user devstack@n-api.service[72090]: INFO nova.api.openstack.compute.server_external_events [req-3e97d7c3-df00-4096-9067-ff2799c27d4a req-629e1139-ee9a-48f7-9808-d32d36e9b3c0 service nova] Creating event network-vif-plugged:77bd0f58-75d0-4cc3-ab98-4f4b31401482 for instance f37ed08c-8c9a-4af7-ba5f-b8a942e54389 on user Apr 11 19:26:00 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [req-3e97d7c3-df00-4096-9067-ff2799c27d4a req-629e1139-ee9a-48f7-9808-d32d36e9b3c0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032259 Apr 11 19:26:00 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 109/333] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:26:00 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:26:02 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [req-ad2485e0-de87-42bb-8239-e742f7f76429 req-48e46c55-7719-4ae0-84fc-a986c8825f41 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f37ed08c-8c9a-4af7-ba5f-b8a942e54389", "name": "network-vif-plugged", "status": "completed", "tag": "77bd0f58-75d0-4cc3-ab98-4f4b31401482"}]} {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:26:02 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-ad2485e0-de87-42bb-8239-e742f7f76429 req-48e46c55-7719-4ae0-84fc-a986c8825f41 service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:26:02 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-ad2485e0-de87-42bb-8239-e742f7f76429 req-48e46c55-7719-4ae0-84fc-a986c8825f41 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:26:02 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-ad2485e0-de87-42bb-8239-e742f7f76429 req-48e46c55-7719-4ae0-84fc-a986c8825f41 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:26:02 user devstack@n-api.service[72088]: INFO nova.api.openstack.compute.server_external_events [req-ad2485e0-de87-42bb-8239-e742f7f76429 req-48e46c55-7719-4ae0-84fc-a986c8825f41 service nova] Creating event network-vif-plugged:77bd0f58-75d0-4cc3-ab98-4f4b31401482 for instance f37ed08c-8c9a-4af7-ba5f-b8a942e54389 on user Apr 11 19:26:02 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [req-ad2485e0-de87-42bb-8239-e742f7f76429 req-48e46c55-7719-4ae0-84fc-a986c8825f41 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060677 Apr 11 19:26:02 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 111/334] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:26:02 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:26:09 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [None req-0de3e6fc-69cb-4a59-84ed-0a0d0cfcfa8c tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] Calling method '>' {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:26:09 user devstack@n-api.service[72089]: DEBUG nova.compute.api [None req-0de3e6fc-69cb-4a59-84ed-0a0d0cfcfa8c tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] [instance: e84ad0e4-a65b-404c-adbf-c49d5f0b3cca] Fetching instance by UUID {{(pid=72089) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:26:09 user devstack@n-api.service[72089]: DEBUG dbcounter [-] [72089] Writing DB stats nova_cell0:SELECT=2 {{(pid=72089) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:26:09 user devstack@n-api.service[72089]: DEBUG dbcounter [-] [72089] Writing DB stats nova_api:SELECT=23 {{(pid=72089) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:26:09 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-0de3e6fc-69cb-4a59-84ed-0a0d0cfcfa8c tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:26:09 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-0de3e6fc-69cb-4a59-84ed-0a0d0cfcfa8c tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:26:09 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-0de3e6fc-69cb-4a59-84ed-0a0d0cfcfa8c tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:26:09 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-0de3e6fc-69cb-4a59-84ed-0a0d0cfcfa8c tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:26:09 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-0de3e6fc-69cb-4a59-84ed-0a0d0cfcfa8c tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:26:09 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-0de3e6fc-69cb-4a59-84ed-0a0d0cfcfa8c tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:26:09 user devstack@n-api.service[72089]: DEBUG dbcounter [-] [72089] Writing DB stats nova_cell1:SELECT=47,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=72089) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:26:09 user devstack@n-api.service[72089]: INFO nova.api.openstack.wsgi [None req-0de3e6fc-69cb-4a59-84ed-0a0d0cfcfa8c tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] HTTP exception thrown: Instance e84ad0e4-a65b-404c-adbf-c49d5f0b3cca could not be found. Apr 11 19:26:09 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [None req-0de3e6fc-69cb-4a59-84ed-0a0d0cfcfa8c tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] Request method failure captured: Apr 11 19:26:09 user devstack@n-api.service[72089]: request: GET /compute/v2.1/servers/e84ad0e4-a65b-404c-adbf-c49d5f0b3cca HTTP/1.1 Apr 11 19:26:09 user devstack@n-api.service[72089]: Accept: application/json Apr 11 19:26:09 user devstack@n-api.service[72089]: Accept-Encoding: identity Apr 11 19:26:09 user devstack@n-api.service[72089]: Connection: close Apr 11 19:26:09 user devstack@n-api.service[72089]: Content-Length: 0 Apr 11 19:26:09 user devstack@n-api.service[72089]: Content-Type: application/json Apr 11 19:26:09 user devstack@n-api.service[72089]: Host: 10.0.0.210 Apr 11 19:26:09 user devstack@n-api.service[72089]: Openstack-System-Scope: None Apr 11 19:26:09 user devstack@n-api.service[72089]: User-Agent: python-urllib3/1.26.15 Apr 11 19:26:09 user devstack@n-api.service[72089]: X-Auth-Token: gAAAAABkNbM9ghjK_EzyGnW10Ps6cv4IuUgiOsH3-4CZQwwhssOT7z-coBiD1Tdn5TLuazoYlNl2MKZxDC8EHQ-1kxF1ymJhDXjVHNMOdUuaIOx6Zld44aVLhO1ciOh-QMlmbYyfhSKlVncwSZpaRu_co_jrVH31BrJgKqwLygUbeq6C-c51jnQ Apr 11 19:26:09 user devstack@n-api.service[72089]: X-Domain-Id: None Apr 11 19:26:09 user devstack@n-api.service[72089]: X-Domain-Name: None Apr 11 19:26:09 user devstack@n-api.service[72089]: X-Identity-Status: Confirmed Apr 11 19:26:09 user devstack@n-api.service[72089]: X-Is-Admin-Project: True Apr 11 19:26:09 user devstack@n-api.service[72089]: X-Project-Domain-Id: default Apr 11 19:26:09 user devstack@n-api.service[72089]: X-Project-Domain-Name: Default Apr 11 19:26:09 user devstack@n-api.service[72089]: X-Project-Id: 0d5d7769df1e4974b295cb30407151dd Apr 11 19:26:09 user devstack@n-api.service[72089]: X-Project-Name: tempest-ServersNegativeTestJSON-1311045721 Apr 11 19:26:09 user devstack@n-api.service[72089]: X-Role: reader,member Apr 11 19:26:09 user devstack@n-api.service[72089]: X-Roles: reader,member Apr 11 19:26:09 user devstack@n-api.service[72089]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0d5d7769df1e4974b295cb30407151dd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/0d5d7769df1e4974b295cb30407151dd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0d5d7769df1e4974b295cb30407151dd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 11 19:26:09 user devstack@n-api.service[72089]: X-Tenant: tempest-ServersNegativeTestJSON-1311045721 Apr 11 19:26:09 user devstack@n-api.service[72089]: X-Tenant-Id: 0d5d7769df1e4974b295cb30407151dd Apr 11 19:26:09 user devstack@n-api.service[72089]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1311045721 Apr 11 19:26:09 user devstack@n-api.service[72089]: X-User: tempest-ServersNegativeTestJSON-1311045721-project-member Apr 11 19:26:09 user devstack@n-api.service[72089]: X-User-Domain-Id: default Apr 11 19:26:09 user devstack@n-api.service[72089]: X-User-Domain-Name: Default Apr 11 19:26:09 user devstack@n-api.service[72089]: X-User-Id: 2f44dfa2528b4540a81f4eb7c3f3f2f5 Apr 11 19:26:09 user devstack@n-api.service[72089]: X-User-Name: tempest-ServersNegativeTestJSON-1311045721-project-member Apr 11 19:26:09 user devstack@n-api.service[72089]: method: > Apr 11 19:26:09 user devstack@n-api.service[72089]: exception: Instance e84ad0e4-a65b-404c-adbf-c49d5f0b3cca could not be found. Apr 11 19:26:09 user devstack@n-api.service[72089]: action_args: {'id': 'e84ad0e4-a65b-404c-adbf-c49d5f0b3cca'} Apr 11 19:26:09 user devstack@n-api.service[72089]: {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 19:26:09 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:26:09 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 19:26:09 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 19:26:09 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 19:26:09 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 19:26:09 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 19:26:09 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 19:26:09 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 19:26:09 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 19:26:09 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e84ad0e4-a65b-404c-adbf-c49d5f0b3cca could not be found. Apr 11 19:26:09 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi Apr 11 19:26:09 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 19:26:09 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi Apr 11 19:26:09 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:26:09 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 19:26:09 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 19:26:09 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 19:26:09 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 19:26:09 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 19:26:09 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 19:26:09 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 19:26:09 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 19:26:09 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 19:26:09 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 19:26:09 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 19:26:09 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 19:26:09 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e84ad0e4-a65b-404c-adbf-c49d5f0b3cca could not be found. Apr 11 19:26:09 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi Apr 11 19:26:09 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 19:26:09 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi Apr 11 19:26:09 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:26:09 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 19:26:09 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 19:26:09 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 19:26:09 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 19:26:09 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e84ad0e4-a65b-404c-adbf-c49d5f0b3cca could not be found. Apr 11 19:26:09 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi Apr 11 19:26:09 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [None req-0de3e6fc-69cb-4a59-84ed-0a0d0cfcfa8c tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] Returning 404 to user: Instance e84ad0e4-a65b-404c-adbf-c49d5f0b3cca could not be found. {{(pid=72089) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 19:26:09 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [None req-0de3e6fc-69cb-4a59-84ed-0a0d0cfcfa8c tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e84ad0e4-a65b-404c-adbf-c49d5f0b3cca" status: 404 len: 111 microversion: 2.1 time: 0.063044 Apr 11 19:26:09 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 115/335] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 19:26:09 2023] GET /compute/v2.1/servers/e84ad0e4-a65b-404c-adbf-c49d5f0b3cca => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 19:26:09 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [None req-590f9abb-7d8d-40c2-8910-941f86a165a2 tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] Calling method '>' {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:26:09 user devstack@n-api.service[72090]: DEBUG nova.compute.api [None req-590f9abb-7d8d-40c2-8910-941f86a165a2 tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] [instance: fc48e37f-8c00-4e48-bea3-f1c2e54d78b8] Fetching instance by UUID {{(pid=72090) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:26:09 user devstack@n-api.service[72090]: DEBUG dbcounter [-] [72090] Writing DB stats nova_api:SELECT=27,nova_api:UPDATE=1 {{(pid=72090) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:26:09 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-590f9abb-7d8d-40c2-8910-941f86a165a2 tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:26:09 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-590f9abb-7d8d-40c2-8910-941f86a165a2 tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:26:09 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-590f9abb-7d8d-40c2-8910-941f86a165a2 tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:26:09 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-590f9abb-7d8d-40c2-8910-941f86a165a2 tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:26:09 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-590f9abb-7d8d-40c2-8910-941f86a165a2 tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:26:09 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-590f9abb-7d8d-40c2-8910-941f86a165a2 tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:26:09 user devstack@n-api.service[72090]: DEBUG dbcounter [-] [72090] Writing DB stats nova_cell1:SELECT=60,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=72090) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:26:09 user devstack@n-api.service[72090]: DEBUG nova.policy [None req-590f9abb-7d8d-40c2-8910-941f86a165a2 tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f44dfa2528b4540a81f4eb7c3f3f2f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5d7769df1e4974b295cb30407151dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72090) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:26:09 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [None req-590f9abb-7d8d-40c2-8910-941f86a165a2 tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fc48e37f-8c00-4e48-bea3-f1c2e54d78b8" status: 200 len: 1494 microversion: 2.1 time: 0.300051 Apr 11 19:26:09 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 110/336] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 19:26:09 2023] GET /compute/v2.1/servers/fc48e37f-8c00-4e48-bea3-f1c2e54d78b8 => generated 1494 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:26:11 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [None req-48d9e4d7-eca9-48e4-a5b7-b23a04297206 tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] Calling method '>' {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:26:11 user devstack@n-api.service[72088]: DEBUG nova.compute.api [None req-48d9e4d7-eca9-48e4-a5b7-b23a04297206 tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] [instance: b71d95ed-728d-4386-b7c6-50b252718ca9] Fetching instance by UUID {{(pid=72088) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:26:11 user devstack@n-api.service[72088]: DEBUG dbcounter [-] [72088] Writing DB stats nova_cell0:SELECT=2 {{(pid=72088) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:26:11 user devstack@n-api.service[72088]: DEBUG dbcounter [-] [72088] Writing DB stats nova_cell0:SELECT=6 {{(pid=72088) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:26:11 user devstack@n-api.service[72088]: DEBUG dbcounter [-] [72088] Writing DB stats nova_api:SELECT=40,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=72088) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:26:11 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-48d9e4d7-eca9-48e4-a5b7-b23a04297206 tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:26:11 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-48d9e4d7-eca9-48e4-a5b7-b23a04297206 tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:26:11 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-48d9e4d7-eca9-48e4-a5b7-b23a04297206 tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:26:11 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-48d9e4d7-eca9-48e4-a5b7-b23a04297206 tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:26:11 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-48d9e4d7-eca9-48e4-a5b7-b23a04297206 tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:26:11 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-48d9e4d7-eca9-48e4-a5b7-b23a04297206 tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:26:11 user devstack@n-api.service[72088]: DEBUG dbcounter [-] [72088] Writing DB stats nova_cell1:SELECT=56,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=72088) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:26:11 user devstack@n-api.service[72088]: INFO nova.api.openstack.wsgi [None req-48d9e4d7-eca9-48e4-a5b7-b23a04297206 tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] HTTP exception thrown: Instance b71d95ed-728d-4386-b7c6-50b252718ca9 could not be found. Apr 11 19:26:11 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [None req-48d9e4d7-eca9-48e4-a5b7-b23a04297206 tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] Request method failure captured: Apr 11 19:26:11 user devstack@n-api.service[72088]: request: GET /compute/v2.1/servers/b71d95ed-728d-4386-b7c6-50b252718ca9 HTTP/1.1 Apr 11 19:26:11 user devstack@n-api.service[72088]: Accept: application/json Apr 11 19:26:11 user devstack@n-api.service[72088]: Accept-Encoding: identity Apr 11 19:26:11 user devstack@n-api.service[72088]: Connection: close Apr 11 19:26:11 user devstack@n-api.service[72088]: Content-Length: 0 Apr 11 19:26:11 user devstack@n-api.service[72088]: Content-Type: application/json Apr 11 19:26:11 user devstack@n-api.service[72088]: Host: 10.0.0.210 Apr 11 19:26:11 user devstack@n-api.service[72088]: Openstack-System-Scope: None Apr 11 19:26:11 user devstack@n-api.service[72088]: User-Agent: python-urllib3/1.26.15 Apr 11 19:26:11 user devstack@n-api.service[72088]: X-Auth-Token: gAAAAABkNbNEW6IFGqprEQX4heykkDbSmeCGH4VYWvbahGlwciXpyOYXGioQkvxzVvj2DV6we-x1odhYMl0nBvs7DiaGlUcLmHLia1Ho1RFgPhZC5BzpSUWQ6r-aZbZIfBFQnTRvduwC4CkFmuOVDQO6ERT0aOKMEt30W2-H6Grrf8RNB175tGY Apr 11 19:26:11 user devstack@n-api.service[72088]: X-Domain-Id: None Apr 11 19:26:11 user devstack@n-api.service[72088]: X-Domain-Name: None Apr 11 19:26:11 user devstack@n-api.service[72088]: X-Identity-Status: Confirmed Apr 11 19:26:11 user devstack@n-api.service[72088]: X-Is-Admin-Project: True Apr 11 19:26:11 user devstack@n-api.service[72088]: X-Openstack-Nova-Api-Version: 2.49 Apr 11 19:26:11 user devstack@n-api.service[72088]: X-Project-Domain-Id: default Apr 11 19:26:11 user devstack@n-api.service[72088]: X-Project-Domain-Name: Default Apr 11 19:26:11 user devstack@n-api.service[72088]: X-Project-Id: f39e7fdf571442b0a6f136020a99f7fb Apr 11 19:26:11 user devstack@n-api.service[72088]: X-Project-Name: tempest-TaggedAttachmentsTest-1678913086 Apr 11 19:26:11 user devstack@n-api.service[72088]: X-Role: reader,member Apr 11 19:26:11 user devstack@n-api.service[72088]: X-Roles: reader,member Apr 11 19:26:11 user devstack@n-api.service[72088]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f39e7fdf571442b0a6f136020a99f7fb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/f39e7fdf571442b0a6f136020a99f7fb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f39e7fdf571442b0a6f136020a99f7fb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 11 19:26:11 user devstack@n-api.service[72088]: X-Tenant: tempest-TaggedAttachmentsTest-1678913086 Apr 11 19:26:11 user devstack@n-api.service[72088]: X-Tenant-Id: f39e7fdf571442b0a6f136020a99f7fb Apr 11 19:26:11 user devstack@n-api.service[72088]: X-Tenant-Name: tempest-TaggedAttachmentsTest-1678913086 Apr 11 19:26:11 user devstack@n-api.service[72088]: X-User: tempest-TaggedAttachmentsTest-1678913086-project-member Apr 11 19:26:11 user devstack@n-api.service[72088]: X-User-Domain-Id: default Apr 11 19:26:11 user devstack@n-api.service[72088]: X-User-Domain-Name: Default Apr 11 19:26:11 user devstack@n-api.service[72088]: X-User-Id: 2f84e7cbdf6a4e588753fea907beba0c Apr 11 19:26:11 user devstack@n-api.service[72088]: X-User-Name: tempest-TaggedAttachmentsTest-1678913086-project-member Apr 11 19:26:11 user devstack@n-api.service[72088]: method: > Apr 11 19:26:11 user devstack@n-api.service[72088]: exception: Instance b71d95ed-728d-4386-b7c6-50b252718ca9 could not be found. Apr 11 19:26:11 user devstack@n-api.service[72088]: action_args: {'id': 'b71d95ed-728d-4386-b7c6-50b252718ca9'} Apr 11 19:26:11 user devstack@n-api.service[72088]: {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 19:26:11 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:26:11 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 19:26:11 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 19:26:11 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 19:26:11 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 19:26:11 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 19:26:11 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 19:26:11 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 19:26:11 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 19:26:11 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b71d95ed-728d-4386-b7c6-50b252718ca9 could not be found. Apr 11 19:26:11 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi Apr 11 19:26:11 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 19:26:11 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi Apr 11 19:26:11 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:26:11 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 19:26:11 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 19:26:11 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 19:26:11 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 19:26:11 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 19:26:11 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 19:26:11 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 19:26:11 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 19:26:11 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 19:26:11 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 19:26:11 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 19:26:11 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 19:26:11 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b71d95ed-728d-4386-b7c6-50b252718ca9 could not be found. Apr 11 19:26:11 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi Apr 11 19:26:11 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 19:26:11 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi Apr 11 19:26:11 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:26:11 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 19:26:11 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 19:26:11 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 19:26:11 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 19:26:11 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b71d95ed-728d-4386-b7c6-50b252718ca9 could not be found. Apr 11 19:26:11 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi Apr 11 19:26:11 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [None req-48d9e4d7-eca9-48e4-a5b7-b23a04297206 tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] Returning 404 to user: Instance b71d95ed-728d-4386-b7c6-50b252718ca9 could not be found. {{(pid=72088) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 19:26:11 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [None req-48d9e4d7-eca9-48e4-a5b7-b23a04297206 tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b71d95ed-728d-4386-b7c6-50b252718ca9" status: 404 len: 111 microversion: 2.49 time: 0.043152 Apr 11 19:26:11 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 112/337] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 19:26:11 2023] GET /compute/v2.1/servers/b71d95ed-728d-4386-b7c6-50b252718ca9 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 11 19:26:11 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [None req-3ed16690-6afa-4528-9b33-e95d2401c081 tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] Calling method '.version_select at 0x7f119dbe9f30>' {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:26:11 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [None req-3ed16690-6afa-4528-9b33-e95d2401c081 tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1575443570" status: 204 len: 0 microversion: 2.49 time: 0.025388 Apr 11 19:26:11 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 116/338] 10.0.0.210 () {64 vars in 1339 bytes} [Tue Apr 11 19:26:11 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1575443570 => generated 0 bytes in 28 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 11 19:26:13 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [None req-9edd4495-fbc1-436f-bd57-93963c7b8d75 tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] Calling method '>' {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:26:13 user devstack@n-api.service[72090]: DEBUG nova.compute.api [None req-9edd4495-fbc1-436f-bd57-93963c7b8d75 tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] [instance: b71d95ed-728d-4386-b7c6-50b252718ca9] Fetching instance by UUID {{(pid=72090) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:26:13 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-9edd4495-fbc1-436f-bd57-93963c7b8d75 tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:26:13 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-9edd4495-fbc1-436f-bd57-93963c7b8d75 tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:26:13 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-9edd4495-fbc1-436f-bd57-93963c7b8d75 tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:26:13 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-9edd4495-fbc1-436f-bd57-93963c7b8d75 tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:26:13 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-9edd4495-fbc1-436f-bd57-93963c7b8d75 tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:26:13 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-9edd4495-fbc1-436f-bd57-93963c7b8d75 tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:26:13 user devstack@n-api.service[72090]: INFO nova.api.openstack.wsgi [None req-9edd4495-fbc1-436f-bd57-93963c7b8d75 tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] HTTP exception thrown: Instance b71d95ed-728d-4386-b7c6-50b252718ca9 could not be found. Apr 11 19:26:13 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [None req-9edd4495-fbc1-436f-bd57-93963c7b8d75 tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] Request method failure captured: Apr 11 19:26:13 user devstack@n-api.service[72090]: request: DELETE /compute/v2.1/servers/b71d95ed-728d-4386-b7c6-50b252718ca9 HTTP/1.1 Apr 11 19:26:13 user devstack@n-api.service[72090]: Accept: application/json Apr 11 19:26:13 user devstack@n-api.service[72090]: Accept-Encoding: identity Apr 11 19:26:13 user devstack@n-api.service[72090]: Connection: close Apr 11 19:26:13 user devstack@n-api.service[72090]: Content-Length: 0 Apr 11 19:26:13 user devstack@n-api.service[72090]: Content-Type: application/json Apr 11 19:26:13 user devstack@n-api.service[72090]: Host: 10.0.0.210 Apr 11 19:26:13 user devstack@n-api.service[72090]: Openstack-System-Scope: None Apr 11 19:26:13 user devstack@n-api.service[72090]: User-Agent: python-urllib3/1.26.15 Apr 11 19:26:13 user devstack@n-api.service[72090]: X-Auth-Token: gAAAAABkNbNEW6IFGqprEQX4heykkDbSmeCGH4VYWvbahGlwciXpyOYXGioQkvxzVvj2DV6we-x1odhYMl0nBvs7DiaGlUcLmHLia1Ho1RFgPhZC5BzpSUWQ6r-aZbZIfBFQnTRvduwC4CkFmuOVDQO6ERT0aOKMEt30W2-H6Grrf8RNB175tGY Apr 11 19:26:13 user devstack@n-api.service[72090]: X-Domain-Id: None Apr 11 19:26:13 user devstack@n-api.service[72090]: X-Domain-Name: None Apr 11 19:26:13 user devstack@n-api.service[72090]: X-Identity-Status: Confirmed Apr 11 19:26:13 user devstack@n-api.service[72090]: X-Is-Admin-Project: True Apr 11 19:26:13 user devstack@n-api.service[72090]: X-Openstack-Nova-Api-Version: 2.49 Apr 11 19:26:13 user devstack@n-api.service[72090]: X-Project-Domain-Id: default Apr 11 19:26:13 user devstack@n-api.service[72090]: X-Project-Domain-Name: Default Apr 11 19:26:13 user devstack@n-api.service[72090]: X-Project-Id: f39e7fdf571442b0a6f136020a99f7fb Apr 11 19:26:13 user devstack@n-api.service[72090]: X-Project-Name: tempest-TaggedAttachmentsTest-1678913086 Apr 11 19:26:13 user devstack@n-api.service[72090]: X-Role: reader,member Apr 11 19:26:13 user devstack@n-api.service[72090]: X-Roles: reader,member Apr 11 19:26:13 user devstack@n-api.service[72090]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f39e7fdf571442b0a6f136020a99f7fb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/f39e7fdf571442b0a6f136020a99f7fb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f39e7fdf571442b0a6f136020a99f7fb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 11 19:26:13 user devstack@n-api.service[72090]: X-Tenant: tempest-TaggedAttachmentsTest-1678913086 Apr 11 19:26:13 user devstack@n-api.service[72090]: X-Tenant-Id: f39e7fdf571442b0a6f136020a99f7fb Apr 11 19:26:13 user devstack@n-api.service[72090]: X-Tenant-Name: tempest-TaggedAttachmentsTest-1678913086 Apr 11 19:26:13 user devstack@n-api.service[72090]: X-User: tempest-TaggedAttachmentsTest-1678913086-project-member Apr 11 19:26:13 user devstack@n-api.service[72090]: X-User-Domain-Id: default Apr 11 19:26:13 user devstack@n-api.service[72090]: X-User-Domain-Name: Default Apr 11 19:26:13 user devstack@n-api.service[72090]: X-User-Id: 2f84e7cbdf6a4e588753fea907beba0c Apr 11 19:26:13 user devstack@n-api.service[72090]: X-User-Name: tempest-TaggedAttachmentsTest-1678913086-project-member Apr 11 19:26:13 user devstack@n-api.service[72090]: method: > Apr 11 19:26:13 user devstack@n-api.service[72090]: exception: Instance b71d95ed-728d-4386-b7c6-50b252718ca9 could not be found. Apr 11 19:26:13 user devstack@n-api.service[72090]: action_args: {'id': 'b71d95ed-728d-4386-b7c6-50b252718ca9'} Apr 11 19:26:13 user devstack@n-api.service[72090]: {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 19:26:13 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:26:13 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 19:26:13 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 19:26:13 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 19:26:13 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 19:26:13 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 19:26:13 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 19:26:13 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 19:26:13 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 19:26:13 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b71d95ed-728d-4386-b7c6-50b252718ca9 could not be found. Apr 11 19:26:13 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi Apr 11 19:26:13 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 19:26:13 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi Apr 11 19:26:13 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:26:13 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 19:26:13 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 19:26:13 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 19:26:13 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 19:26:13 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 19:26:13 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 19:26:13 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 11 19:26:13 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 11 19:26:13 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 11 19:26:13 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 11 19:26:13 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 19:26:13 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 19:26:13 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 19:26:13 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 19:26:13 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b71d95ed-728d-4386-b7c6-50b252718ca9 could not be found. Apr 11 19:26:13 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi Apr 11 19:26:13 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 19:26:13 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi Apr 11 19:26:13 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:26:13 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 19:26:13 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 19:26:13 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 19:26:13 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 19:26:13 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b71d95ed-728d-4386-b7c6-50b252718ca9 could not be found. Apr 11 19:26:13 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi Apr 11 19:26:13 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [None req-9edd4495-fbc1-436f-bd57-93963c7b8d75 tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] Returning 404 to user: Instance b71d95ed-728d-4386-b7c6-50b252718ca9 could not be found. {{(pid=72090) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 19:26:13 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [None req-9edd4495-fbc1-436f-bd57-93963c7b8d75 tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/b71d95ed-728d-4386-b7c6-50b252718ca9" status: 404 len: 111 microversion: 2.49 time: 0.034310 Apr 11 19:26:13 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 111/339] 10.0.0.210 () {64 vars in 1357 bytes} [Tue Apr 11 19:26:13 2023] DELETE /compute/v2.1/servers/b71d95ed-728d-4386-b7c6-50b252718ca9 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 11 19:26:13 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [None req-d23f7fc1-368c-4a58-bdd3-bf3c7529e2b2 tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] Calling method '>' {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:26:13 user devstack@n-api.service[72088]: DEBUG nova.compute.api [None req-d23f7fc1-368c-4a58-bdd3-bf3c7529e2b2 tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] [instance: b71d95ed-728d-4386-b7c6-50b252718ca9] Fetching instance by UUID {{(pid=72088) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:26:13 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-d23f7fc1-368c-4a58-bdd3-bf3c7529e2b2 tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:26:13 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-d23f7fc1-368c-4a58-bdd3-bf3c7529e2b2 tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:26:13 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-d23f7fc1-368c-4a58-bdd3-bf3c7529e2b2 tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:26:13 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-d23f7fc1-368c-4a58-bdd3-bf3c7529e2b2 tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:26:13 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-d23f7fc1-368c-4a58-bdd3-bf3c7529e2b2 tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:26:13 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-d23f7fc1-368c-4a58-bdd3-bf3c7529e2b2 tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:26:13 user devstack@n-api.service[72088]: INFO nova.api.openstack.wsgi [None req-d23f7fc1-368c-4a58-bdd3-bf3c7529e2b2 tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] HTTP exception thrown: Instance b71d95ed-728d-4386-b7c6-50b252718ca9 could not be found. Apr 11 19:26:13 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [None req-d23f7fc1-368c-4a58-bdd3-bf3c7529e2b2 tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] Request method failure captured: Apr 11 19:26:13 user devstack@n-api.service[72088]: request: GET /compute/v2.1/servers/b71d95ed-728d-4386-b7c6-50b252718ca9 HTTP/1.1 Apr 11 19:26:13 user devstack@n-api.service[72088]: Accept: application/json Apr 11 19:26:13 user devstack@n-api.service[72088]: Accept-Encoding: identity Apr 11 19:26:13 user devstack@n-api.service[72088]: Connection: close Apr 11 19:26:13 user devstack@n-api.service[72088]: Content-Length: 0 Apr 11 19:26:13 user devstack@n-api.service[72088]: Content-Type: application/json Apr 11 19:26:13 user devstack@n-api.service[72088]: Host: 10.0.0.210 Apr 11 19:26:13 user devstack@n-api.service[72088]: Openstack-System-Scope: None Apr 11 19:26:13 user devstack@n-api.service[72088]: User-Agent: python-urllib3/1.26.15 Apr 11 19:26:13 user devstack@n-api.service[72088]: X-Auth-Token: gAAAAABkNbNEW6IFGqprEQX4heykkDbSmeCGH4VYWvbahGlwciXpyOYXGioQkvxzVvj2DV6we-x1odhYMl0nBvs7DiaGlUcLmHLia1Ho1RFgPhZC5BzpSUWQ6r-aZbZIfBFQnTRvduwC4CkFmuOVDQO6ERT0aOKMEt30W2-H6Grrf8RNB175tGY Apr 11 19:26:13 user devstack@n-api.service[72088]: X-Domain-Id: None Apr 11 19:26:13 user devstack@n-api.service[72088]: X-Domain-Name: None Apr 11 19:26:13 user devstack@n-api.service[72088]: X-Identity-Status: Confirmed Apr 11 19:26:13 user devstack@n-api.service[72088]: X-Is-Admin-Project: True Apr 11 19:26:13 user devstack@n-api.service[72088]: X-Openstack-Nova-Api-Version: 2.49 Apr 11 19:26:13 user devstack@n-api.service[72088]: X-Project-Domain-Id: default Apr 11 19:26:13 user devstack@n-api.service[72088]: X-Project-Domain-Name: Default Apr 11 19:26:13 user devstack@n-api.service[72088]: X-Project-Id: f39e7fdf571442b0a6f136020a99f7fb Apr 11 19:26:13 user devstack@n-api.service[72088]: X-Project-Name: tempest-TaggedAttachmentsTest-1678913086 Apr 11 19:26:13 user devstack@n-api.service[72088]: X-Role: reader,member Apr 11 19:26:13 user devstack@n-api.service[72088]: X-Roles: reader,member Apr 11 19:26:13 user devstack@n-api.service[72088]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f39e7fdf571442b0a6f136020a99f7fb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/f39e7fdf571442b0a6f136020a99f7fb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f39e7fdf571442b0a6f136020a99f7fb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 11 19:26:13 user devstack@n-api.service[72088]: X-Tenant: tempest-TaggedAttachmentsTest-1678913086 Apr 11 19:26:13 user devstack@n-api.service[72088]: X-Tenant-Id: f39e7fdf571442b0a6f136020a99f7fb Apr 11 19:26:13 user devstack@n-api.service[72088]: X-Tenant-Name: tempest-TaggedAttachmentsTest-1678913086 Apr 11 19:26:13 user devstack@n-api.service[72088]: X-User: tempest-TaggedAttachmentsTest-1678913086-project-member Apr 11 19:26:13 user devstack@n-api.service[72088]: X-User-Domain-Id: default Apr 11 19:26:13 user devstack@n-api.service[72088]: X-User-Domain-Name: Default Apr 11 19:26:13 user devstack@n-api.service[72088]: X-User-Id: 2f84e7cbdf6a4e588753fea907beba0c Apr 11 19:26:13 user devstack@n-api.service[72088]: X-User-Name: tempest-TaggedAttachmentsTest-1678913086-project-member Apr 11 19:26:13 user devstack@n-api.service[72088]: method: > Apr 11 19:26:13 user devstack@n-api.service[72088]: exception: Instance b71d95ed-728d-4386-b7c6-50b252718ca9 could not be found. Apr 11 19:26:13 user devstack@n-api.service[72088]: action_args: {'id': 'b71d95ed-728d-4386-b7c6-50b252718ca9'} Apr 11 19:26:13 user devstack@n-api.service[72088]: {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 19:26:13 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:26:13 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 19:26:13 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 19:26:13 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 19:26:13 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 19:26:13 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 19:26:13 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 19:26:13 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 19:26:13 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 19:26:13 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b71d95ed-728d-4386-b7c6-50b252718ca9 could not be found. Apr 11 19:26:13 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi Apr 11 19:26:13 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 19:26:13 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi Apr 11 19:26:13 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:26:13 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 19:26:13 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 19:26:13 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 19:26:13 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 19:26:13 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 19:26:13 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 19:26:13 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 19:26:13 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 19:26:13 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 19:26:13 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 19:26:13 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 19:26:13 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 19:26:13 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b71d95ed-728d-4386-b7c6-50b252718ca9 could not be found. Apr 11 19:26:13 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi Apr 11 19:26:13 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 19:26:13 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi Apr 11 19:26:13 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:26:13 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 19:26:13 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 19:26:13 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 19:26:13 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 19:26:13 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b71d95ed-728d-4386-b7c6-50b252718ca9 could not be found. Apr 11 19:26:13 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi Apr 11 19:26:13 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [None req-d23f7fc1-368c-4a58-bdd3-bf3c7529e2b2 tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] Returning 404 to user: Instance b71d95ed-728d-4386-b7c6-50b252718ca9 could not be found. {{(pid=72088) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 19:26:13 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [None req-d23f7fc1-368c-4a58-bdd3-bf3c7529e2b2 tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b71d95ed-728d-4386-b7c6-50b252718ca9" status: 404 len: 111 microversion: 2.49 time: 0.047334 Apr 11 19:26:13 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 113/340] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 19:26:13 2023] GET /compute/v2.1/servers/b71d95ed-728d-4386-b7c6-50b252718ca9 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 11 19:26:18 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [None req-f61b9b1e-64df-4d72-bc9e-f8c23778b47a tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Calling method '>' {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:26:19 user devstack@n-api.service[72089]: DEBUG nova.compute.api [None req-f61b9b1e-64df-4d72-bc9e-f8c23778b47a tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] [instance: 9e2d23e8-2d2e-4b3e-94d8-01b17242dac5] Fetching instance by UUID {{(pid=72089) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:26:19 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-f61b9b1e-64df-4d72-bc9e-f8c23778b47a tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:26:19 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-f61b9b1e-64df-4d72-bc9e-f8c23778b47a tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:26:19 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-f61b9b1e-64df-4d72-bc9e-f8c23778b47a tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:26:19 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-f61b9b1e-64df-4d72-bc9e-f8c23778b47a tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:26:19 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-f61b9b1e-64df-4d72-bc9e-f8c23778b47a tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:26:19 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-f61b9b1e-64df-4d72-bc9e-f8c23778b47a tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:26:19 user devstack@n-api.service[72089]: DEBUG nova.policy [None req-f61b9b1e-64df-4d72-bc9e-f8c23778b47a tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b3adca432b04d70818a51d1366f5c6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb91586feb3f4a4c84fa8c2183baaf8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72089) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:26:19 user devstack@n-api.service[72089]: DEBUG nova.policy [None req-f61b9b1e-64df-4d72-bc9e-f8c23778b47a tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b3adca432b04d70818a51d1366f5c6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb91586feb3f4a4c84fa8c2183baaf8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72089) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:26:19 user devstack@n-api.service[72089]: DEBUG nova.policy [None req-f61b9b1e-64df-4d72-bc9e-f8c23778b47a tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b3adca432b04d70818a51d1366f5c6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb91586feb3f4a4c84fa8c2183baaf8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72089) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:26:19 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [None req-f61b9b1e-64df-4d72-bc9e-f8c23778b47a tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9e2d23e8-2d2e-4b3e-94d8-01b17242dac5" status: 200 len: 1690 microversion: 2.87 time: 0.383409 Apr 11 19:26:19 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 117/341] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 19:26:18 2023] GET /compute/v2.1/servers/9e2d23e8-2d2e-4b3e-94d8-01b17242dac5 => generated 1690 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 19:26:27 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [None req-1eba61e7-bcef-4da2-9a3e-1786a0f840ac tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] Calling method '>' {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:26:27 user devstack@n-api.service[72090]: DEBUG nova.compute.api [None req-1eba61e7-bcef-4da2-9a3e-1786a0f840ac tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] [instance: a49d379e-3976-4d68-b6df-f572a922107c] Fetching instance by UUID {{(pid=72090) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:26:27 user devstack@n-api.service[72090]: DEBUG dbcounter [-] [72090] Writing DB stats nova_api:SELECT=3 {{(pid=72090) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:26:27 user devstack@n-api.service[72090]: DEBUG dbcounter [-] [72090] Writing DB stats nova_cell1:SELECT=7 {{(pid=72090) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:26:27 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-1eba61e7-bcef-4da2-9a3e-1786a0f840ac tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:26:27 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-1eba61e7-bcef-4da2-9a3e-1786a0f840ac tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:26:27 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-1eba61e7-bcef-4da2-9a3e-1786a0f840ac tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:26:27 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-1eba61e7-bcef-4da2-9a3e-1786a0f840ac tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:26:27 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-1eba61e7-bcef-4da2-9a3e-1786a0f840ac tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:26:27 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-1eba61e7-bcef-4da2-9a3e-1786a0f840ac tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:26:27 user devstack@n-api.service[72090]: INFO nova.api.openstack.wsgi [None req-1eba61e7-bcef-4da2-9a3e-1786a0f840ac tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] HTTP exception thrown: Instance a49d379e-3976-4d68-b6df-f572a922107c could not be found. Apr 11 19:26:27 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [None req-1eba61e7-bcef-4da2-9a3e-1786a0f840ac tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] Request method failure captured: Apr 11 19:26:27 user devstack@n-api.service[72090]: request: GET /compute/v2.1/servers/a49d379e-3976-4d68-b6df-f572a922107c HTTP/1.1 Apr 11 19:26:27 user devstack@n-api.service[72090]: Accept: application/json Apr 11 19:26:27 user devstack@n-api.service[72090]: Accept-Encoding: identity Apr 11 19:26:27 user devstack@n-api.service[72090]: Connection: close Apr 11 19:26:27 user devstack@n-api.service[72090]: Content-Length: 0 Apr 11 19:26:27 user devstack@n-api.service[72090]: Content-Type: application/json Apr 11 19:26:27 user devstack@n-api.service[72090]: Host: 10.0.0.210 Apr 11 19:26:27 user devstack@n-api.service[72090]: Openstack-System-Scope: None Apr 11 19:26:27 user devstack@n-api.service[72090]: User-Agent: python-urllib3/1.26.15 Apr 11 19:26:27 user devstack@n-api.service[72090]: X-Auth-Token: gAAAAABkNbNIICfYvzC2ISptyniU23dzsBLaG2aD2Zs9iIBXt4aO4a9hU8ZFGe892GIzHlED82Jy1sSyvG2Yj9lGP7qQ2JMBG-tSRWu7mAh342PBujVmrPOdwoICGoPphXA7Y0FZgSgUD5P5ZaIbFaJXhxI_axY_o40htgIG679Q1GATjfXEQkc Apr 11 19:26:27 user devstack@n-api.service[72090]: X-Domain-Id: None Apr 11 19:26:27 user devstack@n-api.service[72090]: X-Domain-Name: None Apr 11 19:26:27 user devstack@n-api.service[72090]: X-Identity-Status: Confirmed Apr 11 19:26:27 user devstack@n-api.service[72090]: X-Is-Admin-Project: True Apr 11 19:26:27 user devstack@n-api.service[72090]: X-Project-Domain-Id: default Apr 11 19:26:27 user devstack@n-api.service[72090]: X-Project-Domain-Name: Default Apr 11 19:26:27 user devstack@n-api.service[72090]: X-Project-Id: e9f8ee2edca748e0bd03ace6f93be649 Apr 11 19:26:27 user devstack@n-api.service[72090]: X-Project-Name: tempest-TestVolumeSwap-1558953300 Apr 11 19:26:27 user devstack@n-api.service[72090]: X-Role: reader,member Apr 11 19:26:27 user devstack@n-api.service[72090]: X-Roles: reader,member Apr 11 19:26:27 user devstack@n-api.service[72090]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e9f8ee2edca748e0bd03ace6f93be649"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/e9f8ee2edca748e0bd03ace6f93be649"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e9f8ee2edca748e0bd03ace6f93be649"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 11 19:26:27 user devstack@n-api.service[72090]: X-Tenant: tempest-TestVolumeSwap-1558953300 Apr 11 19:26:27 user devstack@n-api.service[72090]: X-Tenant-Id: e9f8ee2edca748e0bd03ace6f93be649 Apr 11 19:26:27 user devstack@n-api.service[72090]: X-Tenant-Name: tempest-TestVolumeSwap-1558953300 Apr 11 19:26:27 user devstack@n-api.service[72090]: X-User: tempest-TestVolumeSwap-1558953300-project-member Apr 11 19:26:27 user devstack@n-api.service[72090]: X-User-Domain-Id: default Apr 11 19:26:27 user devstack@n-api.service[72090]: X-User-Domain-Name: Default Apr 11 19:26:27 user devstack@n-api.service[72090]: X-User-Id: 24e95f55f8f9497592320a19f2ca7fb8 Apr 11 19:26:27 user devstack@n-api.service[72090]: X-User-Name: tempest-TestVolumeSwap-1558953300-project-member Apr 11 19:26:27 user devstack@n-api.service[72090]: method: > Apr 11 19:26:27 user devstack@n-api.service[72090]: exception: Instance a49d379e-3976-4d68-b6df-f572a922107c could not be found. Apr 11 19:26:27 user devstack@n-api.service[72090]: action_args: {'id': 'a49d379e-3976-4d68-b6df-f572a922107c'} Apr 11 19:26:27 user devstack@n-api.service[72090]: {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 19:26:27 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:26:27 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 19:26:27 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 19:26:27 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 19:26:27 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 19:26:27 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 19:26:27 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 19:26:27 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 19:26:27 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 19:26:27 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a49d379e-3976-4d68-b6df-f572a922107c could not be found. Apr 11 19:26:27 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi Apr 11 19:26:27 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 19:26:27 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi Apr 11 19:26:27 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:26:27 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 19:26:27 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 19:26:27 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 19:26:27 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 19:26:27 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 19:26:27 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 19:26:27 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 19:26:27 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 19:26:27 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 19:26:27 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 19:26:27 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 19:26:27 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 19:26:27 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a49d379e-3976-4d68-b6df-f572a922107c could not be found. Apr 11 19:26:27 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi Apr 11 19:26:27 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 19:26:27 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi Apr 11 19:26:27 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:26:27 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 19:26:27 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 19:26:27 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 19:26:27 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 19:26:27 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a49d379e-3976-4d68-b6df-f572a922107c could not be found. Apr 11 19:26:27 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi Apr 11 19:26:27 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [None req-1eba61e7-bcef-4da2-9a3e-1786a0f840ac tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] Returning 404 to user: Instance a49d379e-3976-4d68-b6df-f572a922107c could not be found. {{(pid=72090) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 19:26:27 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [None req-1eba61e7-bcef-4da2-9a3e-1786a0f840ac tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a49d379e-3976-4d68-b6df-f572a922107c" status: 404 len: 111 microversion: 2.1 time: 0.033124 Apr 11 19:26:27 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 112/342] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 19:26:27 2023] GET /compute/v2.1/servers/a49d379e-3976-4d68-b6df-f572a922107c => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 19:26:27 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [None req-4200e5da-3eb8-4650-a58d-98950eb012a8 tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] Calling method '.version_select at 0x7f119db06d40>' {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:26:27 user devstack@n-api.service[72088]: DEBUG dbcounter [-] [72088] Writing DB stats nova_api:SELECT=3 {{(pid=72088) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:26:27 user devstack@n-api.service[72088]: DEBUG dbcounter [-] [72088] Writing DB stats nova_cell1:SELECT=3 {{(pid=72088) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:26:27 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [None req-4200e5da-3eb8-4650-a58d-98950eb012a8 tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1479395347" status: 202 len: 0 microversion: 2.1 time: 0.031812 Apr 11 19:26:27 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 114/343] 10.0.0.210 () {62 vars in 1298 bytes} [Tue Apr 11 19:26:27 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1479395347 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 19:26:32 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [None req-dc6b9620-1eaa-4cfd-8cc1-219eff39499c tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Calling method '>' {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:26:32 user devstack@n-api.service[72089]: DEBUG nova.compute.api [None req-dc6b9620-1eaa-4cfd-8cc1-219eff39499c tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] [instance: 53ccc829-6323-48ec-b63f-9de9bc607456] Fetching instance by UUID {{(pid=72089) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:26:32 user devstack@n-api.service[72089]: DEBUG dbcounter [-] [72089] Writing DB stats nova_cell1:SELECT=7 {{(pid=72089) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:26:32 user devstack@n-api.service[72089]: DEBUG dbcounter [-] [72089] Writing DB stats nova_api:SELECT=9,nova_api:DELETE=1 {{(pid=72089) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:26:32 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-dc6b9620-1eaa-4cfd-8cc1-219eff39499c tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:26:32 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-dc6b9620-1eaa-4cfd-8cc1-219eff39499c tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:26:32 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-dc6b9620-1eaa-4cfd-8cc1-219eff39499c tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:26:32 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-dc6b9620-1eaa-4cfd-8cc1-219eff39499c tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:26:32 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-dc6b9620-1eaa-4cfd-8cc1-219eff39499c tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:26:32 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-dc6b9620-1eaa-4cfd-8cc1-219eff39499c tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:26:32 user devstack@n-api.service[72089]: INFO nova.api.openstack.wsgi [None req-dc6b9620-1eaa-4cfd-8cc1-219eff39499c tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] HTTP exception thrown: Instance 53ccc829-6323-48ec-b63f-9de9bc607456 could not be found. Apr 11 19:26:32 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [None req-dc6b9620-1eaa-4cfd-8cc1-219eff39499c tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Request method failure captured: Apr 11 19:26:32 user devstack@n-api.service[72089]: request: GET /compute/v2.1/servers/53ccc829-6323-48ec-b63f-9de9bc607456 HTTP/1.1 Apr 11 19:26:32 user devstack@n-api.service[72089]: Accept: application/json Apr 11 19:26:32 user devstack@n-api.service[72089]: Accept-Encoding: identity Apr 11 19:26:32 user devstack@n-api.service[72089]: Connection: close Apr 11 19:26:32 user devstack@n-api.service[72089]: Content-Length: 0 Apr 11 19:26:32 user devstack@n-api.service[72089]: Content-Type: application/json Apr 11 19:26:32 user devstack@n-api.service[72089]: Host: 10.0.0.210 Apr 11 19:26:32 user devstack@n-api.service[72089]: Openstack-System-Scope: None Apr 11 19:26:32 user devstack@n-api.service[72089]: User-Agent: python-urllib3/1.26.15 Apr 11 19:26:32 user devstack@n-api.service[72089]: X-Auth-Token: gAAAAABkNbM9PPhjuxFro365bgGlzXmEeNXBFjH7B9DXRG846ZOMZNO8rjcHBUXZkmUpO9G06QygHvaEJVpRlrFcJIyDYtH16p4qIRFo8lVfjRkqkJh8soUAdF5jsPsH_hjCF2czbYEFIUpkQBo9PM7kG8byL_cnEa6VpD9RmxIaxcGcdobg_-U Apr 11 19:26:32 user devstack@n-api.service[72089]: X-Domain-Id: None Apr 11 19:26:32 user devstack@n-api.service[72089]: X-Domain-Name: None Apr 11 19:26:32 user devstack@n-api.service[72089]: X-Identity-Status: Confirmed Apr 11 19:26:32 user devstack@n-api.service[72089]: X-Is-Admin-Project: True Apr 11 19:26:32 user devstack@n-api.service[72089]: X-Project-Domain-Id: default Apr 11 19:26:32 user devstack@n-api.service[72089]: X-Project-Domain-Name: Default Apr 11 19:26:32 user devstack@n-api.service[72089]: X-Project-Id: 06966e2f4d3a4dec92282c7ad348635d Apr 11 19:26:32 user devstack@n-api.service[72089]: X-Project-Name: tempest-AttachVolumeNegativeTest-303418642 Apr 11 19:26:32 user devstack@n-api.service[72089]: X-Role: reader,member Apr 11 19:26:32 user devstack@n-api.service[72089]: X-Roles: reader,member Apr 11 19:26:32 user devstack@n-api.service[72089]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/06966e2f4d3a4dec92282c7ad348635d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/06966e2f4d3a4dec92282c7ad348635d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/06966e2f4d3a4dec92282c7ad348635d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 11 19:26:32 user devstack@n-api.service[72089]: X-Tenant: tempest-AttachVolumeNegativeTest-303418642 Apr 11 19:26:32 user devstack@n-api.service[72089]: X-Tenant-Id: 06966e2f4d3a4dec92282c7ad348635d Apr 11 19:26:32 user devstack@n-api.service[72089]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-303418642 Apr 11 19:26:32 user devstack@n-api.service[72089]: X-User: tempest-AttachVolumeNegativeTest-303418642-project-member Apr 11 19:26:32 user devstack@n-api.service[72089]: X-User-Domain-Id: default Apr 11 19:26:32 user devstack@n-api.service[72089]: X-User-Domain-Name: Default Apr 11 19:26:32 user devstack@n-api.service[72089]: X-User-Id: d5d405421ceb4d99967ef2e7f55e7809 Apr 11 19:26:32 user devstack@n-api.service[72089]: X-User-Name: tempest-AttachVolumeNegativeTest-303418642-project-member Apr 11 19:26:32 user devstack@n-api.service[72089]: method: > Apr 11 19:26:32 user devstack@n-api.service[72089]: exception: Instance 53ccc829-6323-48ec-b63f-9de9bc607456 could not be found. Apr 11 19:26:32 user devstack@n-api.service[72089]: action_args: {'id': '53ccc829-6323-48ec-b63f-9de9bc607456'} Apr 11 19:26:32 user devstack@n-api.service[72089]: {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 19:26:32 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:26:32 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 19:26:32 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 19:26:32 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 19:26:32 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 19:26:32 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 19:26:32 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 19:26:32 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 19:26:32 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 19:26:32 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 53ccc829-6323-48ec-b63f-9de9bc607456 could not be found. Apr 11 19:26:32 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi Apr 11 19:26:32 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 19:26:32 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi Apr 11 19:26:32 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:26:32 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 19:26:32 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 19:26:32 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 19:26:32 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 19:26:32 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 19:26:32 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 19:26:32 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 19:26:32 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 19:26:32 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 19:26:32 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 19:26:32 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 19:26:32 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 19:26:32 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 53ccc829-6323-48ec-b63f-9de9bc607456 could not be found. Apr 11 19:26:32 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi Apr 11 19:26:32 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 19:26:32 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi Apr 11 19:26:32 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:26:32 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 19:26:32 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 19:26:32 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 19:26:32 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 19:26:32 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 53ccc829-6323-48ec-b63f-9de9bc607456 could not be found. Apr 11 19:26:32 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi Apr 11 19:26:32 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [None req-dc6b9620-1eaa-4cfd-8cc1-219eff39499c tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Returning 404 to user: Instance 53ccc829-6323-48ec-b63f-9de9bc607456 could not be found. {{(pid=72089) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 19:26:32 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [None req-dc6b9620-1eaa-4cfd-8cc1-219eff39499c tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] 10.0.0.210 "GET /compute/v2.1/servers/53ccc829-6323-48ec-b63f-9de9bc607456" status: 404 len: 111 microversion: 2.1 time: 0.056034 Apr 11 19:26:32 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 118/344] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 19:26:32 2023] GET /compute/v2.1/servers/53ccc829-6323-48ec-b63f-9de9bc607456 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 19:26:32 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [None req-d0c0b4ff-5ee5-4be9-a1ab-d7dab116c8b3 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Calling method '.version_select at 0x7f119db1a320>' {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:26:32 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [None req-d0c0b4ff-5ee5-4be9-a1ab-d7dab116c8b3 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-985453267" status: 202 len: 0 microversion: 2.1 time: 0.066273 Apr 11 19:26:32 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 113/345] 10.0.0.210 () {62 vars in 1295 bytes} [Tue Apr 11 19:26:32 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-985453267 => generated 0 bytes in 68 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 19:26:32 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [None req-5efdc9d8-e2a6-4fbf-baed-d9eee20f81b0 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Action: 'create', calling method: .version_select at 0x7f119db071c0>, body: {"keypair": {"name": "tempest-keypair-787762884", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ82RBzB/1/A3FnM1xLWpDXU/zavewAraCLhBOFMjSAT73wEadTAAV/T3F8H/2XBNIlxPBMghQi8EI/lCPJr4+3PB4NLUhilDnSU8CjIwDu129bM+5w7HZBo//kKOchz0Q=="}} {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:26:32 user devstack@n-api.service[72088]: DEBUG nova.quota [None req-5efdc9d8-e2a6-4fbf-baed-d9eee20f81b0 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Getting quotas for project 8d8b189667e34931aa36149620a036e1. Resources: {'key_pairs'} {{(pid=72088) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 19:26:32 user devstack@n-api.service[72088]: DEBUG nova.quota [None req-5efdc9d8-e2a6-4fbf-baed-d9eee20f81b0 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Getting quotas for user e0558ba5a2b04d36ba2f2411090cc4e4 and project 8d8b189667e34931aa36149620a036e1. Resources: {'key_pairs'} {{(pid=72088) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 19:26:32 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [None req-5efdc9d8-e2a6-4fbf-baed-d9eee20f81b0 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.171453 Apr 11 19:26:32 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 115/346] 10.0.0.210 () {66 vars in 1277 bytes} [Tue Apr 11 19:26:32 2023] POST /compute/v2.1/os-keypairs => generated 400 bytes in 173 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Apr 11 19:26:32 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [None req-73e99670-369a-41d3-b099-726f929f954a tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Calling method '>' {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:26:32 user devstack@n-api.service[72089]: DEBUG nova.compute.api [None req-73e99670-369a-41d3-b099-726f929f954a tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] [instance: bed4001c-02c2-4c6b-84c8-61654df66d8b] Fetching instance by UUID {{(pid=72089) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:26:32 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-73e99670-369a-41d3-b099-726f929f954a tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:26:32 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-73e99670-369a-41d3-b099-726f929f954a tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:26:32 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-73e99670-369a-41d3-b099-726f929f954a tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:26:32 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-73e99670-369a-41d3-b099-726f929f954a tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:26:32 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-73e99670-369a-41d3-b099-726f929f954a tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:26:33 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-73e99670-369a-41d3-b099-726f929f954a tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:26:33 user devstack@n-api.service[72089]: DEBUG nova.objects.instance [None req-73e99670-369a-41d3-b099-726f929f954a tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Lazy-loading 'services' on Instance uuid bed4001c-02c2-4c6b-84c8-61654df66d8b {{(pid=72089) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 11 19:26:33 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [None req-73e99670-369a-41d3-b099-726f929f954a tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/bed4001c-02c2-4c6b-84c8-61654df66d8b/os-volume_attachments/4940d74f-b60a-49aa-bf74-4e000efa8dc5" status: 202 len: 0 microversion: 2.1 time: 0.301131 Apr 11 19:26:33 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 119/347] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Apr 11 19:26:32 2023] DELETE /compute/v2.1/servers/bed4001c-02c2-4c6b-84c8-61654df66d8b/os-volume_attachments/4940d74f-b60a-49aa-bf74-4e000efa8dc5 => generated 0 bytes in 304 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 19:26:33 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [None req-9361ee4e-5a55-4f94-8d0d-95573c3565db tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Calling method '>' {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:26:33 user devstack@n-api.service[72090]: DEBUG nova.compute.api [None req-9361ee4e-5a55-4f94-8d0d-95573c3565db tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] [instance: bed4001c-02c2-4c6b-84c8-61654df66d8b] Fetching instance by UUID {{(pid=72090) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:26:33 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-9361ee4e-5a55-4f94-8d0d-95573c3565db tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:26:33 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-9361ee4e-5a55-4f94-8d0d-95573c3565db tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:26:33 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-9361ee4e-5a55-4f94-8d0d-95573c3565db tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:26:33 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-9361ee4e-5a55-4f94-8d0d-95573c3565db tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:26:33 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-9361ee4e-5a55-4f94-8d0d-95573c3565db tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:26:33 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-9361ee4e-5a55-4f94-8d0d-95573c3565db tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:26:33 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [None req-9361ee4e-5a55-4f94-8d0d-95573c3565db tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bed4001c-02c2-4c6b-84c8-61654df66d8b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059487 Apr 11 19:26:33 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 114/348] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Apr 11 19:26:33 2023] GET /compute/v2.1/servers/bed4001c-02c2-4c6b-84c8-61654df66d8b/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:26:34 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [None req-f6b72bff-d6fd-4373-a498-2051409de62f tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1219064691", "imageRef": "4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "0fffcabf-f83f-41a3-b4e9-c67b67b4f814"}], "security_groups": [{"name": "tempest-securitygroup--247877362"}], "key_name": "tempest-keypair-787762884", "user_data": "}} {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:26:34 user devstack@n-api.service[72088]: DEBUG nova.network.neutron [None req-f6b72bff-d6fd-4373-a498-2051409de62f tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] validate_networks() for [('0fffcabf-f83f-41a3-b4e9-c67b67b4f814', None, None, None, None, None)] {{(pid=72088) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 11 19:26:34 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [None req-0c8a7c3d-e7fa-4b96-9d59-b1a9f9164c1a tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] Calling method '>' {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:26:34 user devstack@n-api.service[72089]: DEBUG nova.compute.api [None req-0c8a7c3d-e7fa-4b96-9d59-b1a9f9164c1a tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] [instance: aa0bb9aa-a93d-45bc-9f90-46eeb6416365] Fetching instance by UUID {{(pid=72089) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:26:34 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-0c8a7c3d-e7fa-4b96-9d59-b1a9f9164c1a tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:26:34 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-0c8a7c3d-e7fa-4b96-9d59-b1a9f9164c1a tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:26:34 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-0c8a7c3d-e7fa-4b96-9d59-b1a9f9164c1a tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:26:34 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-0c8a7c3d-e7fa-4b96-9d59-b1a9f9164c1a tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:26:34 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-0c8a7c3d-e7fa-4b96-9d59-b1a9f9164c1a tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:26:34 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-0c8a7c3d-e7fa-4b96-9d59-b1a9f9164c1a tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:26:34 user devstack@n-api.service[72089]: DEBUG nova.policy [None req-0c8a7c3d-e7fa-4b96-9d59-b1a9f9164c1a tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26f091a1508b4d2689005b660f6a1380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ee7c68b277420ba524c2a99cd444ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72089) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:26:34 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [None req-0c8a7c3d-e7fa-4b96-9d59-b1a9f9164c1a tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] 10.0.0.210 "GET /compute/v2.1/servers/aa0bb9aa-a93d-45bc-9f90-46eeb6416365" status: 200 len: 1703 microversion: 2.1 time: 0.180678 Apr 11 19:26:34 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 120/349] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 19:26:34 2023] GET /compute/v2.1/servers/aa0bb9aa-a93d-45bc-9f90-46eeb6416365 => generated 1703 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:26:34 user devstack@n-api.service[72088]: DEBUG nova.virt.hardware [None req-f6b72bff-d6fd-4373-a498-2051409de62f tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Flavor limits 0:0:0 {{(pid=72088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 19:26:34 user devstack@n-api.service[72088]: DEBUG nova.virt.hardware [None req-f6b72bff-d6fd-4373-a498-2051409de62f tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Image limits 0:0:0 {{(pid=72088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 19:26:34 user devstack@n-api.service[72088]: DEBUG nova.virt.hardware [None req-f6b72bff-d6fd-4373-a498-2051409de62f tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Flavor pref 0:0:0 {{(pid=72088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 19:26:34 user devstack@n-api.service[72088]: DEBUG nova.virt.hardware [None req-f6b72bff-d6fd-4373-a498-2051409de62f tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Image pref 0:0:0 {{(pid=72088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 19:26:34 user devstack@n-api.service[72088]: DEBUG nova.virt.hardware [None req-f6b72bff-d6fd-4373-a498-2051409de62f tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 19:26:34 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-f6b72bff-d6fd-4373-a498-2051409de62f tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:26:34 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-f6b72bff-d6fd-4373-a498-2051409de62f tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:26:34 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-f6b72bff-d6fd-4373-a498-2051409de62f tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:26:34 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-f6b72bff-d6fd-4373-a498-2051409de62f tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:26:34 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-f6b72bff-d6fd-4373-a498-2051409de62f tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:26:34 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-f6b72bff-d6fd-4373-a498-2051409de62f tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:26:34 user devstack@n-api.service[72088]: DEBUG nova.quota [None req-f6b72bff-d6fd-4373-a498-2051409de62f tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Getting quotas for project 8d8b189667e34931aa36149620a036e1. Resources: {'ram', 'instances', 'cores'} {{(pid=72088) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 19:26:34 user devstack@n-api.service[72088]: DEBUG nova.quota [None req-f6b72bff-d6fd-4373-a498-2051409de62f tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Getting quotas for user e0558ba5a2b04d36ba2f2411090cc4e4 and project 8d8b189667e34931aa36149620a036e1. Resources: {'ram', 'instances', 'cores'} {{(pid=72088) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 19:26:34 user devstack@n-api.service[72088]: DEBUG nova.compute.api [None req-f6b72bff-d6fd-4373-a498-2051409de62f tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Going to run 1 instances... {{(pid=72088) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 11 19:26:34 user devstack@n-api.service[72088]: DEBUG nova.compute.api [None req-f6b72bff-d6fd-4373-a498-2051409de62f tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] [instance: 720c683f-c03a-444c-92a8-daf97c9f524b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=72088) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 11 19:26:35 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [None req-f6b72bff-d6fd-4373-a498-2051409de62f tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 399 microversion: 2.20 time: 0.747623 Apr 11 19:26:35 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 116/350] 10.0.0.210 () {66 vars in 1265 bytes} [Tue Apr 11 19:26:34 2023] POST /compute/v2.1/servers => generated 399 bytes in 749 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 11 19:26:35 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [None req-f26cfe44-efe6-438e-a8a0-0f6469a5b849 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Calling method '>' {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:26:35 user devstack@n-api.service[72090]: DEBUG nova.compute.api [None req-f26cfe44-efe6-438e-a8a0-0f6469a5b849 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] [instance: 720c683f-c03a-444c-92a8-daf97c9f524b] Fetching instance by UUID {{(pid=72090) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:26:35 user devstack@n-api.service[72090]: DEBUG nova.policy [None req-f26cfe44-efe6-438e-a8a0-0f6469a5b849 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0558ba5a2b04d36ba2f2411090cc4e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d8b189667e34931aa36149620a036e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72090) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:26:35 user devstack@n-api.service[72090]: DEBUG nova.policy [None req-f26cfe44-efe6-438e-a8a0-0f6469a5b849 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0558ba5a2b04d36ba2f2411090cc4e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d8b189667e34931aa36149620a036e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72090) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:26:35 user devstack@n-api.service[72090]: DEBUG nova.policy [None req-f26cfe44-efe6-438e-a8a0-0f6469a5b849 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0558ba5a2b04d36ba2f2411090cc4e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d8b189667e34931aa36149620a036e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72090) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:26:35 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [None req-f26cfe44-efe6-438e-a8a0-0f6469a5b849 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] 10.0.0.210 "GET /compute/v2.1/servers/720c683f-c03a-444c-92a8-daf97c9f524b" status: 200 len: 1275 microversion: 2.20 time: 0.182903 Apr 11 19:26:35 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 115/351] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 19:26:35 2023] GET /compute/v2.1/servers/720c683f-c03a-444c-92a8-daf97c9f524b => generated 1275 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 19:26:37 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [None req-9757d742-ffb1-4dbe-a1df-23f30d738e5e tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Calling method '>' {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:26:37 user devstack@n-api.service[72089]: DEBUG nova.compute.api [None req-9757d742-ffb1-4dbe-a1df-23f30d738e5e tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] [instance: 6802f099-9236-4c79-a892-2963f1b15b0e] Fetching instance by UUID {{(pid=72089) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:26:37 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-9757d742-ffb1-4dbe-a1df-23f30d738e5e tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:26:37 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-9757d742-ffb1-4dbe-a1df-23f30d738e5e tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:26:37 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-9757d742-ffb1-4dbe-a1df-23f30d738e5e tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:26:37 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-9757d742-ffb1-4dbe-a1df-23f30d738e5e tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:26:37 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-9757d742-ffb1-4dbe-a1df-23f30d738e5e tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:26:37 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-9757d742-ffb1-4dbe-a1df-23f30d738e5e tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:26:37 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [None req-9757d742-ffb1-4dbe-a1df-23f30d738e5e tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6802f099-9236-4c79-a892-2963f1b15b0e/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.122676 Apr 11 19:26:37 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 121/352] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Apr 11 19:26:37 2023] GET /compute/v2.1/servers/6802f099-9236-4c79-a892-2963f1b15b0e/os-interface => generated 283 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:26:38 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [req-e5f5dd75-fff3-4193-be87-29979b977aa7 req-04ebb423-3eec-444f-bc21-b036bbf41b91 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6802f099-9236-4c79-a892-2963f1b15b0e", "tag": "6193819b-0c1b-476b-b89e-dbbfc7938fc5"}]} {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:26:38 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-e5f5dd75-fff3-4193-be87-29979b977aa7 req-04ebb423-3eec-444f-bc21-b036bbf41b91 service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:26:38 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-e5f5dd75-fff3-4193-be87-29979b977aa7 req-04ebb423-3eec-444f-bc21-b036bbf41b91 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:26:38 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-e5f5dd75-fff3-4193-be87-29979b977aa7 req-04ebb423-3eec-444f-bc21-b036bbf41b91 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:26:38 user devstack@n-api.service[72088]: INFO nova.api.openstack.compute.server_external_events [req-e5f5dd75-fff3-4193-be87-29979b977aa7 req-04ebb423-3eec-444f-bc21-b036bbf41b91 service nova] Creating event network-changed:6193819b-0c1b-476b-b89e-dbbfc7938fc5 for instance 6802f099-9236-4c79-a892-2963f1b15b0e on user Apr 11 19:26:38 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [req-e5f5dd75-fff3-4193-be87-29979b977aa7 req-04ebb423-3eec-444f-bc21-b036bbf41b91 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031737 Apr 11 19:26:38 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 117/353] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:26:38 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:26:38 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [None req-9ee744d0-5c50-4288-8fda-4a4e4a557fa7 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Calling method '>' {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:26:38 user devstack@n-api.service[72090]: DEBUG nova.compute.api [None req-9ee744d0-5c50-4288-8fda-4a4e4a557fa7 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] [instance: 6802f099-9236-4c79-a892-2963f1b15b0e] Fetching instance by UUID {{(pid=72090) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:26:38 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-9ee744d0-5c50-4288-8fda-4a4e4a557fa7 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:26:38 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-9ee744d0-5c50-4288-8fda-4a4e4a557fa7 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:26:38 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-9ee744d0-5c50-4288-8fda-4a4e4a557fa7 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:26:38 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-9ee744d0-5c50-4288-8fda-4a4e4a557fa7 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:26:38 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-9ee744d0-5c50-4288-8fda-4a4e4a557fa7 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:26:38 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-9ee744d0-5c50-4288-8fda-4a4e4a557fa7 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:26:38 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [None req-9ee744d0-5c50-4288-8fda-4a4e4a557fa7 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6802f099-9236-4c79-a892-2963f1b15b0e/ips" status: 200 len: 105 microversion: 2.1 time: 0.043742 Apr 11 19:26:38 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 116/354] 10.0.0.210 () {62 vars in 1325 bytes} [Tue Apr 11 19:26:38 2023] GET /compute/v2.1/servers/6802f099-9236-4c79-a892-2963f1b15b0e/ips => generated 105 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 11 19:26:38 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [req-17c31520-47ef-4f85-8468-e19c45681d1a req-4b27eb07-b661-4de4-8b71-e7c8ea12a65b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "720c683f-c03a-444c-92a8-daf97c9f524b", "tag": "9e6087aa-464a-450d-bd04-2653d9420094"}]} {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:26:38 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-17c31520-47ef-4f85-8468-e19c45681d1a req-4b27eb07-b661-4de4-8b71-e7c8ea12a65b service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:26:38 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-17c31520-47ef-4f85-8468-e19c45681d1a req-4b27eb07-b661-4de4-8b71-e7c8ea12a65b service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:26:38 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-17c31520-47ef-4f85-8468-e19c45681d1a req-4b27eb07-b661-4de4-8b71-e7c8ea12a65b service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:26:38 user devstack@n-api.service[72089]: INFO nova.api.openstack.compute.server_external_events [req-17c31520-47ef-4f85-8468-e19c45681d1a req-4b27eb07-b661-4de4-8b71-e7c8ea12a65b service nova] Creating event network-changed:9e6087aa-464a-450d-bd04-2653d9420094 for instance 720c683f-c03a-444c-92a8-daf97c9f524b on user Apr 11 19:26:38 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [req-17c31520-47ef-4f85-8468-e19c45681d1a req-4b27eb07-b661-4de4-8b71-e7c8ea12a65b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031103 Apr 11 19:26:38 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 122/355] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:26:38 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:26:39 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [None req-7ca76eee-d8b4-4184-a299-8aff63a73dde tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ae9e623b-e20a-47f6-8a7b-d48a85701e3e"}} {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:26:39 user devstack@n-api.service[72088]: DEBUG nova.compute.api [None req-7ca76eee-d8b4-4184-a299-8aff63a73dde tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] [instance: 6802f099-9236-4c79-a892-2963f1b15b0e] Fetching instance by UUID {{(pid=72088) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:26:39 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-7ca76eee-d8b4-4184-a299-8aff63a73dde tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:26:39 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-7ca76eee-d8b4-4184-a299-8aff63a73dde tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:26:39 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-7ca76eee-d8b4-4184-a299-8aff63a73dde tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:26:39 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-7ca76eee-d8b4-4184-a299-8aff63a73dde tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:26:39 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-7ca76eee-d8b4-4184-a299-8aff63a73dde tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:26:39 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-7ca76eee-d8b4-4184-a299-8aff63a73dde tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:26:40 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [None req-7ca76eee-d8b4-4184-a299-8aff63a73dde tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] 10.0.0.210 "POST /compute/v2.1/servers/6802f099-9236-4c79-a892-2963f1b15b0e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.340624 Apr 11 19:26:40 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 118/356] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Apr 11 19:26:39 2023] POST /compute/v2.1/servers/6802f099-9236-4c79-a892-2963f1b15b0e/os-volume_attachments => generated 194 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:26:41 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [req-d336c825-d932-4839-8b67-5a0d6376fec9 req-45b20040-5ea7-43e7-8aee-9e57bb22b4e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "720c683f-c03a-444c-92a8-daf97c9f524b", "name": "network-vif-plugged", "status": "completed", "tag": "9e6087aa-464a-450d-bd04-2653d9420094"}]} {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:26:41 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-d336c825-d932-4839-8b67-5a0d6376fec9 req-45b20040-5ea7-43e7-8aee-9e57bb22b4e1 service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:26:41 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-d336c825-d932-4839-8b67-5a0d6376fec9 req-45b20040-5ea7-43e7-8aee-9e57bb22b4e1 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:26:41 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-d336c825-d932-4839-8b67-5a0d6376fec9 req-45b20040-5ea7-43e7-8aee-9e57bb22b4e1 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:26:41 user devstack@n-api.service[72090]: INFO nova.api.openstack.compute.server_external_events [req-d336c825-d932-4839-8b67-5a0d6376fec9 req-45b20040-5ea7-43e7-8aee-9e57bb22b4e1 service nova] Creating event network-vif-plugged:9e6087aa-464a-450d-bd04-2653d9420094 for instance 720c683f-c03a-444c-92a8-daf97c9f524b on user Apr 11 19:26:41 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [req-d336c825-d932-4839-8b67-5a0d6376fec9 req-45b20040-5ea7-43e7-8aee-9e57bb22b4e1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031633 Apr 11 19:26:41 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 117/357] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:26:41 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:26:43 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [req-150d1bfe-bf8e-468a-9924-35ea834eeb47 req-017fb6da-0a8d-48ee-913e-e6d71b185833 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "720c683f-c03a-444c-92a8-daf97c9f524b", "name": "network-vif-plugged", "status": "completed", "tag": "9e6087aa-464a-450d-bd04-2653d9420094"}]} {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:26:43 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-150d1bfe-bf8e-468a-9924-35ea834eeb47 req-017fb6da-0a8d-48ee-913e-e6d71b185833 service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:26:43 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-150d1bfe-bf8e-468a-9924-35ea834eeb47 req-017fb6da-0a8d-48ee-913e-e6d71b185833 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:26:43 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-150d1bfe-bf8e-468a-9924-35ea834eeb47 req-017fb6da-0a8d-48ee-913e-e6d71b185833 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:26:43 user devstack@n-api.service[72089]: INFO nova.api.openstack.compute.server_external_events [req-150d1bfe-bf8e-468a-9924-35ea834eeb47 req-017fb6da-0a8d-48ee-913e-e6d71b185833 service nova] Creating event network-vif-plugged:9e6087aa-464a-450d-bd04-2653d9420094 for instance 720c683f-c03a-444c-92a8-daf97c9f524b on user Apr 11 19:26:43 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [req-150d1bfe-bf8e-468a-9924-35ea834eeb47 req-017fb6da-0a8d-48ee-913e-e6d71b185833 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035375 Apr 11 19:26:43 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 123/358] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:26:43 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:26:45 user devstack@n-api.service[72088]: DEBUG dbcounter [-] [72088] Writing DB stats nova_cell0:SELECT=2 {{(pid=72088) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:26:45 user devstack@n-api.service[72088]: DEBUG dbcounter [-] [72088] Writing DB stats nova_cell0:SELECT=10 {{(pid=72088) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:26:45 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [None req-75c47ee1-8ccd-4a8a-9aab-dd3f92edd0a8 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Calling method '>' {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:26:45 user devstack@n-api.service[72088]: DEBUG nova.compute.api [None req-75c47ee1-8ccd-4a8a-9aab-dd3f92edd0a8 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] [instance: f37ed08c-8c9a-4af7-ba5f-b8a942e54389] Fetching instance by UUID {{(pid=72088) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:26:45 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-75c47ee1-8ccd-4a8a-9aab-dd3f92edd0a8 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:26:45 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-75c47ee1-8ccd-4a8a-9aab-dd3f92edd0a8 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:26:45 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-75c47ee1-8ccd-4a8a-9aab-dd3f92edd0a8 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:26:45 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-75c47ee1-8ccd-4a8a-9aab-dd3f92edd0a8 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:26:45 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-75c47ee1-8ccd-4a8a-9aab-dd3f92edd0a8 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:26:45 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-75c47ee1-8ccd-4a8a-9aab-dd3f92edd0a8 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:26:45 user devstack@n-api.service[72088]: DEBUG nova.policy [None req-75c47ee1-8ccd-4a8a-9aab-dd3f92edd0a8 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a32a5d0547141a180f655e98567ed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bceca6e3506e43f68f9cf8d0b56d141b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72088) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:26:45 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [None req-75c47ee1-8ccd-4a8a-9aab-dd3f92edd0a8 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f37ed08c-8c9a-4af7-ba5f-b8a942e54389" status: 200 len: 1537 microversion: 2.1 time: 0.195039 Apr 11 19:26:45 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 119/359] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 19:26:45 2023] GET /compute/v2.1/servers/f37ed08c-8c9a-4af7-ba5f-b8a942e54389 => generated 1537 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:26:47 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [None req-81f1074c-825c-446e-802d-2af426d9b7f0 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:26:47 user devstack@n-api.service[72090]: DEBUG dbcounter [-] [72090] Writing DB stats nova_cell0:SELECT=2 {{(pid=72090) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:26:47 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-81f1074c-825c-446e-802d-2af426d9b7f0 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:26:47 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-81f1074c-825c-446e-802d-2af426d9b7f0 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:26:47 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-81f1074c-825c-446e-802d-2af426d9b7f0 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:26:47 user devstack@n-api.service[72090]: DEBUG nova.compute.api [None req-81f1074c-825c-446e-802d-2af426d9b7f0 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] [instance: 6802f099-9236-4c79-a892-2963f1b15b0e] Going to try to stop instance {{(pid=72090) force_stop /opt/stack/nova/nova/compute/api.py:2764}} Apr 11 19:26:47 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [None req-81f1074c-825c-446e-802d-2af426d9b7f0 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] 10.0.0.210 "POST /compute/v2.1/servers/6802f099-9236-4c79-a892-2963f1b15b0e/action" status: 202 len: 0 microversion: 2.1 time: 0.123824 Apr 11 19:26:47 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 118/360] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Apr 11 19:26:47 2023] POST /compute/v2.1/servers/6802f099-9236-4c79-a892-2963f1b15b0e/action => generated 0 bytes in 126 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 19:26:47 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [None req-422b29d7-3d12-4957-aac8-c6fd4537c545 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Calling method '>' {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:26:47 user devstack@n-api.service[72089]: DEBUG nova.compute.api [None req-422b29d7-3d12-4957-aac8-c6fd4537c545 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] [instance: 6802f099-9236-4c79-a892-2963f1b15b0e] Fetching instance by UUID {{(pid=72089) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:26:47 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-422b29d7-3d12-4957-aac8-c6fd4537c545 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:26:47 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-422b29d7-3d12-4957-aac8-c6fd4537c545 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:26:47 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-422b29d7-3d12-4957-aac8-c6fd4537c545 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:26:47 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-422b29d7-3d12-4957-aac8-c6fd4537c545 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:26:47 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-422b29d7-3d12-4957-aac8-c6fd4537c545 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:26:47 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-422b29d7-3d12-4957-aac8-c6fd4537c545 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:26:48 user devstack@n-api.service[72089]: DEBUG nova.policy [None req-422b29d7-3d12-4957-aac8-c6fd4537c545 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31c237e142784bd6aa460d6f1bf33400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd886d2ec5fc946b49af3c8ca7c8556c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72089) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:26:48 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [None req-422b29d7-3d12-4957-aac8-c6fd4537c545 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6802f099-9236-4c79-a892-2963f1b15b0e" status: 200 len: 1713 microversion: 2.1 time: 0.229002 Apr 11 19:26:48 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 124/361] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 19:26:47 2023] GET /compute/v2.1/servers/6802f099-9236-4c79-a892-2963f1b15b0e => generated 1713 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:26:48 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [None req-44114a09-c8c1-420e-9b13-119a859ce211 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Action: 'create', calling method: .version_select at 0x7f119db5a290>, body: {"keypair": {"name": "tempest-keypair-185807874", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPbyHpdARVwQsB0yVIUDdRt39e/Rh8hpY6VgP/C5N1uvYaZZfTyXtGDRzpm2X2Az8MVhwAqoFSVzr+Ae6fw8QfbgkHfeed/GzNN9a27F9JKH0I8cWqQv/D93kLn/L5pokw=="}} {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:26:48 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [req-532f076b-899d-4e1d-8435-c0dd40a17483 req-5060b168-05fe-4af6-a3ba-209e5043eefd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6802f099-9236-4c79-a892-2963f1b15b0e", "name": "network-vif-unplugged", "status": "completed", "tag": "6193819b-0c1b-476b-b89e-dbbfc7938fc5"}]} {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:26:48 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-532f076b-899d-4e1d-8435-c0dd40a17483 req-5060b168-05fe-4af6-a3ba-209e5043eefd service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:26:48 user devstack@n-api.service[72088]: DEBUG nova.quota [None req-44114a09-c8c1-420e-9b13-119a859ce211 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Getting quotas for project 60a7381a31b84e97a068528f90813773. Resources: {'key_pairs'} {{(pid=72088) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 19:26:48 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-532f076b-899d-4e1d-8435-c0dd40a17483 req-5060b168-05fe-4af6-a3ba-209e5043eefd service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:26:48 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-532f076b-899d-4e1d-8435-c0dd40a17483 req-5060b168-05fe-4af6-a3ba-209e5043eefd service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:26:48 user devstack@n-api.service[72088]: DEBUG nova.quota [None req-44114a09-c8c1-420e-9b13-119a859ce211 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Getting quotas for user 05fb551c320a48f98a4ec00a7f7492d7 and project 60a7381a31b84e97a068528f90813773. Resources: {'key_pairs'} {{(pid=72088) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 19:26:48 user devstack@n-api.service[72090]: INFO nova.api.openstack.compute.server_external_events [req-532f076b-899d-4e1d-8435-c0dd40a17483 req-5060b168-05fe-4af6-a3ba-209e5043eefd service nova] Creating event network-vif-unplugged:6193819b-0c1b-476b-b89e-dbbfc7938fc5 for instance 6802f099-9236-4c79-a892-2963f1b15b0e on user Apr 11 19:26:48 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [req-532f076b-899d-4e1d-8435-c0dd40a17483 req-5060b168-05fe-4af6-a3ba-209e5043eefd service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.266497 Apr 11 19:26:48 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [None req-44114a09-c8c1-420e-9b13-119a859ce211 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.317237 Apr 11 19:26:48 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 120/362] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Apr 11 19:26:48 2023] POST /compute/v2.1/os-keypairs => generated 385 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:26:48 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 119/363] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:26:48 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:26:50 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [None req-0b375327-e374-412f-a43e-5d9e9f9a022a tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-505347267", "imageRef": "4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "8694f053-fd47-47b5-8463-d21b35fbe7ac"}], "security_groups": [{"name": "tempest-securitygroup--641665583"}], "key_name": "tempest-keypair-185807874", "user_data": "}} {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:26:50 user devstack@n-api.service[72089]: DEBUG nova.network.neutron [None req-0b375327-e374-412f-a43e-5d9e9f9a022a tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] validate_networks() for [('8694f053-fd47-47b5-8463-d21b35fbe7ac', None, None, None, None, None)] {{(pid=72089) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 11 19:26:50 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [req-abde3b6a-5947-425b-acfc-d9a4da595fa7 req-f30c6a6e-614e-4602-ae22-643f265cc5cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6802f099-9236-4c79-a892-2963f1b15b0e", "name": "network-vif-plugged", "status": "completed", "tag": "6193819b-0c1b-476b-b89e-dbbfc7938fc5"}]} {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:26:50 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-abde3b6a-5947-425b-acfc-d9a4da595fa7 req-f30c6a6e-614e-4602-ae22-643f265cc5cf service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:26:50 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-abde3b6a-5947-425b-acfc-d9a4da595fa7 req-f30c6a6e-614e-4602-ae22-643f265cc5cf service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:26:50 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-abde3b6a-5947-425b-acfc-d9a4da595fa7 req-f30c6a6e-614e-4602-ae22-643f265cc5cf service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:26:50 user devstack@n-api.service[72088]: INFO nova.api.openstack.compute.server_external_events [req-abde3b6a-5947-425b-acfc-d9a4da595fa7 req-f30c6a6e-614e-4602-ae22-643f265cc5cf service nova] Creating event network-vif-plugged:6193819b-0c1b-476b-b89e-dbbfc7938fc5 for instance 6802f099-9236-4c79-a892-2963f1b15b0e on user Apr 11 19:26:50 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [req-abde3b6a-5947-425b-acfc-d9a4da595fa7 req-f30c6a6e-614e-4602-ae22-643f265cc5cf service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028925 Apr 11 19:26:50 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 121/364] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:26:50 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:26:51 user devstack@n-api.service[72089]: DEBUG nova.virt.hardware [None req-0b375327-e374-412f-a43e-5d9e9f9a022a tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Flavor limits 0:0:0 {{(pid=72089) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 19:26:51 user devstack@n-api.service[72089]: DEBUG nova.virt.hardware [None req-0b375327-e374-412f-a43e-5d9e9f9a022a tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Image limits 0:0:0 {{(pid=72089) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 19:26:51 user devstack@n-api.service[72089]: DEBUG nova.virt.hardware [None req-0b375327-e374-412f-a43e-5d9e9f9a022a tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Flavor pref 0:0:0 {{(pid=72089) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 19:26:51 user devstack@n-api.service[72089]: DEBUG nova.virt.hardware [None req-0b375327-e374-412f-a43e-5d9e9f9a022a tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Image pref 0:0:0 {{(pid=72089) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 19:26:51 user devstack@n-api.service[72089]: DEBUG nova.virt.hardware [None req-0b375327-e374-412f-a43e-5d9e9f9a022a tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72089) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 19:26:51 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-0b375327-e374-412f-a43e-5d9e9f9a022a tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:26:51 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-0b375327-e374-412f-a43e-5d9e9f9a022a tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:26:51 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-0b375327-e374-412f-a43e-5d9e9f9a022a tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:26:51 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-0b375327-e374-412f-a43e-5d9e9f9a022a tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:26:51 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-0b375327-e374-412f-a43e-5d9e9f9a022a tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:26:51 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-0b375327-e374-412f-a43e-5d9e9f9a022a tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:26:51 user devstack@n-api.service[72089]: DEBUG nova.quota [None req-0b375327-e374-412f-a43e-5d9e9f9a022a tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Getting quotas for project 60a7381a31b84e97a068528f90813773. Resources: {'ram', 'instances', 'cores'} {{(pid=72089) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 19:26:51 user devstack@n-api.service[72089]: DEBUG nova.quota [None req-0b375327-e374-412f-a43e-5d9e9f9a022a tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Getting quotas for user 05fb551c320a48f98a4ec00a7f7492d7 and project 60a7381a31b84e97a068528f90813773. Resources: {'ram', 'instances', 'cores'} {{(pid=72089) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 19:26:51 user devstack@n-api.service[72089]: DEBUG nova.compute.api [None req-0b375327-e374-412f-a43e-5d9e9f9a022a tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Going to run 1 instances... {{(pid=72089) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 11 19:26:51 user devstack@n-api.service[72089]: DEBUG nova.compute.api [None req-0b375327-e374-412f-a43e-5d9e9f9a022a tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] [instance: 647674d8-af53-405a-8116-4b7a01549bdf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=72089) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 11 19:26:51 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [None req-0b375327-e374-412f-a43e-5d9e9f9a022a tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.767301 Apr 11 19:26:51 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 125/365] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 11 19:26:50 2023] POST /compute/v2.1/servers => generated 406 bytes in 768 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 11 19:26:51 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [None req-be042d19-e79c-4178-8a8d-48ef223e6ac1 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Calling method '>' {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:26:51 user devstack@n-api.service[72090]: DEBUG nova.compute.api [None req-be042d19-e79c-4178-8a8d-48ef223e6ac1 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] [instance: 647674d8-af53-405a-8116-4b7a01549bdf] Fetching instance by UUID {{(pid=72090) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:26:51 user devstack@n-api.service[72090]: DEBUG nova.policy [None req-be042d19-e79c-4178-8a8d-48ef223e6ac1 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05fb551c320a48f98a4ec00a7f7492d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60a7381a31b84e97a068528f90813773', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72090) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:26:51 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [None req-be042d19-e79c-4178-8a8d-48ef223e6ac1 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] 10.0.0.210 "GET /compute/v2.1/servers/647674d8-af53-405a-8116-4b7a01549bdf" status: 200 len: 1231 microversion: 2.1 time: 0.105674 Apr 11 19:26:51 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 120/366] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 19:26:51 2023] GET /compute/v2.1/servers/647674d8-af53-405a-8116-4b7a01549bdf => generated 1231 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:26:54 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [req-f0df4d5e-21ae-4a41-af24-928fd6a02d0b req-16b3b814-82e6-46f2-a949-15bdb9d34043 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "647674d8-af53-405a-8116-4b7a01549bdf", "tag": "e4e4888a-168a-4fe8-a43e-ee683b50a39a"}]} {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:26:54 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-f0df4d5e-21ae-4a41-af24-928fd6a02d0b req-16b3b814-82e6-46f2-a949-15bdb9d34043 service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:26:54 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-f0df4d5e-21ae-4a41-af24-928fd6a02d0b req-16b3b814-82e6-46f2-a949-15bdb9d34043 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:26:54 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-f0df4d5e-21ae-4a41-af24-928fd6a02d0b req-16b3b814-82e6-46f2-a949-15bdb9d34043 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:26:54 user devstack@n-api.service[72088]: INFO nova.api.openstack.compute.server_external_events [req-f0df4d5e-21ae-4a41-af24-928fd6a02d0b req-16b3b814-82e6-46f2-a949-15bdb9d34043 service nova] Creating event network-changed:e4e4888a-168a-4fe8-a43e-ee683b50a39a for instance 647674d8-af53-405a-8116-4b7a01549bdf on user Apr 11 19:26:54 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [req-f0df4d5e-21ae-4a41-af24-928fd6a02d0b req-16b3b814-82e6-46f2-a949-15bdb9d34043 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035559 Apr 11 19:26:54 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 122/367] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:26:54 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:26:56 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [req-677a9dbb-f514-4789-8836-c5b43312c015 req-03e33ecf-a4b5-4925-ba47-370acaa9ed0f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "647674d8-af53-405a-8116-4b7a01549bdf", "name": "network-vif-plugged", "status": "completed", "tag": "e4e4888a-168a-4fe8-a43e-ee683b50a39a"}]} {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:26:56 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-677a9dbb-f514-4789-8836-c5b43312c015 req-03e33ecf-a4b5-4925-ba47-370acaa9ed0f service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:26:56 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-677a9dbb-f514-4789-8836-c5b43312c015 req-03e33ecf-a4b5-4925-ba47-370acaa9ed0f service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:26:56 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-677a9dbb-f514-4789-8836-c5b43312c015 req-03e33ecf-a4b5-4925-ba47-370acaa9ed0f service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:26:56 user devstack@n-api.service[72089]: INFO nova.api.openstack.compute.server_external_events [req-677a9dbb-f514-4789-8836-c5b43312c015 req-03e33ecf-a4b5-4925-ba47-370acaa9ed0f service nova] Creating event network-vif-plugged:e4e4888a-168a-4fe8-a43e-ee683b50a39a for instance 647674d8-af53-405a-8116-4b7a01549bdf on user Apr 11 19:26:56 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [req-677a9dbb-f514-4789-8836-c5b43312c015 req-03e33ecf-a4b5-4925-ba47-370acaa9ed0f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.314952 Apr 11 19:26:56 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 126/368] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:26:56 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:26:57 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [None req-359ea0f7-794e-40d4-ad65-051e92e0f537 tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] Calling method '>' {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:26:57 user devstack@n-api.service[72090]: DEBUG nova.compute.api [None req-359ea0f7-794e-40d4-ad65-051e92e0f537 tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] [instance: ac961841-1fc4-4cec-89bd-8f932270441a] Fetching instance by UUID {{(pid=72090) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:26:57 user devstack@n-api.service[72090]: DEBUG dbcounter [-] [72090] Writing DB stats nova_api:SELECT=24,nova_api:DELETE=1 {{(pid=72090) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:26:57 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-359ea0f7-794e-40d4-ad65-051e92e0f537 tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:26:57 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-359ea0f7-794e-40d4-ad65-051e92e0f537 tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:26:57 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-359ea0f7-794e-40d4-ad65-051e92e0f537 tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:26:57 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-359ea0f7-794e-40d4-ad65-051e92e0f537 tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:26:57 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-359ea0f7-794e-40d4-ad65-051e92e0f537 tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:26:57 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-359ea0f7-794e-40d4-ad65-051e92e0f537 tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:26:57 user devstack@n-api.service[72090]: DEBUG dbcounter [-] [72090] Writing DB stats nova_cell1:SELECT=27,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=72090) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:26:57 user devstack@n-api.service[72090]: DEBUG nova.compute.api [None req-359ea0f7-794e-40d4-ad65-051e92e0f537 tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] [instance: ac961841-1fc4-4cec-89bd-8f932270441a] Going to try to terminate instance {{(pid=72090) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 11 19:26:57 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [None req-359ea0f7-794e-40d4-ad65-051e92e0f537 tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/ac961841-1fc4-4cec-89bd-8f932270441a" status: 204 len: 0 microversion: 2.1 time: 0.114097 Apr 11 19:26:57 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 121/369] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 19:26:57 2023] DELETE /compute/v2.1/servers/ac961841-1fc4-4cec-89bd-8f932270441a => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Apr 11 19:26:57 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [None req-5d2dc189-dc0f-4c41-bbdf-36066add16cf tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] Calling method '>' {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:26:57 user devstack@n-api.service[72088]: DEBUG nova.compute.api [None req-5d2dc189-dc0f-4c41-bbdf-36066add16cf tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] [instance: ac961841-1fc4-4cec-89bd-8f932270441a] Fetching instance by UUID {{(pid=72088) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:26:57 user devstack@n-api.service[72088]: DEBUG dbcounter [-] [72088] Writing DB stats nova_api:SELECT=51,nova_api:DELETE=1,nova_api:INSERT=5 {{(pid=72088) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:26:57 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-5d2dc189-dc0f-4c41-bbdf-36066add16cf tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:26:57 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-5d2dc189-dc0f-4c41-bbdf-36066add16cf tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:26:57 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-5d2dc189-dc0f-4c41-bbdf-36066add16cf tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:26:57 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-5d2dc189-dc0f-4c41-bbdf-36066add16cf tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:26:57 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-5d2dc189-dc0f-4c41-bbdf-36066add16cf tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:26:57 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-5d2dc189-dc0f-4c41-bbdf-36066add16cf tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:26:57 user devstack@n-api.service[72088]: DEBUG dbcounter [-] [72088] Writing DB stats nova_cell1:SELECT=26,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=72088) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:26:57 user devstack@n-api.service[72088]: DEBUG nova.policy [None req-5d2dc189-dc0f-4c41-bbdf-36066add16cf tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c9641ceb17e4914b1cdf061c5bdc79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7543456a70d04d7f8c50f37e64b7ee9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72088) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:26:57 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [None req-5d2dc189-dc0f-4c41-bbdf-36066add16cf tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ac961841-1fc4-4cec-89bd-8f932270441a" status: 200 len: 1491 microversion: 2.1 time: 0.206829 Apr 11 19:26:57 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 123/370] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 19:26:57 2023] GET /compute/v2.1/servers/ac961841-1fc4-4cec-89bd-8f932270441a => generated 1491 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:26:57 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [req-7047ebc7-4d95-4c48-93ec-dab9c9e3b065 req-883626bd-162e-40d1-bdbe-cd281d37bac8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac961841-1fc4-4cec-89bd-8f932270441a", "name": "network-vif-unplugged", "status": "completed", "tag": "c48d7fec-727d-409c-8285-6ae0da5ff14d"}]} {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:26:57 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-7047ebc7-4d95-4c48-93ec-dab9c9e3b065 req-883626bd-162e-40d1-bdbe-cd281d37bac8 service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:26:57 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-7047ebc7-4d95-4c48-93ec-dab9c9e3b065 req-883626bd-162e-40d1-bdbe-cd281d37bac8 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:26:57 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-7047ebc7-4d95-4c48-93ec-dab9c9e3b065 req-883626bd-162e-40d1-bdbe-cd281d37bac8 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:26:57 user devstack@n-api.service[72089]: INFO nova.api.openstack.compute.server_external_events [req-7047ebc7-4d95-4c48-93ec-dab9c9e3b065 req-883626bd-162e-40d1-bdbe-cd281d37bac8 service nova] Creating event network-vif-unplugged:c48d7fec-727d-409c-8285-6ae0da5ff14d for instance ac961841-1fc4-4cec-89bd-8f932270441a on user Apr 11 19:26:57 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [req-7047ebc7-4d95-4c48-93ec-dab9c9e3b065 req-883626bd-162e-40d1-bdbe-cd281d37bac8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033339 Apr 11 19:26:57 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 127/371] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:26:57 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:26:58 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [req-3e136e54-8d01-4373-a9fc-ae9570fc8b96 req-3de89ad7-28dd-4d04-9a9b-4ad9ac738318 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "647674d8-af53-405a-8116-4b7a01549bdf", "name": "network-vif-plugged", "status": "completed", "tag": "e4e4888a-168a-4fe8-a43e-ee683b50a39a"}]} {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:26:58 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-3e136e54-8d01-4373-a9fc-ae9570fc8b96 req-3de89ad7-28dd-4d04-9a9b-4ad9ac738318 service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:26:58 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-3e136e54-8d01-4373-a9fc-ae9570fc8b96 req-3de89ad7-28dd-4d04-9a9b-4ad9ac738318 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:26:58 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-3e136e54-8d01-4373-a9fc-ae9570fc8b96 req-3de89ad7-28dd-4d04-9a9b-4ad9ac738318 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:26:58 user devstack@n-api.service[72090]: INFO nova.api.openstack.compute.server_external_events [req-3e136e54-8d01-4373-a9fc-ae9570fc8b96 req-3de89ad7-28dd-4d04-9a9b-4ad9ac738318 service nova] Creating event network-vif-plugged:e4e4888a-168a-4fe8-a43e-ee683b50a39a for instance 647674d8-af53-405a-8116-4b7a01549bdf on user Apr 11 19:26:58 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [req-3e136e54-8d01-4373-a9fc-ae9570fc8b96 req-3de89ad7-28dd-4d04-9a9b-4ad9ac738318 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031405 Apr 11 19:26:58 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 122/372] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:26:58 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:26:59 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [req-eb4b3b6c-5e6d-4ca9-8b2c-c45450db5ed4 req-05849aa4-6677-42e9-b266-50acf1a3af38 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac961841-1fc4-4cec-89bd-8f932270441a", "name": "network-vif-plugged", "status": "completed", "tag": "c48d7fec-727d-409c-8285-6ae0da5ff14d"}, {"server_uuid": "ac961841-1fc4-4cec-89bd-8f932270441a", "name": "network-vif-deleted", "tag": "c48d7fec-727d-409c-8285-6ae0da5ff14d"}]} {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:26:59 user devstack@n-api.service[72088]: DEBUG dbcounter [-] [72088] Writing DB stats nova_cell0:SELECT=4 {{(pid=72088) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:26:59 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-eb4b3b6c-5e6d-4ca9-8b2c-c45450db5ed4 req-05849aa4-6677-42e9-b266-50acf1a3af38 service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:26:59 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-eb4b3b6c-5e6d-4ca9-8b2c-c45450db5ed4 req-05849aa4-6677-42e9-b266-50acf1a3af38 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:26:59 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-eb4b3b6c-5e6d-4ca9-8b2c-c45450db5ed4 req-05849aa4-6677-42e9-b266-50acf1a3af38 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:26:59 user devstack@n-api.service[72088]: INFO nova.api.openstack.compute.server_external_events [req-eb4b3b6c-5e6d-4ca9-8b2c-c45450db5ed4 req-05849aa4-6677-42e9-b266-50acf1a3af38 service nova] Creating event network-vif-plugged:c48d7fec-727d-409c-8285-6ae0da5ff14d for instance ac961841-1fc4-4cec-89bd-8f932270441a on user Apr 11 19:26:59 user devstack@n-api.service[72088]: INFO nova.api.openstack.compute.server_external_events [req-eb4b3b6c-5e6d-4ca9-8b2c-c45450db5ed4 req-05849aa4-6677-42e9-b266-50acf1a3af38 service nova] Creating event network-vif-deleted:c48d7fec-727d-409c-8285-6ae0da5ff14d for instance ac961841-1fc4-4cec-89bd-8f932270441a on user Apr 11 19:26:59 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [req-eb4b3b6c-5e6d-4ca9-8b2c-c45450db5ed4 req-05849aa4-6677-42e9-b266-50acf1a3af38 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.039408 Apr 11 19:26:59 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 124/373] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:26:59 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:27:01 user devstack@n-api.service[72089]: DEBUG dbcounter [-] [72089] Writing DB stats nova_cell0:SELECT=2 {{(pid=72089) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:27:01 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [None req-9b2f5544-d8dd-416e-bfea-c578515a17f8 tempest-VolumesAdminNegativeTest-731043923 tempest-VolumesAdminNegativeTest-731043923-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "fe5d7b75-a2c8-40dc-a578-7a9ba4e21d12"}} {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:27:01 user devstack@n-api.service[72089]: DEBUG nova.compute.api [None req-9b2f5544-d8dd-416e-bfea-c578515a17f8 tempest-VolumesAdminNegativeTest-731043923 tempest-VolumesAdminNegativeTest-731043923-project-admin] [instance: 083108da-0a96-4177-8866-66131d77c39b] Fetching instance by UUID {{(pid=72089) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:27:01 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-9b2f5544-d8dd-416e-bfea-c578515a17f8 tempest-VolumesAdminNegativeTest-731043923 tempest-VolumesAdminNegativeTest-731043923-project-admin] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:27:01 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-9b2f5544-d8dd-416e-bfea-c578515a17f8 tempest-VolumesAdminNegativeTest-731043923 tempest-VolumesAdminNegativeTest-731043923-project-admin] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:27:01 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-9b2f5544-d8dd-416e-bfea-c578515a17f8 tempest-VolumesAdminNegativeTest-731043923 tempest-VolumesAdminNegativeTest-731043923-project-admin] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:27:01 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-9b2f5544-d8dd-416e-bfea-c578515a17f8 tempest-VolumesAdminNegativeTest-731043923 tempest-VolumesAdminNegativeTest-731043923-project-admin] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:27:01 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-9b2f5544-d8dd-416e-bfea-c578515a17f8 tempest-VolumesAdminNegativeTest-731043923 tempest-VolumesAdminNegativeTest-731043923-project-admin] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:27:01 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-9b2f5544-d8dd-416e-bfea-c578515a17f8 tempest-VolumesAdminNegativeTest-731043923 tempest-VolumesAdminNegativeTest-731043923-project-admin] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:27:01 user devstack@n-api.service[72089]: DEBUG dbcounter [-] [72089] Writing DB stats nova_cell0:SELECT=6 {{(pid=72089) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:27:01 user devstack@n-api.service[72089]: INFO nova.api.openstack.wsgi [None req-9b2f5544-d8dd-416e-bfea-c578515a17f8 tempest-VolumesAdminNegativeTest-731043923 tempest-VolumesAdminNegativeTest-731043923-project-admin] HTTP exception thrown: Volume 40319516-1355-483a-926f-be3e570f0b03 could not be found. Apr 11 19:27:01 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [None req-9b2f5544-d8dd-416e-bfea-c578515a17f8 tempest-VolumesAdminNegativeTest-731043923 tempest-VolumesAdminNegativeTest-731043923-project-admin] Request method failure captured: Apr 11 19:27:01 user devstack@n-api.service[72089]: request: PUT /compute/v2.1/servers/083108da-0a96-4177-8866-66131d77c39b/os-volume_attachments/40319516-1355-483a-926f-be3e570f0b03 HTTP/1.1 Apr 11 19:27:01 user devstack@n-api.service[72089]: Accept: application/json Apr 11 19:27:01 user devstack@n-api.service[72089]: Accept-Encoding: identity Apr 11 19:27:01 user devstack@n-api.service[72089]: Connection: close Apr 11 19:27:01 user devstack@n-api.service[72089]: Content-Length: 74 Apr 11 19:27:01 user devstack@n-api.service[72089]: Content-Type: application/json Apr 11 19:27:01 user devstack@n-api.service[72089]: Host: 10.0.0.210 Apr 11 19:27:01 user devstack@n-api.service[72089]: Openstack-System-Scope: None Apr 11 19:27:01 user devstack@n-api.service[72089]: User-Agent: python-urllib3/1.26.15 Apr 11 19:27:01 user devstack@n-api.service[72089]: X-Auth-Token: gAAAAABkNbNjhstSp3gMaMntNK884ejhXS8F3SWSNiLKAkgVuBEPd6JpGPmj4s4SN1uLXS8B-HaS8_St3V3Vu6G6bqT2DHCxuNGGV_HW_-_cqNaZ7PMWZ9_aLmRi5HMLEp08IEObZ76AdvhBwWj_nO0PECB1TrrDojYETLTSAYmZal58u_AVZ5Y Apr 11 19:27:01 user devstack@n-api.service[72089]: X-Domain-Id: None Apr 11 19:27:01 user devstack@n-api.service[72089]: X-Domain-Name: None Apr 11 19:27:01 user devstack@n-api.service[72089]: X-Identity-Status: Confirmed Apr 11 19:27:01 user devstack@n-api.service[72089]: X-Is-Admin-Project: True Apr 11 19:27:01 user devstack@n-api.service[72089]: X-Project-Domain-Id: default Apr 11 19:27:01 user devstack@n-api.service[72089]: X-Project-Domain-Name: Default Apr 11 19:27:01 user devstack@n-api.service[72089]: X-Project-Id: 861da46acc9948bc87b3f81a520975dd Apr 11 19:27:01 user devstack@n-api.service[72089]: X-Project-Name: tempest-VolumesAdminNegativeTest-731043923 Apr 11 19:27:01 user devstack@n-api.service[72089]: X-Role: reader,admin,member Apr 11 19:27:01 user devstack@n-api.service[72089]: X-Roles: reader,admin,member Apr 11 19:27:01 user devstack@n-api.service[72089]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/861da46acc9948bc87b3f81a520975dd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/861da46acc9948bc87b3f81a520975dd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/861da46acc9948bc87b3f81a520975dd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 11 19:27:01 user devstack@n-api.service[72089]: X-Tenant: tempest-VolumesAdminNegativeTest-731043923 Apr 11 19:27:01 user devstack@n-api.service[72089]: X-Tenant-Id: 861da46acc9948bc87b3f81a520975dd Apr 11 19:27:01 user devstack@n-api.service[72089]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-731043923 Apr 11 19:27:01 user devstack@n-api.service[72089]: X-User: tempest-VolumesAdminNegativeTest-731043923-project-admin Apr 11 19:27:01 user devstack@n-api.service[72089]: X-User-Domain-Id: default Apr 11 19:27:01 user devstack@n-api.service[72089]: X-User-Domain-Name: Default Apr 11 19:27:01 user devstack@n-api.service[72089]: X-User-Id: 514a4ce680104cc8bff11add7c74f8cd Apr 11 19:27:01 user devstack@n-api.service[72089]: X-User-Name: tempest-VolumesAdminNegativeTest-731043923-project-admin Apr 11 19:27:01 user devstack@n-api.service[72089]: Apr 11 19:27:01 user devstack@n-api.service[72089]: {"volumeAttachment": {"volumeId": "fe5d7b75-a2c8-40dc-a578-7a9ba4e21d12"}} Apr 11 19:27:01 user devstack@n-api.service[72089]: method: > Apr 11 19:27:01 user devstack@n-api.service[72089]: exception: Volume 40319516-1355-483a-926f-be3e570f0b03 could not be found. Apr 11 19:27:01 user devstack@n-api.service[72089]: action_args: {'server_id': '083108da-0a96-4177-8866-66131d77c39b', 'id': '40319516-1355-483a-926f-be3e570f0b03', 'body': {'volumeAttachment': {'volumeId': 'fe5d7b75-a2c8-40dc-a578-7a9ba4e21d12'}}} Apr 11 19:27:01 user devstack@n-api.service[72089]: {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 19:27:01 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:27:01 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 11 19:27:01 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 11 19:27:01 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 11 19:27:01 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 11 19:27:01 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 11 19:27:01 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 11 19:27:01 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 11 19:27:01 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 11 19:27:01 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 11 19:27:01 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 11 19:27:01 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 11 19:27:01 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 11 19:27:01 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 11 19:27:01 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 11 19:27:01 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 40319516-1355-483a-926f-be3e570f0b03 could not be found. (HTTP 404) (Request-ID: req-01cc910e-0c16-4a52-b287-1cf0b9cc128b) Apr 11 19:27:01 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi Apr 11 19:27:01 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 19:27:01 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi Apr 11 19:27:01 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:27:01 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 430, in _update_volume_swap Apr 11 19:27:01 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi old_volume = self.volume_api.get(context, old_volume_id) Apr 11 19:27:01 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 11 19:27:01 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 11 19:27:01 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 11 19:27:01 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 11 19:27:01 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 11 19:27:01 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 11 19:27:01 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 11 19:27:01 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 11 19:27:01 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 11 19:27:01 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 11 19:27:01 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 11 19:27:01 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 11 19:27:01 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 11 19:27:01 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 11 19:27:01 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 11 19:27:01 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 11 19:27:01 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 11 19:27:01 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 11 19:27:01 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 11 19:27:01 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 11 19:27:01 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 40319516-1355-483a-926f-be3e570f0b03 could not be found. Apr 11 19:27:01 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi Apr 11 19:27:01 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 19:27:01 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi Apr 11 19:27:01 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:27:01 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 19:27:01 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 19:27:01 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 19:27:01 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 19:27:01 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 19:27:01 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 19:27:01 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 11 19:27:01 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 11 19:27:01 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 11 19:27:01 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 11 19:27:01 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Apr 11 19:27:01 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Apr 11 19:27:01 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 432, in _update_volume_swap Apr 11 19:27:01 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 19:27:01 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 40319516-1355-483a-926f-be3e570f0b03 could not be found. Apr 11 19:27:01 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi Apr 11 19:27:01 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 19:27:01 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi Apr 11 19:27:01 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:27:01 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 19:27:01 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 19:27:01 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 19:27:01 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 19:27:01 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 40319516-1355-483a-926f-be3e570f0b03 could not be found. Apr 11 19:27:01 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi Apr 11 19:27:01 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [None req-9b2f5544-d8dd-416e-bfea-c578515a17f8 tempest-VolumesAdminNegativeTest-731043923 tempest-VolumesAdminNegativeTest-731043923-project-admin] Returning 404 to user: Volume 40319516-1355-483a-926f-be3e570f0b03 could not be found. {{(pid=72089) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 19:27:01 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [None req-9b2f5544-d8dd-416e-bfea-c578515a17f8 tempest-VolumesAdminNegativeTest-731043923 tempest-VolumesAdminNegativeTest-731043923-project-admin] 10.0.0.210 "PUT /compute/v2.1/servers/083108da-0a96-4177-8866-66131d77c39b/os-volume_attachments/40319516-1355-483a-926f-be3e570f0b03" status: 404 len: 109 microversion: 2.1 time: 0.080117 Apr 11 19:27:01 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 128/374] 10.0.0.210 () {64 vars in 1510 bytes} [Tue Apr 11 19:27:01 2023] PUT /compute/v2.1/servers/083108da-0a96-4177-8866-66131d77c39b/os-volume_attachments/40319516-1355-483a-926f-be3e570f0b03 => generated 109 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 19:27:02 user devstack@n-api.service[72090]: DEBUG dbcounter [-] [72090] Writing DB stats nova_cell0:SELECT=2 {{(pid=72090) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:27:02 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [None req-d5236c76-7941-47f3-8f4b-91116e6b2feb tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] Calling method '>' {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:27:02 user devstack@n-api.service[72090]: DEBUG nova.compute.api [None req-d5236c76-7941-47f3-8f4b-91116e6b2feb tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] [instance: 083108da-0a96-4177-8866-66131d77c39b] Fetching instance by UUID {{(pid=72090) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:27:02 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-d5236c76-7941-47f3-8f4b-91116e6b2feb tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:27:02 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-d5236c76-7941-47f3-8f4b-91116e6b2feb tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:27:02 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-d5236c76-7941-47f3-8f4b-91116e6b2feb tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:27:02 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-d5236c76-7941-47f3-8f4b-91116e6b2feb tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:27:02 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-d5236c76-7941-47f3-8f4b-91116e6b2feb tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:27:02 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-d5236c76-7941-47f3-8f4b-91116e6b2feb tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:27:02 user devstack@n-api.service[72090]: DEBUG nova.compute.api [None req-d5236c76-7941-47f3-8f4b-91116e6b2feb tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] [instance: 083108da-0a96-4177-8866-66131d77c39b] Going to try to terminate instance {{(pid=72090) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 11 19:27:02 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [None req-d5236c76-7941-47f3-8f4b-91116e6b2feb tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/083108da-0a96-4177-8866-66131d77c39b" status: 204 len: 0 microversion: 2.1 time: 0.145427 Apr 11 19:27:02 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 123/375] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 19:27:02 2023] DELETE /compute/v2.1/servers/083108da-0a96-4177-8866-66131d77c39b => generated 0 bytes in 148 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 11 19:27:02 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [None req-92d2853c-87c9-4023-a113-7b5f26d17652 tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] Calling method '>' {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:27:02 user devstack@n-api.service[72088]: DEBUG nova.compute.api [None req-92d2853c-87c9-4023-a113-7b5f26d17652 tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] [instance: 083108da-0a96-4177-8866-66131d77c39b] Fetching instance by UUID {{(pid=72088) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:27:02 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-92d2853c-87c9-4023-a113-7b5f26d17652 tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:27:02 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-92d2853c-87c9-4023-a113-7b5f26d17652 tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:27:02 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-92d2853c-87c9-4023-a113-7b5f26d17652 tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:27:02 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-92d2853c-87c9-4023-a113-7b5f26d17652 tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:27:02 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-92d2853c-87c9-4023-a113-7b5f26d17652 tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:27:02 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-92d2853c-87c9-4023-a113-7b5f26d17652 tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:27:02 user devstack@n-api.service[72088]: DEBUG nova.policy [None req-92d2853c-87c9-4023-a113-7b5f26d17652 tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b4a383f04d4269a0099a738e14807e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f153e6b272924b8fa0ef28fb5f0970bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72088) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:27:02 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [None req-92d2853c-87c9-4023-a113-7b5f26d17652 tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] 10.0.0.210 "GET /compute/v2.1/servers/083108da-0a96-4177-8866-66131d77c39b" status: 200 len: 1500 microversion: 2.1 time: 0.188875 Apr 11 19:27:02 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 125/376] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 19:27:02 2023] GET /compute/v2.1/servers/083108da-0a96-4177-8866-66131d77c39b => generated 1500 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 19:27:02 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [req-215c91ec-5986-48c1-94b6-d79c6d5b978b req-44e76cf8-9b80-4c18-82ed-cce22c60f89c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "083108da-0a96-4177-8866-66131d77c39b", "name": "network-vif-unplugged", "status": "completed", "tag": "44671174-415b-41e7-964a-8c37ccb6a82d"}]} {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:27:02 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-215c91ec-5986-48c1-94b6-d79c6d5b978b req-44e76cf8-9b80-4c18-82ed-cce22c60f89c service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:27:02 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-215c91ec-5986-48c1-94b6-d79c6d5b978b req-44e76cf8-9b80-4c18-82ed-cce22c60f89c service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:27:02 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-215c91ec-5986-48c1-94b6-d79c6d5b978b req-44e76cf8-9b80-4c18-82ed-cce22c60f89c service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:27:02 user devstack@n-api.service[72089]: DEBUG dbcounter [-] [72089] Writing DB stats nova_cell1:SELECT=42,nova_cell1:INSERT=1 {{(pid=72089) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:27:02 user devstack@n-api.service[72089]: INFO nova.api.openstack.compute.server_external_events [req-215c91ec-5986-48c1-94b6-d79c6d5b978b req-44e76cf8-9b80-4c18-82ed-cce22c60f89c service nova] Creating event network-vif-unplugged:44671174-415b-41e7-964a-8c37ccb6a82d for instance 083108da-0a96-4177-8866-66131d77c39b on user Apr 11 19:27:02 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [req-215c91ec-5986-48c1-94b6-d79c6d5b978b req-44e76cf8-9b80-4c18-82ed-cce22c60f89c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.029676 Apr 11 19:27:02 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 129/377] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:27:02 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:27:04 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [req-25c60bd2-f764-4291-b6bf-ffc1c91f91e2 req-b616a371-5d2e-4004-9ccd-42642ddb5655 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "083108da-0a96-4177-8866-66131d77c39b", "name": "network-vif-plugged", "status": "completed", "tag": "44671174-415b-41e7-964a-8c37ccb6a82d"}, {"server_uuid": "083108da-0a96-4177-8866-66131d77c39b", "name": "network-vif-deleted", "tag": "44671174-415b-41e7-964a-8c37ccb6a82d"}]} {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:27:04 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-25c60bd2-f764-4291-b6bf-ffc1c91f91e2 req-b616a371-5d2e-4004-9ccd-42642ddb5655 service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:27:04 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-25c60bd2-f764-4291-b6bf-ffc1c91f91e2 req-b616a371-5d2e-4004-9ccd-42642ddb5655 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:27:04 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-25c60bd2-f764-4291-b6bf-ffc1c91f91e2 req-b616a371-5d2e-4004-9ccd-42642ddb5655 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:27:04 user devstack@n-api.service[72090]: INFO nova.api.openstack.compute.server_external_events [req-25c60bd2-f764-4291-b6bf-ffc1c91f91e2 req-b616a371-5d2e-4004-9ccd-42642ddb5655 service nova] Creating event network-vif-plugged:44671174-415b-41e7-964a-8c37ccb6a82d for instance 083108da-0a96-4177-8866-66131d77c39b on user Apr 11 19:27:04 user devstack@n-api.service[72090]: INFO nova.api.openstack.compute.server_external_events [req-25c60bd2-f764-4291-b6bf-ffc1c91f91e2 req-b616a371-5d2e-4004-9ccd-42642ddb5655 service nova] Creating event network-vif-deleted:44671174-415b-41e7-964a-8c37ccb6a82d for instance 083108da-0a96-4177-8866-66131d77c39b on user Apr 11 19:27:04 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [req-25c60bd2-f764-4291-b6bf-ffc1c91f91e2 req-b616a371-5d2e-4004-9ccd-42642ddb5655 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.030119 Apr 11 19:27:04 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 124/378] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:27:04 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:27:11 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [None req-9196e7ab-4dd8-46e1-9b68-ed59ff673edd tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1243344397", "imageRef": "", "flavorRef": "42", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "99b10be8-43b6-41e0-9de4-096fe22bd1a9", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "b29e55eb-c801-47f0-8cb7-be11e1471261"}]}} {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:27:11 user devstack@n-api.service[72088]: INFO nova.api.openstack.wsgi [None req-9196e7ab-4dd8-46e1-9b68-ed59ff673edd tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] HTTP exception thrown: Block Device 99b10be8-43b6-41e0-9de4-096fe22bd1a9 is not bootable. Apr 11 19:27:11 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [None req-9196e7ab-4dd8-46e1-9b68-ed59ff673edd tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] Request method failure captured: Apr 11 19:27:11 user devstack@n-api.service[72088]: request: POST /compute/v2.1/servers HTTP/1.1 Apr 11 19:27:11 user devstack@n-api.service[72088]: Accept: application/json Apr 11 19:27:11 user devstack@n-api.service[72088]: Accept-Encoding: identity Apr 11 19:27:11 user devstack@n-api.service[72088]: Connection: close Apr 11 19:27:11 user devstack@n-api.service[72088]: Content-Length: 357 Apr 11 19:27:11 user devstack@n-api.service[72088]: Content-Type: application/json Apr 11 19:27:11 user devstack@n-api.service[72088]: Host: 10.0.0.210 Apr 11 19:27:11 user devstack@n-api.service[72088]: Openstack-System-Scope: None Apr 11 19:27:11 user devstack@n-api.service[72088]: User-Agent: python-urllib3/1.26.15 Apr 11 19:27:11 user devstack@n-api.service[72088]: X-Auth-Token: gAAAAABkNbM9ghjK_EzyGnW10Ps6cv4IuUgiOsH3-4CZQwwhssOT7z-coBiD1Tdn5TLuazoYlNl2MKZxDC8EHQ-1kxF1ymJhDXjVHNMOdUuaIOx6Zld44aVLhO1ciOh-QMlmbYyfhSKlVncwSZpaRu_co_jrVH31BrJgKqwLygUbeq6C-c51jnQ Apr 11 19:27:11 user devstack@n-api.service[72088]: X-Domain-Id: None Apr 11 19:27:11 user devstack@n-api.service[72088]: X-Domain-Name: None Apr 11 19:27:11 user devstack@n-api.service[72088]: X-Identity-Status: Confirmed Apr 11 19:27:11 user devstack@n-api.service[72088]: X-Is-Admin-Project: True Apr 11 19:27:11 user devstack@n-api.service[72088]: X-Project-Domain-Id: default Apr 11 19:27:11 user devstack@n-api.service[72088]: X-Project-Domain-Name: Default Apr 11 19:27:11 user devstack@n-api.service[72088]: X-Project-Id: 0d5d7769df1e4974b295cb30407151dd Apr 11 19:27:11 user devstack@n-api.service[72088]: X-Project-Name: tempest-ServersNegativeTestJSON-1311045721 Apr 11 19:27:11 user devstack@n-api.service[72088]: X-Role: reader,member Apr 11 19:27:11 user devstack@n-api.service[72088]: X-Roles: reader,member Apr 11 19:27:11 user devstack@n-api.service[72088]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0d5d7769df1e4974b295cb30407151dd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/0d5d7769df1e4974b295cb30407151dd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0d5d7769df1e4974b295cb30407151dd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 11 19:27:11 user devstack@n-api.service[72088]: X-Tenant: tempest-ServersNegativeTestJSON-1311045721 Apr 11 19:27:11 user devstack@n-api.service[72088]: X-Tenant-Id: 0d5d7769df1e4974b295cb30407151dd Apr 11 19:27:11 user devstack@n-api.service[72088]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1311045721 Apr 11 19:27:11 user devstack@n-api.service[72088]: X-User: tempest-ServersNegativeTestJSON-1311045721-project-member Apr 11 19:27:11 user devstack@n-api.service[72088]: X-User-Domain-Id: default Apr 11 19:27:11 user devstack@n-api.service[72088]: X-User-Domain-Name: Default Apr 11 19:27:11 user devstack@n-api.service[72088]: X-User-Id: 2f44dfa2528b4540a81f4eb7c3f3f2f5 Apr 11 19:27:11 user devstack@n-api.service[72088]: X-User-Name: tempest-ServersNegativeTestJSON-1311045721-project-member Apr 11 19:27:11 user devstack@n-api.service[72088]: Apr 11 19:27:11 user devstack@n-api.service[72088]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1243344397", "imageRef": "", "flavorRef": "42", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "99b10be8-43b6-41e0-9de4-096fe22bd1a9", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "b29e55eb-c801-47f0-8cb7-be11e1471261"}]}} Apr 11 19:27:11 user devstack@n-api.service[72088]: method: > Apr 11 19:27:11 user devstack@n-api.service[72088]: exception: Block Device 99b10be8-43b6-41e0-9de4-096fe22bd1a9 is not bootable. Apr 11 19:27:11 user devstack@n-api.service[72088]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1243344397', 'imageRef': '', 'flavorRef': '42', 'block_device_mapping_v2': [{'boot_index': 0, 'source_type': 'volume', 'destination_type': 'volume', 'delete_on_termination': False, 'volume_id': '99b10be8-43b6-41e0-9de4-096fe22bd1a9'}], 'networks': [{'uuid': 'b29e55eb-c801-47f0-8cb7-be11e1471261'}]}}} Apr 11 19:27:11 user devstack@n-api.service[72088]: {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 19:27:11 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:27:11 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 785, in create Apr 11 19:27:11 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Apr 11 19:27:11 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Apr 11 19:27:11 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi return self._create_instance( Apr 11 19:27:11 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1672, in _create_instance Apr 11 19:27:11 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi boot_meta = block_device.get_bdm_image_metadata( Apr 11 19:27:11 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/block_device.py", line 664, in get_bdm_image_metadata Apr 11 19:27:11 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi raise exception.InvalidBDMVolumeNotBootable(id=volume_id) Apr 11 19:27:11 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi nova.exception.InvalidBDMVolumeNotBootable: Block Device 99b10be8-43b6-41e0-9de4-096fe22bd1a9 is not bootable. Apr 11 19:27:11 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi Apr 11 19:27:11 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 19:27:11 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi Apr 11 19:27:11 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:27:11 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 19:27:11 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 19:27:11 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 19:27:11 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 19:27:11 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 19:27:11 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 19:27:11 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 11 19:27:11 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 11 19:27:11 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 11 19:27:11 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 11 19:27:11 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 11 19:27:11 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 11 19:27:11 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi [Previous line repeated 11 more times] Apr 11 19:27:11 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 867, in create Apr 11 19:27:11 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Apr 11 19:27:11 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Block Device 99b10be8-43b6-41e0-9de4-096fe22bd1a9 is not bootable. Apr 11 19:27:11 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi Apr 11 19:27:11 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 19:27:11 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi Apr 11 19:27:11 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:27:11 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 19:27:11 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 19:27:11 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 19:27:11 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 19:27:11 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Block Device 99b10be8-43b6-41e0-9de4-096fe22bd1a9 is not bootable. Apr 11 19:27:11 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi Apr 11 19:27:11 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [None req-9196e7ab-4dd8-46e1-9b68-ed59ff673edd tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] Returning 400 to user: Block Device 99b10be8-43b6-41e0-9de4-096fe22bd1a9 is not bootable. {{(pid=72088) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 19:27:11 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [None req-9196e7ab-4dd8-46e1-9b68-ed59ff673edd tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 400 len: 110 microversion: 2.1 time: 0.066090 Apr 11 19:27:11 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 126/379] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 11 19:27:11 2023] POST /compute/v2.1/servers => generated 110 bytes in 68 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 11 19:27:11 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [None req-77d7901d-b8e0-41ea-9930-071e225203ce tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] Calling method '>' {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:27:11 user devstack@n-api.service[72089]: DEBUG nova.compute.api [None req-77d7901d-b8e0-41ea-9930-071e225203ce tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] [instance: fc48e37f-8c00-4e48-bea3-f1c2e54d78b8] Fetching instance by UUID {{(pid=72089) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:27:11 user devstack@n-api.service[72089]: DEBUG dbcounter [-] [72089] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=3 {{(pid=72089) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:27:11 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-77d7901d-b8e0-41ea-9930-071e225203ce tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:27:11 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-77d7901d-b8e0-41ea-9930-071e225203ce tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:27:11 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-77d7901d-b8e0-41ea-9930-071e225203ce tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:27:11 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-77d7901d-b8e0-41ea-9930-071e225203ce tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:27:11 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-77d7901d-b8e0-41ea-9930-071e225203ce tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:27:11 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-77d7901d-b8e0-41ea-9930-071e225203ce tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:27:11 user devstack@n-api.service[72089]: DEBUG nova.policy [None req-77d7901d-b8e0-41ea-9930-071e225203ce tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f44dfa2528b4540a81f4eb7c3f3f2f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5d7769df1e4974b295cb30407151dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72089) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:27:11 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [None req-77d7901d-b8e0-41ea-9930-071e225203ce tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fc48e37f-8c00-4e48-bea3-f1c2e54d78b8" status: 200 len: 1494 microversion: 2.1 time: 0.143710 Apr 11 19:27:11 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 130/380] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 19:27:11 2023] GET /compute/v2.1/servers/fc48e37f-8c00-4e48-bea3-f1c2e54d78b8 => generated 1494 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:27:19 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [None req-37705614-fd1b-40c2-b99f-85de1f603de2 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ServerBootFromVolumeStableRescueTest-image-1812938857"}} {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:27:19 user devstack@n-api.service[72090]: DEBUG nova.compute.api [None req-37705614-fd1b-40c2-b99f-85de1f603de2 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] [instance: 9e2d23e8-2d2e-4b3e-94d8-01b17242dac5] Fetching instance by UUID {{(pid=72090) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:27:19 user devstack@n-api.service[72090]: DEBUG dbcounter [-] [72090] Writing DB stats nova_api:SELECT=17,nova_api:UPDATE=2 {{(pid=72090) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:27:19 user devstack@n-api.service[72090]: DEBUG dbcounter [-] [72090] Writing DB stats nova_cell1:SELECT=33,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=72090) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:27:19 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-37705614-fd1b-40c2-b99f-85de1f603de2 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:27:19 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-37705614-fd1b-40c2-b99f-85de1f603de2 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:27:19 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-37705614-fd1b-40c2-b99f-85de1f603de2 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:27:19 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-37705614-fd1b-40c2-b99f-85de1f603de2 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:27:19 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-37705614-fd1b-40c2-b99f-85de1f603de2 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:27:19 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-37705614-fd1b-40c2-b99f-85de1f603de2 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:27:20 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [None req-37705614-fd1b-40c2-b99f-85de1f603de2 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] 10.0.0.210 "POST /compute/v2.1/servers/9e2d23e8-2d2e-4b3e-94d8-01b17242dac5/action" status: 202 len: 52 microversion: 2.87 time: 0.764602 Apr 11 19:27:20 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 125/381] 10.0.0.210 () {66 vars in 1396 bytes} [Tue Apr 11 19:27:19 2023] POST /compute/v2.1/servers/9e2d23e8-2d2e-4b3e-94d8-01b17242dac5/action => generated 52 bytes in 766 msecs (HTTP/1.1 202) 9 headers in 364 bytes (1 switches on core 0) Apr 11 19:27:23 user devstack@n-api.service[72088]: DEBUG dbcounter [-] [72088] Writing DB stats nova_cell1:SELECT=13 {{(pid=72088) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:27:23 user devstack@n-api.service[72088]: DEBUG dbcounter [-] [72088] Writing DB stats nova_api:SELECT=7 {{(pid=72088) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:27:23 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [None req-9334da2c-d88c-4165-8165-95c195838957 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Calling method '>' {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:27:23 user devstack@n-api.service[72088]: DEBUG nova.compute.api [None req-9334da2c-d88c-4165-8165-95c195838957 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] [instance: bed4001c-02c2-4c6b-84c8-61654df66d8b] Fetching instance by UUID {{(pid=72088) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:27:23 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-9334da2c-d88c-4165-8165-95c195838957 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:27:23 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-9334da2c-d88c-4165-8165-95c195838957 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:27:23 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-9334da2c-d88c-4165-8165-95c195838957 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:27:23 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-9334da2c-d88c-4165-8165-95c195838957 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:27:23 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-9334da2c-d88c-4165-8165-95c195838957 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:27:23 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-9334da2c-d88c-4165-8165-95c195838957 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:27:23 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [None req-9334da2c-d88c-4165-8165-95c195838957 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bed4001c-02c2-4c6b-84c8-61654df66d8b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.170748 Apr 11 19:27:23 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 127/382] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Apr 11 19:27:23 2023] GET /compute/v2.1/servers/bed4001c-02c2-4c6b-84c8-61654df66d8b/os-volume_attachments => generated 25 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Apr 11 19:27:23 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [None req-5b5966a2-afa4-4f4d-9e85-d2605bbc962d tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Calling method '>' {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:27:23 user devstack@n-api.service[72089]: DEBUG nova.compute.api [None req-5b5966a2-afa4-4f4d-9e85-d2605bbc962d tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] [instance: bed4001c-02c2-4c6b-84c8-61654df66d8b] Fetching instance by UUID {{(pid=72089) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:27:23 user devstack@n-api.service[72089]: DEBUG dbcounter [-] [72089] Writing DB stats nova_api:SELECT=1 {{(pid=72089) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:27:23 user devstack@n-api.service[72089]: DEBUG dbcounter [-] [72089] Writing DB stats nova_cell1:SELECT=7 {{(pid=72089) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:27:23 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-5b5966a2-afa4-4f4d-9e85-d2605bbc962d tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:27:23 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-5b5966a2-afa4-4f4d-9e85-d2605bbc962d tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:27:23 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-5b5966a2-afa4-4f4d-9e85-d2605bbc962d tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:27:23 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-5b5966a2-afa4-4f4d-9e85-d2605bbc962d tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:27:23 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-5b5966a2-afa4-4f4d-9e85-d2605bbc962d tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:27:23 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-5b5966a2-afa4-4f4d-9e85-d2605bbc962d tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:27:23 user devstack@n-api.service[72089]: DEBUG nova.compute.api [None req-5b5966a2-afa4-4f4d-9e85-d2605bbc962d tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] [instance: bed4001c-02c2-4c6b-84c8-61654df66d8b] Going to try to terminate instance {{(pid=72089) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 11 19:27:23 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [None req-5b5966a2-afa4-4f4d-9e85-d2605bbc962d tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/bed4001c-02c2-4c6b-84c8-61654df66d8b" status: 204 len: 0 microversion: 2.1 time: 0.172025 Apr 11 19:27:23 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 131/383] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 19:27:23 2023] DELETE /compute/v2.1/servers/bed4001c-02c2-4c6b-84c8-61654df66d8b => generated 0 bytes in 174 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 11 19:27:23 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [None req-cb951c35-ae70-48ad-b3cd-d7939fa5854b tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Calling method '>' {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:27:23 user devstack@n-api.service[72090]: DEBUG nova.compute.api [None req-cb951c35-ae70-48ad-b3cd-d7939fa5854b tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] [instance: bed4001c-02c2-4c6b-84c8-61654df66d8b] Fetching instance by UUID {{(pid=72090) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:27:23 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-cb951c35-ae70-48ad-b3cd-d7939fa5854b tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:27:23 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-cb951c35-ae70-48ad-b3cd-d7939fa5854b tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:27:23 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-cb951c35-ae70-48ad-b3cd-d7939fa5854b tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:27:23 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-cb951c35-ae70-48ad-b3cd-d7939fa5854b tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:27:23 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-cb951c35-ae70-48ad-b3cd-d7939fa5854b tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:27:23 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-cb951c35-ae70-48ad-b3cd-d7939fa5854b tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:27:24 user devstack@n-api.service[72090]: DEBUG nova.policy [None req-cb951c35-ae70-48ad-b3cd-d7939fa5854b tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5d405421ceb4d99967ef2e7f55e7809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06966e2f4d3a4dec92282c7ad348635d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72090) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:27:24 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [None req-cb951c35-ae70-48ad-b3cd-d7939fa5854b tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bed4001c-02c2-4c6b-84c8-61654df66d8b" status: 200 len: 1670 microversion: 2.1 time: 0.207132 Apr 11 19:27:24 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 126/384] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 19:27:23 2023] GET /compute/v2.1/servers/bed4001c-02c2-4c6b-84c8-61654df66d8b => generated 1670 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:27:24 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [req-292fdef8-86aa-41ac-b842-98fff12a32fb req-b75682f5-36be-430d-a1a7-75fdca04232a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bed4001c-02c2-4c6b-84c8-61654df66d8b", "name": "network-vif-unplugged", "status": "completed", "tag": "b644e09b-afb0-43e7-9773-0df435010320"}]} {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:27:24 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-292fdef8-86aa-41ac-b842-98fff12a32fb req-b75682f5-36be-430d-a1a7-75fdca04232a service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:27:24 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-292fdef8-86aa-41ac-b842-98fff12a32fb req-b75682f5-36be-430d-a1a7-75fdca04232a service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:27:24 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-292fdef8-86aa-41ac-b842-98fff12a32fb req-b75682f5-36be-430d-a1a7-75fdca04232a service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:27:24 user devstack@n-api.service[72088]: INFO nova.api.openstack.compute.server_external_events [req-292fdef8-86aa-41ac-b842-98fff12a32fb req-b75682f5-36be-430d-a1a7-75fdca04232a service nova] Creating event network-vif-unplugged:b644e09b-afb0-43e7-9773-0df435010320 for instance bed4001c-02c2-4c6b-84c8-61654df66d8b on user Apr 11 19:27:24 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [req-292fdef8-86aa-41ac-b842-98fff12a32fb req-b75682f5-36be-430d-a1a7-75fdca04232a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.042658 Apr 11 19:27:24 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 128/385] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:27:24 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:27:25 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [None req-3be30e5a-2324-4a0c-9d9d-d6d4f70eaa7e tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Calling method '>' {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:27:25 user devstack@n-api.service[72089]: DEBUG nova.compute.api [None req-3be30e5a-2324-4a0c-9d9d-d6d4f70eaa7e tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] [instance: 720c683f-c03a-444c-92a8-daf97c9f524b] Fetching instance by UUID {{(pid=72089) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:27:25 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-3be30e5a-2324-4a0c-9d9d-d6d4f70eaa7e tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:27:25 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-3be30e5a-2324-4a0c-9d9d-d6d4f70eaa7e tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:27:25 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-3be30e5a-2324-4a0c-9d9d-d6d4f70eaa7e tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:27:25 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-3be30e5a-2324-4a0c-9d9d-d6d4f70eaa7e tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:27:25 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-3be30e5a-2324-4a0c-9d9d-d6d4f70eaa7e tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:27:25 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-3be30e5a-2324-4a0c-9d9d-d6d4f70eaa7e tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:27:25 user devstack@n-api.service[72089]: DEBUG nova.policy [None req-3be30e5a-2324-4a0c-9d9d-d6d4f70eaa7e tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0558ba5a2b04d36ba2f2411090cc4e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d8b189667e34931aa36149620a036e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72089) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:27:25 user devstack@n-api.service[72089]: DEBUG nova.policy [None req-3be30e5a-2324-4a0c-9d9d-d6d4f70eaa7e tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0558ba5a2b04d36ba2f2411090cc4e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d8b189667e34931aa36149620a036e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72089) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:27:25 user devstack@n-api.service[72089]: DEBUG nova.policy [None req-3be30e5a-2324-4a0c-9d9d-d6d4f70eaa7e tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0558ba5a2b04d36ba2f2411090cc4e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d8b189667e34931aa36149620a036e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72089) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:27:25 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [None req-3be30e5a-2324-4a0c-9d9d-d6d4f70eaa7e tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] 10.0.0.210 "GET /compute/v2.1/servers/720c683f-c03a-444c-92a8-daf97c9f524b" status: 200 len: 1585 microversion: 2.20 time: 0.169410 Apr 11 19:27:25 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 132/386] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 19:27:25 2023] GET /compute/v2.1/servers/720c683f-c03a-444c-92a8-daf97c9f524b => generated 1585 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 19:27:25 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [None req-f08eafb2-ae70-43b0-a59b-ce71e90abf4c tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Calling method '>' {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:27:25 user devstack@n-api.service[72090]: DEBUG nova.compute.api [None req-f08eafb2-ae70-43b0-a59b-ce71e90abf4c tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] [instance: 9e2d23e8-2d2e-4b3e-94d8-01b17242dac5] Fetching instance by UUID {{(pid=72090) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:27:25 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-f08eafb2-ae70-43b0-a59b-ce71e90abf4c tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:27:25 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-f08eafb2-ae70-43b0-a59b-ce71e90abf4c tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:27:25 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-f08eafb2-ae70-43b0-a59b-ce71e90abf4c tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:27:25 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-f08eafb2-ae70-43b0-a59b-ce71e90abf4c tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:27:25 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-f08eafb2-ae70-43b0-a59b-ce71e90abf4c tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:27:25 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-f08eafb2-ae70-43b0-a59b-ce71e90abf4c tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:27:25 user devstack@n-api.service[72090]: DEBUG nova.policy [None req-f08eafb2-ae70-43b0-a59b-ce71e90abf4c tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b3adca432b04d70818a51d1366f5c6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb91586feb3f4a4c84fa8c2183baaf8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72090) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:27:25 user devstack@n-api.service[72090]: DEBUG nova.policy [None req-f08eafb2-ae70-43b0-a59b-ce71e90abf4c tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b3adca432b04d70818a51d1366f5c6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb91586feb3f4a4c84fa8c2183baaf8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72090) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:27:25 user devstack@n-api.service[72090]: DEBUG nova.policy [None req-f08eafb2-ae70-43b0-a59b-ce71e90abf4c tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b3adca432b04d70818a51d1366f5c6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb91586feb3f4a4c84fa8c2183baaf8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72090) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:27:25 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [None req-f08eafb2-ae70-43b0-a59b-ce71e90abf4c tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9e2d23e8-2d2e-4b3e-94d8-01b17242dac5" status: 200 len: 1690 microversion: 2.87 time: 0.201164 Apr 11 19:27:25 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 127/387] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 19:27:25 2023] GET /compute/v2.1/servers/9e2d23e8-2d2e-4b3e-94d8-01b17242dac5 => generated 1690 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 19:27:25 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [req-98ad3e04-703f-4859-8d3a-5ebcca954411 req-2c5553ba-947c-4690-b156-830741c638a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bed4001c-02c2-4c6b-84c8-61654df66d8b", "name": "network-vif-deleted", "tag": "b644e09b-afb0-43e7-9773-0df435010320"}]} {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:27:25 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-98ad3e04-703f-4859-8d3a-5ebcca954411 req-2c5553ba-947c-4690-b156-830741c638a0 service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:27:25 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-98ad3e04-703f-4859-8d3a-5ebcca954411 req-2c5553ba-947c-4690-b156-830741c638a0 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:27:25 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-98ad3e04-703f-4859-8d3a-5ebcca954411 req-2c5553ba-947c-4690-b156-830741c638a0 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:27:25 user devstack@n-api.service[72088]: INFO nova.api.openstack.compute.server_external_events [req-98ad3e04-703f-4859-8d3a-5ebcca954411 req-2c5553ba-947c-4690-b156-830741c638a0 service nova] Creating event network-vif-deleted:b644e09b-afb0-43e7-9773-0df435010320 for instance bed4001c-02c2-4c6b-84c8-61654df66d8b on user Apr 11 19:27:25 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [req-98ad3e04-703f-4859-8d3a-5ebcca954411 req-2c5553ba-947c-4690-b156-830741c638a0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035525 Apr 11 19:27:25 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 129/388] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:27:25 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:27:26 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [req-662e57c7-789f-43d6-9b89-31df5ac8b2f9 req-1b920703-4165-4803-90d5-f2ba69178bd7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bed4001c-02c2-4c6b-84c8-61654df66d8b", "name": "network-vif-plugged", "status": "completed", "tag": "b644e09b-afb0-43e7-9773-0df435010320"}]} {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:27:26 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-662e57c7-789f-43d6-9b89-31df5ac8b2f9 req-1b920703-4165-4803-90d5-f2ba69178bd7 service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:27:26 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-662e57c7-789f-43d6-9b89-31df5ac8b2f9 req-1b920703-4165-4803-90d5-f2ba69178bd7 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:27:26 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-662e57c7-789f-43d6-9b89-31df5ac8b2f9 req-1b920703-4165-4803-90d5-f2ba69178bd7 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:27:26 user devstack@n-api.service[72089]: INFO nova.api.openstack.compute.server_external_events [req-662e57c7-789f-43d6-9b89-31df5ac8b2f9 req-1b920703-4165-4803-90d5-f2ba69178bd7 service nova] Creating event network-vif-plugged:b644e09b-afb0-43e7-9773-0df435010320 for instance bed4001c-02c2-4c6b-84c8-61654df66d8b on user Apr 11 19:27:26 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [req-662e57c7-789f-43d6-9b89-31df5ac8b2f9 req-1b920703-4165-4803-90d5-f2ba69178bd7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029748 Apr 11 19:27:26 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 133/389] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:27:26 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:27:35 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [None req-0ce44d55-c426-4dbc-a66b-f0acf9e1bd77 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:27:35 user devstack@n-api.service[72090]: DEBUG nova.compute.api [None req-0ce44d55-c426-4dbc-a66b-f0acf9e1bd77 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] [instance: aa0bb9aa-a93d-45bc-9f90-46eeb6416365] Fetching instance by UUID {{(pid=72090) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:27:35 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-0ce44d55-c426-4dbc-a66b-f0acf9e1bd77 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:27:35 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-0ce44d55-c426-4dbc-a66b-f0acf9e1bd77 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:27:35 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-0ce44d55-c426-4dbc-a66b-f0acf9e1bd77 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:27:35 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-0ce44d55-c426-4dbc-a66b-f0acf9e1bd77 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:27:35 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-0ce44d55-c426-4dbc-a66b-f0acf9e1bd77 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:27:35 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-0ce44d55-c426-4dbc-a66b-f0acf9e1bd77 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:27:35 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [None req-0ce44d55-c426-4dbc-a66b-f0acf9e1bd77 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] 10.0.0.210 "POST /compute/v2.1/servers/aa0bb9aa-a93d-45bc-9f90-46eeb6416365/action" status: 202 len: 0 microversion: 2.1 time: 0.199561 Apr 11 19:27:35 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 128/390] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Apr 11 19:27:34 2023] POST /compute/v2.1/servers/aa0bb9aa-a93d-45bc-9f90-46eeb6416365/action => generated 0 bytes in 202 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 19:27:35 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [None req-b28be38d-aab4-49a3-8e13-3b5fae09b90d tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] Calling method '>' {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:27:35 user devstack@n-api.service[72088]: DEBUG nova.compute.api [None req-b28be38d-aab4-49a3-8e13-3b5fae09b90d tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] [instance: aa0bb9aa-a93d-45bc-9f90-46eeb6416365] Fetching instance by UUID {{(pid=72088) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:27:35 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-b28be38d-aab4-49a3-8e13-3b5fae09b90d tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:27:35 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-b28be38d-aab4-49a3-8e13-3b5fae09b90d tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:27:35 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-b28be38d-aab4-49a3-8e13-3b5fae09b90d tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:27:35 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-b28be38d-aab4-49a3-8e13-3b5fae09b90d tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:27:35 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-b28be38d-aab4-49a3-8e13-3b5fae09b90d tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:27:35 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-b28be38d-aab4-49a3-8e13-3b5fae09b90d tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:27:35 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [None req-b28be38d-aab4-49a3-8e13-3b5fae09b90d tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] 10.0.0.210 "GET /compute/v2.1/servers/aa0bb9aa-a93d-45bc-9f90-46eeb6416365/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.203251 Apr 11 19:27:35 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 130/391] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Apr 11 19:27:35 2023] GET /compute/v2.1/servers/aa0bb9aa-a93d-45bc-9f90-46eeb6416365/os-interface => generated 282 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:27:36 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [req-5d835bf7-7305-4e11-9ed2-5a851bfb0904 req-27c57c7e-5b1c-4a4f-adf7-16a5ced449ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa0bb9aa-a93d-45bc-9f90-46eeb6416365", "name": "network-vif-unplugged", "status": "completed", "tag": "5a15e207-1839-4be5-80b2-fc995098dbbf"}]} {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:27:36 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-5d835bf7-7305-4e11-9ed2-5a851bfb0904 req-27c57c7e-5b1c-4a4f-adf7-16a5ced449ce service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:27:36 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-5d835bf7-7305-4e11-9ed2-5a851bfb0904 req-27c57c7e-5b1c-4a4f-adf7-16a5ced449ce service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:27:36 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-5d835bf7-7305-4e11-9ed2-5a851bfb0904 req-27c57c7e-5b1c-4a4f-adf7-16a5ced449ce service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:27:36 user devstack@n-api.service[72089]: INFO nova.api.openstack.compute.server_external_events [req-5d835bf7-7305-4e11-9ed2-5a851bfb0904 req-27c57c7e-5b1c-4a4f-adf7-16a5ced449ce service nova] Creating event network-vif-unplugged:5a15e207-1839-4be5-80b2-fc995098dbbf for instance aa0bb9aa-a93d-45bc-9f90-46eeb6416365 on user Apr 11 19:27:36 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [req-5d835bf7-7305-4e11-9ed2-5a851bfb0904 req-27c57c7e-5b1c-4a4f-adf7-16a5ced449ce service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.039101 Apr 11 19:27:36 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 134/392] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:27:36 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:27:36 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [req-dafb895a-542f-4370-a7a9-a3b12c6473a3 req-d061381d-c11e-4e30-86d4-58d2f0e05bae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aa0bb9aa-a93d-45bc-9f90-46eeb6416365", "tag": "5a15e207-1839-4be5-80b2-fc995098dbbf"}]} {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:27:36 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-dafb895a-542f-4370-a7a9-a3b12c6473a3 req-d061381d-c11e-4e30-86d4-58d2f0e05bae service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:27:36 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-dafb895a-542f-4370-a7a9-a3b12c6473a3 req-d061381d-c11e-4e30-86d4-58d2f0e05bae service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:27:36 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-dafb895a-542f-4370-a7a9-a3b12c6473a3 req-d061381d-c11e-4e30-86d4-58d2f0e05bae service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:27:36 user devstack@n-api.service[72090]: INFO nova.api.openstack.compute.server_external_events [req-dafb895a-542f-4370-a7a9-a3b12c6473a3 req-d061381d-c11e-4e30-86d4-58d2f0e05bae service nova] Creating event network-changed:5a15e207-1839-4be5-80b2-fc995098dbbf for instance aa0bb9aa-a93d-45bc-9f90-46eeb6416365 on user Apr 11 19:27:36 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [req-dafb895a-542f-4370-a7a9-a3b12c6473a3 req-d061381d-c11e-4e30-86d4-58d2f0e05bae service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105874 Apr 11 19:27:36 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 129/393] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:27:36 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:27:38 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [None req-848e26fa-75f1-44a7-aab7-2b7c8f1a346e tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Calling method '>' {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:27:38 user devstack@n-api.service[72088]: DEBUG nova.compute.api [None req-848e26fa-75f1-44a7-aab7-2b7c8f1a346e tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] [instance: 6802f099-9236-4c79-a892-2963f1b15b0e] Fetching instance by UUID {{(pid=72088) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:27:38 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-848e26fa-75f1-44a7-aab7-2b7c8f1a346e tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:27:38 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-848e26fa-75f1-44a7-aab7-2b7c8f1a346e tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:27:38 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-848e26fa-75f1-44a7-aab7-2b7c8f1a346e tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:27:38 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-848e26fa-75f1-44a7-aab7-2b7c8f1a346e tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:27:38 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-848e26fa-75f1-44a7-aab7-2b7c8f1a346e tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:27:38 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-848e26fa-75f1-44a7-aab7-2b7c8f1a346e tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:27:38 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [req-3d081d79-5197-4f1b-9b6a-2af5f73addcc req-cff2c0fa-f3db-443c-b681-8fe62b4c82a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa0bb9aa-a93d-45bc-9f90-46eeb6416365", "name": "network-vif-plugged", "status": "completed", "tag": "5a15e207-1839-4be5-80b2-fc995098dbbf"}, {"server_uuid": "aa0bb9aa-a93d-45bc-9f90-46eeb6416365", "name": "network-vif-plugged", "status": "completed", "tag": "5a15e207-1839-4be5-80b2-fc995098dbbf"}]} {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:27:38 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-3d081d79-5197-4f1b-9b6a-2af5f73addcc req-cff2c0fa-f3db-443c-b681-8fe62b4c82a1 service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:27:38 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-3d081d79-5197-4f1b-9b6a-2af5f73addcc req-cff2c0fa-f3db-443c-b681-8fe62b4c82a1 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:27:38 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-3d081d79-5197-4f1b-9b6a-2af5f73addcc req-cff2c0fa-f3db-443c-b681-8fe62b4c82a1 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:27:38 user devstack@n-api.service[72089]: INFO nova.api.openstack.compute.server_external_events [req-3d081d79-5197-4f1b-9b6a-2af5f73addcc req-cff2c0fa-f3db-443c-b681-8fe62b4c82a1 service nova] Creating event network-vif-plugged:5a15e207-1839-4be5-80b2-fc995098dbbf for instance aa0bb9aa-a93d-45bc-9f90-46eeb6416365 on user Apr 11 19:27:38 user devstack@n-api.service[72089]: INFO nova.api.openstack.compute.server_external_events [req-3d081d79-5197-4f1b-9b6a-2af5f73addcc req-cff2c0fa-f3db-443c-b681-8fe62b4c82a1 service nova] Creating event network-vif-plugged:5a15e207-1839-4be5-80b2-fc995098dbbf for instance aa0bb9aa-a93d-45bc-9f90-46eeb6416365 on user Apr 11 19:27:38 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [req-3d081d79-5197-4f1b-9b6a-2af5f73addcc req-cff2c0fa-f3db-443c-b681-8fe62b4c82a1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.032410 Apr 11 19:27:38 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 135/394] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:27:38 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:27:38 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [req-543751fc-8e13-4b87-bc0c-bdd7e90d09a3 req-2dcabc12-9e88-4412-b31d-9e132838a108 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aa0bb9aa-a93d-45bc-9f90-46eeb6416365", "tag": "5a15e207-1839-4be5-80b2-fc995098dbbf"}]} {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:27:38 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-543751fc-8e13-4b87-bc0c-bdd7e90d09a3 req-2dcabc12-9e88-4412-b31d-9e132838a108 service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:27:38 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-543751fc-8e13-4b87-bc0c-bdd7e90d09a3 req-2dcabc12-9e88-4412-b31d-9e132838a108 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:27:38 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-543751fc-8e13-4b87-bc0c-bdd7e90d09a3 req-2dcabc12-9e88-4412-b31d-9e132838a108 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:27:38 user devstack@n-api.service[72090]: INFO nova.api.openstack.compute.server_external_events [req-543751fc-8e13-4b87-bc0c-bdd7e90d09a3 req-2dcabc12-9e88-4412-b31d-9e132838a108 service nova] Creating event network-changed:5a15e207-1839-4be5-80b2-fc995098dbbf for instance aa0bb9aa-a93d-45bc-9f90-46eeb6416365 on user Apr 11 19:27:38 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [req-543751fc-8e13-4b87-bc0c-bdd7e90d09a3 req-2dcabc12-9e88-4412-b31d-9e132838a108 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034800 Apr 11 19:27:38 user devstack@n-api.service[72088]: DEBUG nova.policy [None req-848e26fa-75f1-44a7-aab7-2b7c8f1a346e tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31c237e142784bd6aa460d6f1bf33400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd886d2ec5fc946b49af3c8ca7c8556c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72088) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:27:38 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 130/395] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:27:38 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:27:38 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [None req-848e26fa-75f1-44a7-aab7-2b7c8f1a346e tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6802f099-9236-4c79-a892-2963f1b15b0e" status: 200 len: 1690 microversion: 2.1 time: 0.220994 Apr 11 19:27:38 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 131/396] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 19:27:38 2023] GET /compute/v2.1/servers/6802f099-9236-4c79-a892-2963f1b15b0e => generated 1690 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:27:40 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [req-309a51c0-77af-485f-9f08-97b169757f5e req-ec78f223-bbe5-41c7-9e62-e9f59d54bd1e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa0bb9aa-a93d-45bc-9f90-46eeb6416365", "name": "network-vif-plugged", "status": "completed", "tag": "5a15e207-1839-4be5-80b2-fc995098dbbf"}]} {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:27:40 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-309a51c0-77af-485f-9f08-97b169757f5e req-ec78f223-bbe5-41c7-9e62-e9f59d54bd1e service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:27:40 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-309a51c0-77af-485f-9f08-97b169757f5e req-ec78f223-bbe5-41c7-9e62-e9f59d54bd1e service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:27:40 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-309a51c0-77af-485f-9f08-97b169757f5e req-ec78f223-bbe5-41c7-9e62-e9f59d54bd1e service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:27:40 user devstack@n-api.service[72089]: INFO nova.api.openstack.compute.server_external_events [req-309a51c0-77af-485f-9f08-97b169757f5e req-ec78f223-bbe5-41c7-9e62-e9f59d54bd1e service nova] Creating event network-vif-plugged:5a15e207-1839-4be5-80b2-fc995098dbbf for instance aa0bb9aa-a93d-45bc-9f90-46eeb6416365 on user Apr 11 19:27:40 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [req-309a51c0-77af-485f-9f08-97b169757f5e req-ec78f223-bbe5-41c7-9e62-e9f59d54bd1e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036939 Apr 11 19:27:40 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 136/397] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:27:40 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:27:41 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [None req-6ca05161-775e-4383-b521-7b8f31512281 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Calling method '>' {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:27:41 user devstack@n-api.service[72090]: DEBUG nova.compute.api [None req-6ca05161-775e-4383-b521-7b8f31512281 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] [instance: 647674d8-af53-405a-8116-4b7a01549bdf] Fetching instance by UUID {{(pid=72090) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:27:41 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-6ca05161-775e-4383-b521-7b8f31512281 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:27:41 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-6ca05161-775e-4383-b521-7b8f31512281 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:27:41 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-6ca05161-775e-4383-b521-7b8f31512281 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:27:41 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-6ca05161-775e-4383-b521-7b8f31512281 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:27:41 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-6ca05161-775e-4383-b521-7b8f31512281 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:27:41 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-6ca05161-775e-4383-b521-7b8f31512281 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:27:41 user devstack@n-api.service[72090]: DEBUG nova.policy [None req-6ca05161-775e-4383-b521-7b8f31512281 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05fb551c320a48f98a4ec00a7f7492d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60a7381a31b84e97a068528f90813773', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72090) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:27:41 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [None req-6ca05161-775e-4383-b521-7b8f31512281 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] 10.0.0.210 "GET /compute/v2.1/servers/647674d8-af53-405a-8116-4b7a01549bdf" status: 200 len: 1538 microversion: 2.1 time: 0.170869 Apr 11 19:27:41 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 131/398] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 19:27:41 2023] GET /compute/v2.1/servers/647674d8-af53-405a-8116-4b7a01549bdf => generated 1538 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:27:45 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [None req-ea6aba85-ba42-4b1f-87e7-9cdcef5a5b8c tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Calling method '>' {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:27:45 user devstack@n-api.service[72088]: DEBUG nova.compute.api [None req-ea6aba85-ba42-4b1f-87e7-9cdcef5a5b8c tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] [instance: f37ed08c-8c9a-4af7-ba5f-b8a942e54389] Fetching instance by UUID {{(pid=72088) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:27:45 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-ea6aba85-ba42-4b1f-87e7-9cdcef5a5b8c tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:27:45 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-ea6aba85-ba42-4b1f-87e7-9cdcef5a5b8c tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:27:45 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-ea6aba85-ba42-4b1f-87e7-9cdcef5a5b8c tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:27:45 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-ea6aba85-ba42-4b1f-87e7-9cdcef5a5b8c tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:27:45 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-ea6aba85-ba42-4b1f-87e7-9cdcef5a5b8c tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:27:45 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-ea6aba85-ba42-4b1f-87e7-9cdcef5a5b8c tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:27:45 user devstack@n-api.service[72088]: DEBUG nova.policy [None req-ea6aba85-ba42-4b1f-87e7-9cdcef5a5b8c tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a32a5d0547141a180f655e98567ed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bceca6e3506e43f68f9cf8d0b56d141b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72088) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:27:45 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [None req-ea6aba85-ba42-4b1f-87e7-9cdcef5a5b8c tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f37ed08c-8c9a-4af7-ba5f-b8a942e54389" status: 200 len: 1537 microversion: 2.1 time: 0.252004 Apr 11 19:27:45 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 132/399] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 19:27:45 2023] GET /compute/v2.1/servers/f37ed08c-8c9a-4af7-ba5f-b8a942e54389 => generated 1537 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:27:47 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [req-95c1da2e-8573-414b-a7a5-7af30c19eaf7 req-68ea6365-7d64-461a-bfb9-ef4922ea7579 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f37ed08c-8c9a-4af7-ba5f-b8a942e54389", "tag": "77bd0f58-75d0-4cc3-ab98-4f4b31401482"}]} {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:27:47 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-95c1da2e-8573-414b-a7a5-7af30c19eaf7 req-68ea6365-7d64-461a-bfb9-ef4922ea7579 service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:27:47 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-95c1da2e-8573-414b-a7a5-7af30c19eaf7 req-68ea6365-7d64-461a-bfb9-ef4922ea7579 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:27:47 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-95c1da2e-8573-414b-a7a5-7af30c19eaf7 req-68ea6365-7d64-461a-bfb9-ef4922ea7579 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:27:47 user devstack@n-api.service[72089]: INFO nova.api.openstack.compute.server_external_events [req-95c1da2e-8573-414b-a7a5-7af30c19eaf7 req-68ea6365-7d64-461a-bfb9-ef4922ea7579 service nova] Creating event network-changed:77bd0f58-75d0-4cc3-ab98-4f4b31401482 for instance f37ed08c-8c9a-4af7-ba5f-b8a942e54389 on user Apr 11 19:27:47 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [req-95c1da2e-8573-414b-a7a5-7af30c19eaf7 req-68ea6365-7d64-461a-bfb9-ef4922ea7579 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039699 Apr 11 19:27:47 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 137/400] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:27:47 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:27:47 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [None req-838ebb3c-83f9-4818-bdb0-4764d11e2a5f tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a8c38948-98ba-4df2-9662-251d3da4b5d7"}} {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:27:47 user devstack@n-api.service[72090]: DEBUG nova.compute.api [None req-838ebb3c-83f9-4818-bdb0-4764d11e2a5f tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] [instance: f37ed08c-8c9a-4af7-ba5f-b8a942e54389] Fetching instance by UUID {{(pid=72090) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:27:47 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-838ebb3c-83f9-4818-bdb0-4764d11e2a5f tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:27:47 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-838ebb3c-83f9-4818-bdb0-4764d11e2a5f tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:27:47 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-838ebb3c-83f9-4818-bdb0-4764d11e2a5f tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:27:47 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-838ebb3c-83f9-4818-bdb0-4764d11e2a5f tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:27:47 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-838ebb3c-83f9-4818-bdb0-4764d11e2a5f tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:27:47 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-838ebb3c-83f9-4818-bdb0-4764d11e2a5f tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:27:47 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [None req-77a58f41-9d55-4de0-b1a1-c9761c4aa1e2 tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] Calling method '>' {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:27:47 user devstack@n-api.service[72088]: DEBUG nova.compute.api [None req-77a58f41-9d55-4de0-b1a1-c9761c4aa1e2 tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] [instance: ac961841-1fc4-4cec-89bd-8f932270441a] Fetching instance by UUID {{(pid=72088) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:27:47 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-77a58f41-9d55-4de0-b1a1-c9761c4aa1e2 tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:27:47 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-77a58f41-9d55-4de0-b1a1-c9761c4aa1e2 tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:27:47 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-77a58f41-9d55-4de0-b1a1-c9761c4aa1e2 tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:27:47 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-77a58f41-9d55-4de0-b1a1-c9761c4aa1e2 tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:27:47 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-77a58f41-9d55-4de0-b1a1-c9761c4aa1e2 tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:27:47 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-77a58f41-9d55-4de0-b1a1-c9761c4aa1e2 tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:27:47 user devstack@n-api.service[72088]: INFO nova.api.openstack.wsgi [None req-77a58f41-9d55-4de0-b1a1-c9761c4aa1e2 tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] HTTP exception thrown: Instance ac961841-1fc4-4cec-89bd-8f932270441a could not be found. Apr 11 19:27:47 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [None req-77a58f41-9d55-4de0-b1a1-c9761c4aa1e2 tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] Request method failure captured: Apr 11 19:27:47 user devstack@n-api.service[72088]: request: GET /compute/v2.1/servers/ac961841-1fc4-4cec-89bd-8f932270441a HTTP/1.1 Apr 11 19:27:47 user devstack@n-api.service[72088]: Accept: application/json Apr 11 19:27:47 user devstack@n-api.service[72088]: Accept-Encoding: identity Apr 11 19:27:47 user devstack@n-api.service[72088]: Connection: close Apr 11 19:27:47 user devstack@n-api.service[72088]: Content-Length: 0 Apr 11 19:27:47 user devstack@n-api.service[72088]: Content-Type: application/json Apr 11 19:27:47 user devstack@n-api.service[72088]: Host: 10.0.0.210 Apr 11 19:27:47 user devstack@n-api.service[72088]: Openstack-System-Scope: None Apr 11 19:27:47 user devstack@n-api.service[72088]: User-Agent: python-urllib3/1.26.15 Apr 11 19:27:47 user devstack@n-api.service[72088]: X-Auth-Token: gAAAAABkNbNssWeW5lBXgEzyBx-Vjb8Ttkfyn1j_WiXhLp2AkyHxAuIaz9lQtAEypBexf7LpEidcAOU79EqZjAkQHeP9iLR0rXVFmB6W9Q_s1Ek9r7UHOto1ZteB50mRtwpnUHelyUMzQcbH-Giz5k67LiMRuL9CkxuW6muRa5gAv_3CiHsBdJI Apr 11 19:27:47 user devstack@n-api.service[72088]: X-Domain-Id: None Apr 11 19:27:47 user devstack@n-api.service[72088]: X-Domain-Name: None Apr 11 19:27:47 user devstack@n-api.service[72088]: X-Identity-Status: Confirmed Apr 11 19:27:47 user devstack@n-api.service[72088]: X-Is-Admin-Project: True Apr 11 19:27:47 user devstack@n-api.service[72088]: X-Project-Domain-Id: default Apr 11 19:27:47 user devstack@n-api.service[72088]: X-Project-Domain-Name: Default Apr 11 19:27:47 user devstack@n-api.service[72088]: X-Project-Id: 7543456a70d04d7f8c50f37e64b7ee9c Apr 11 19:27:47 user devstack@n-api.service[72088]: X-Project-Name: tempest-VolumesActionsTest-2124197416 Apr 11 19:27:47 user devstack@n-api.service[72088]: X-Role: reader,member Apr 11 19:27:47 user devstack@n-api.service[72088]: X-Roles: reader,member Apr 11 19:27:47 user devstack@n-api.service[72088]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/7543456a70d04d7f8c50f37e64b7ee9c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/7543456a70d04d7f8c50f37e64b7ee9c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/7543456a70d04d7f8c50f37e64b7ee9c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 11 19:27:47 user devstack@n-api.service[72088]: X-Tenant: tempest-VolumesActionsTest-2124197416 Apr 11 19:27:47 user devstack@n-api.service[72088]: X-Tenant-Id: 7543456a70d04d7f8c50f37e64b7ee9c Apr 11 19:27:47 user devstack@n-api.service[72088]: X-Tenant-Name: tempest-VolumesActionsTest-2124197416 Apr 11 19:27:47 user devstack@n-api.service[72088]: X-User: tempest-VolumesActionsTest-2124197416-project-member Apr 11 19:27:47 user devstack@n-api.service[72088]: X-User-Domain-Id: default Apr 11 19:27:47 user devstack@n-api.service[72088]: X-User-Domain-Name: Default Apr 11 19:27:47 user devstack@n-api.service[72088]: X-User-Id: 7c9641ceb17e4914b1cdf061c5bdc79f Apr 11 19:27:47 user devstack@n-api.service[72088]: X-User-Name: tempest-VolumesActionsTest-2124197416-project-member Apr 11 19:27:47 user devstack@n-api.service[72088]: method: > Apr 11 19:27:47 user devstack@n-api.service[72088]: exception: Instance ac961841-1fc4-4cec-89bd-8f932270441a could not be found. Apr 11 19:27:47 user devstack@n-api.service[72088]: action_args: {'id': 'ac961841-1fc4-4cec-89bd-8f932270441a'} Apr 11 19:27:47 user devstack@n-api.service[72088]: {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 19:27:47 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:27:47 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 19:27:47 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 19:27:47 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 19:27:47 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 19:27:47 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 19:27:47 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 19:27:47 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 19:27:47 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 19:27:47 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ac961841-1fc4-4cec-89bd-8f932270441a could not be found. Apr 11 19:27:47 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi Apr 11 19:27:47 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 19:27:47 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi Apr 11 19:27:47 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:27:47 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 19:27:47 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 19:27:47 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 19:27:47 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 19:27:47 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 19:27:47 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 19:27:47 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 19:27:47 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 19:27:47 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 19:27:47 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 19:27:47 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 19:27:47 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 19:27:47 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ac961841-1fc4-4cec-89bd-8f932270441a could not be found. Apr 11 19:27:47 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi Apr 11 19:27:47 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 19:27:47 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi Apr 11 19:27:47 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:27:47 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 19:27:47 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 19:27:47 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 19:27:47 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 19:27:47 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ac961841-1fc4-4cec-89bd-8f932270441a could not be found. Apr 11 19:27:47 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi Apr 11 19:27:47 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [None req-77a58f41-9d55-4de0-b1a1-c9761c4aa1e2 tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] Returning 404 to user: Instance ac961841-1fc4-4cec-89bd-8f932270441a could not be found. {{(pid=72088) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 19:27:47 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [None req-77a58f41-9d55-4de0-b1a1-c9761c4aa1e2 tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ac961841-1fc4-4cec-89bd-8f932270441a" status: 404 len: 111 microversion: 2.1 time: 0.141362 Apr 11 19:27:47 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 133/401] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 19:27:47 2023] GET /compute/v2.1/servers/ac961841-1fc4-4cec-89bd-8f932270441a => generated 111 bytes in 142 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 19:27:47 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [None req-838ebb3c-83f9-4818-bdb0-4764d11e2a5f tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] 10.0.0.210 "POST /compute/v2.1/servers/f37ed08c-8c9a-4af7-ba5f-b8a942e54389/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.309663 Apr 11 19:27:47 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 132/402] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Apr 11 19:27:47 2023] POST /compute/v2.1/servers/f37ed08c-8c9a-4af7-ba5f-b8a942e54389/os-volume_attachments => generated 194 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:27:52 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [None req-92b1db87-7e77-4034-929f-d5d6f26a2a1e tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] Calling method '>' {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:27:52 user devstack@n-api.service[72089]: DEBUG nova.compute.api [None req-92b1db87-7e77-4034-929f-d5d6f26a2a1e tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] [instance: 083108da-0a96-4177-8866-66131d77c39b] Fetching instance by UUID {{(pid=72089) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:27:52 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-92b1db87-7e77-4034-929f-d5d6f26a2a1e tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:27:52 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-92b1db87-7e77-4034-929f-d5d6f26a2a1e tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:27:52 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-92b1db87-7e77-4034-929f-d5d6f26a2a1e tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:27:52 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-92b1db87-7e77-4034-929f-d5d6f26a2a1e tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:27:52 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-92b1db87-7e77-4034-929f-d5d6f26a2a1e tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:27:52 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-92b1db87-7e77-4034-929f-d5d6f26a2a1e tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:27:52 user devstack@n-api.service[72089]: INFO nova.api.openstack.wsgi [None req-92b1db87-7e77-4034-929f-d5d6f26a2a1e tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] HTTP exception thrown: Instance 083108da-0a96-4177-8866-66131d77c39b could not be found. Apr 11 19:27:52 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [None req-92b1db87-7e77-4034-929f-d5d6f26a2a1e tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] Request method failure captured: Apr 11 19:27:52 user devstack@n-api.service[72089]: request: GET /compute/v2.1/servers/083108da-0a96-4177-8866-66131d77c39b HTTP/1.1 Apr 11 19:27:52 user devstack@n-api.service[72089]: Accept: application/json Apr 11 19:27:52 user devstack@n-api.service[72089]: Accept-Encoding: identity Apr 11 19:27:52 user devstack@n-api.service[72089]: Connection: close Apr 11 19:27:52 user devstack@n-api.service[72089]: Content-Length: 0 Apr 11 19:27:52 user devstack@n-api.service[72089]: Content-Type: application/json Apr 11 19:27:52 user devstack@n-api.service[72089]: Host: 10.0.0.210 Apr 11 19:27:52 user devstack@n-api.service[72089]: Openstack-System-Scope: None Apr 11 19:27:52 user devstack@n-api.service[72089]: User-Agent: python-urllib3/1.26.15 Apr 11 19:27:52 user devstack@n-api.service[72089]: X-Auth-Token: gAAAAABkNbNIE1hvjNylQegbrNw45pSfdo-34pgb_xwbAMt6-K8u7ip8VALOzQp-LTfmOsIxGEXav7XpdztLmMLa-gLQ1EJabTxBdl4KqGNKMlGTJ7qj666StYT9PeGkP7m_OvL1IyzQJofX8M44yuPP0JiV8yRZFlbzZEL6xekDsrvkTouUXPo Apr 11 19:27:52 user devstack@n-api.service[72089]: X-Domain-Id: None Apr 11 19:27:52 user devstack@n-api.service[72089]: X-Domain-Name: None Apr 11 19:27:52 user devstack@n-api.service[72089]: X-Identity-Status: Confirmed Apr 11 19:27:52 user devstack@n-api.service[72089]: X-Is-Admin-Project: True Apr 11 19:27:52 user devstack@n-api.service[72089]: X-Project-Domain-Id: default Apr 11 19:27:52 user devstack@n-api.service[72089]: X-Project-Domain-Name: Default Apr 11 19:27:52 user devstack@n-api.service[72089]: X-Project-Id: f153e6b272924b8fa0ef28fb5f0970bb Apr 11 19:27:52 user devstack@n-api.service[72089]: X-Project-Name: tempest-VolumesAdminNegativeTest-1308264816 Apr 11 19:27:52 user devstack@n-api.service[72089]: X-Role: reader,member Apr 11 19:27:52 user devstack@n-api.service[72089]: X-Roles: reader,member Apr 11 19:27:52 user devstack@n-api.service[72089]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f153e6b272924b8fa0ef28fb5f0970bb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/f153e6b272924b8fa0ef28fb5f0970bb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f153e6b272924b8fa0ef28fb5f0970bb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 11 19:27:52 user devstack@n-api.service[72089]: X-Tenant: tempest-VolumesAdminNegativeTest-1308264816 Apr 11 19:27:52 user devstack@n-api.service[72089]: X-Tenant-Id: f153e6b272924b8fa0ef28fb5f0970bb Apr 11 19:27:52 user devstack@n-api.service[72089]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1308264816 Apr 11 19:27:52 user devstack@n-api.service[72089]: X-User: tempest-VolumesAdminNegativeTest-1308264816-project-member Apr 11 19:27:52 user devstack@n-api.service[72089]: X-User-Domain-Id: default Apr 11 19:27:52 user devstack@n-api.service[72089]: X-User-Domain-Name: Default Apr 11 19:27:52 user devstack@n-api.service[72089]: X-User-Id: 54b4a383f04d4269a0099a738e14807e Apr 11 19:27:52 user devstack@n-api.service[72089]: X-User-Name: tempest-VolumesAdminNegativeTest-1308264816-project-member Apr 11 19:27:52 user devstack@n-api.service[72089]: method: > Apr 11 19:27:52 user devstack@n-api.service[72089]: exception: Instance 083108da-0a96-4177-8866-66131d77c39b could not be found. Apr 11 19:27:52 user devstack@n-api.service[72089]: action_args: {'id': '083108da-0a96-4177-8866-66131d77c39b'} Apr 11 19:27:52 user devstack@n-api.service[72089]: {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 19:27:52 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:27:52 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 19:27:52 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 19:27:52 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 19:27:52 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 19:27:52 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 19:27:52 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 19:27:52 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 19:27:52 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 19:27:52 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 083108da-0a96-4177-8866-66131d77c39b could not be found. Apr 11 19:27:52 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi Apr 11 19:27:52 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 19:27:52 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi Apr 11 19:27:52 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:27:52 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 19:27:52 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 19:27:52 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 19:27:52 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 19:27:52 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 19:27:52 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 19:27:52 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 19:27:52 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 19:27:52 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 19:27:52 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 19:27:52 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 19:27:52 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 19:27:52 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 083108da-0a96-4177-8866-66131d77c39b could not be found. Apr 11 19:27:52 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi Apr 11 19:27:52 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 19:27:52 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi Apr 11 19:27:52 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:27:52 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 19:27:52 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 19:27:52 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 19:27:52 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 19:27:52 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 083108da-0a96-4177-8866-66131d77c39b could not be found. Apr 11 19:27:52 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi Apr 11 19:27:52 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [None req-92b1db87-7e77-4034-929f-d5d6f26a2a1e tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] Returning 404 to user: Instance 083108da-0a96-4177-8866-66131d77c39b could not be found. {{(pid=72089) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 19:27:52 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [None req-92b1db87-7e77-4034-929f-d5d6f26a2a1e tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] 10.0.0.210 "GET /compute/v2.1/servers/083108da-0a96-4177-8866-66131d77c39b" status: 404 len: 111 microversion: 2.1 time: 0.145839 Apr 11 19:27:52 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 138/403] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 19:27:52 2023] GET /compute/v2.1/servers/083108da-0a96-4177-8866-66131d77c39b => generated 111 bytes in 148 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 19:27:54 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [None req-dd8fe315-9f88-4e98-b980-9ed045be584c tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] Calling method '>' {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:27:54 user devstack@n-api.service[72088]: DEBUG nova.compute.api [None req-dd8fe315-9f88-4e98-b980-9ed045be584c tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] [instance: 9941d033-15c2-4069-b9a6-f80840e95a38] Fetching instance by UUID {{(pid=72088) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:27:54 user devstack@n-api.service[72088]: DEBUG dbcounter [-] [72088] Writing DB stats nova_api:SELECT=15 {{(pid=72088) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:27:54 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-dd8fe315-9f88-4e98-b980-9ed045be584c tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:27:54 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-dd8fe315-9f88-4e98-b980-9ed045be584c tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:27:54 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-dd8fe315-9f88-4e98-b980-9ed045be584c tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:27:54 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-dd8fe315-9f88-4e98-b980-9ed045be584c tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:27:54 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-dd8fe315-9f88-4e98-b980-9ed045be584c tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:27:54 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-dd8fe315-9f88-4e98-b980-9ed045be584c tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:27:54 user devstack@n-api.service[72088]: DEBUG dbcounter [-] [72088] Writing DB stats nova_cell1:SELECT=29 {{(pid=72088) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:27:54 user devstack@n-api.service[72088]: DEBUG nova.compute.api [None req-dd8fe315-9f88-4e98-b980-9ed045be584c tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] [instance: 9941d033-15c2-4069-b9a6-f80840e95a38] Going to try to terminate instance {{(pid=72088) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 11 19:27:54 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [None req-dd8fe315-9f88-4e98-b980-9ed045be584c tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/9941d033-15c2-4069-b9a6-f80840e95a38" status: 204 len: 0 microversion: 2.1 time: 0.158327 Apr 11 19:27:54 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 134/404] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 19:27:53 2023] DELETE /compute/v2.1/servers/9941d033-15c2-4069-b9a6-f80840e95a38 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 11 19:27:54 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [None req-949a8e4b-7577-4666-90f4-a022b119e196 tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] Calling method '>' {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:27:54 user devstack@n-api.service[72090]: DEBUG nova.compute.api [None req-949a8e4b-7577-4666-90f4-a022b119e196 tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] [instance: 9941d033-15c2-4069-b9a6-f80840e95a38] Fetching instance by UUID {{(pid=72090) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:27:54 user devstack@n-api.service[72090]: DEBUG dbcounter [-] [72090] Writing DB stats nova_api:SELECT=19 {{(pid=72090) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:27:54 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-949a8e4b-7577-4666-90f4-a022b119e196 tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:27:54 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-949a8e4b-7577-4666-90f4-a022b119e196 tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:27:54 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-949a8e4b-7577-4666-90f4-a022b119e196 tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:27:54 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-949a8e4b-7577-4666-90f4-a022b119e196 tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:27:54 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-949a8e4b-7577-4666-90f4-a022b119e196 tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:27:54 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-949a8e4b-7577-4666-90f4-a022b119e196 tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:27:54 user devstack@n-api.service[72090]: DEBUG dbcounter [-] [72090] Writing DB stats nova_cell1:SELECT=57,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=72090) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:27:54 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [None req-ca03b349-3443-4041-b108-6a738641c832 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] Calling method '>' {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:27:54 user devstack@n-api.service[72089]: DEBUG nova.compute.api [None req-ca03b349-3443-4041-b108-6a738641c832 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] [instance: aa0bb9aa-a93d-45bc-9f90-46eeb6416365] Fetching instance by UUID {{(pid=72089) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:27:54 user devstack@n-api.service[72089]: DEBUG dbcounter [-] [72089] Writing DB stats nova_api:SELECT=22,nova_api:UPDATE=1 {{(pid=72089) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:27:54 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-ca03b349-3443-4041-b108-6a738641c832 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:27:54 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-ca03b349-3443-4041-b108-6a738641c832 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:27:54 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-ca03b349-3443-4041-b108-6a738641c832 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:27:54 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-ca03b349-3443-4041-b108-6a738641c832 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:27:54 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-ca03b349-3443-4041-b108-6a738641c832 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:27:54 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-ca03b349-3443-4041-b108-6a738641c832 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:27:54 user devstack@n-api.service[72089]: DEBUG dbcounter [-] [72089] Writing DB stats nova_cell1:SELECT=34,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=72089) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:27:54 user devstack@n-api.service[72090]: DEBUG nova.policy [None req-949a8e4b-7577-4666-90f4-a022b119e196 tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b4a383f04d4269a0099a738e14807e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f153e6b272924b8fa0ef28fb5f0970bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72090) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:27:54 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [None req-949a8e4b-7577-4666-90f4-a022b119e196 tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9941d033-15c2-4069-b9a6-f80840e95a38" status: 200 len: 1667 microversion: 2.1 time: 0.215280 Apr 11 19:27:54 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 133/405] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 19:27:54 2023] GET /compute/v2.1/servers/9941d033-15c2-4069-b9a6-f80840e95a38 => generated 1667 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:27:54 user devstack@n-api.service[72089]: DEBUG nova.objects.instance [None req-ca03b349-3443-4041-b108-6a738641c832 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] Lazy-loading 'services' on Instance uuid aa0bb9aa-a93d-45bc-9f90-46eeb6416365 {{(pid=72089) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 11 19:27:54 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [req-6dce3ff4-a470-49fd-8934-64a34f845ab5 req-efefed41-ea96-46a4-b350-8c1bd424b414 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9941d033-15c2-4069-b9a6-f80840e95a38", "name": "network-vif-unplugged", "status": "completed", "tag": "031df3cc-5433-459d-ab9b-484629289e90"}]} {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:27:54 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-6dce3ff4-a470-49fd-8934-64a34f845ab5 req-efefed41-ea96-46a4-b350-8c1bd424b414 service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:27:54 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-6dce3ff4-a470-49fd-8934-64a34f845ab5 req-efefed41-ea96-46a4-b350-8c1bd424b414 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:27:54 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-6dce3ff4-a470-49fd-8934-64a34f845ab5 req-efefed41-ea96-46a4-b350-8c1bd424b414 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:27:54 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [None req-ca03b349-3443-4041-b108-6a738641c832 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/aa0bb9aa-a93d-45bc-9f90-46eeb6416365/os-volume_attachments/f2d4810b-a6fe-4903-813a-a0562018f061" status: 202 len: 0 microversion: 2.1 time: 0.203903 Apr 11 19:27:54 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 139/406] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Apr 11 19:27:54 2023] DELETE /compute/v2.1/servers/aa0bb9aa-a93d-45bc-9f90-46eeb6416365/os-volume_attachments/f2d4810b-a6fe-4903-813a-a0562018f061 => generated 0 bytes in 206 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 19:27:54 user devstack@n-api.service[72088]: INFO nova.api.openstack.compute.server_external_events [req-6dce3ff4-a470-49fd-8934-64a34f845ab5 req-efefed41-ea96-46a4-b350-8c1bd424b414 service nova] Creating event network-vif-unplugged:031df3cc-5433-459d-ab9b-484629289e90 for instance 9941d033-15c2-4069-b9a6-f80840e95a38 on user Apr 11 19:27:54 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [req-6dce3ff4-a470-49fd-8934-64a34f845ab5 req-efefed41-ea96-46a4-b350-8c1bd424b414 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.042300 Apr 11 19:27:54 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 135/407] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:27:54 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:27:54 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [None req-475cc613-2dde-4705-96d6-2b339d30cc16 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] Calling method '>' {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:27:54 user devstack@n-api.service[72090]: DEBUG nova.compute.api [None req-475cc613-2dde-4705-96d6-2b339d30cc16 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] [instance: aa0bb9aa-a93d-45bc-9f90-46eeb6416365] Fetching instance by UUID {{(pid=72090) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:27:54 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-475cc613-2dde-4705-96d6-2b339d30cc16 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:27:54 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-475cc613-2dde-4705-96d6-2b339d30cc16 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:27:54 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-475cc613-2dde-4705-96d6-2b339d30cc16 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:27:54 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-475cc613-2dde-4705-96d6-2b339d30cc16 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:27:54 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-475cc613-2dde-4705-96d6-2b339d30cc16 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:27:54 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-475cc613-2dde-4705-96d6-2b339d30cc16 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:27:54 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [None req-475cc613-2dde-4705-96d6-2b339d30cc16 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] 10.0.0.210 "GET /compute/v2.1/servers/aa0bb9aa-a93d-45bc-9f90-46eeb6416365/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059142 Apr 11 19:27:54 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 134/408] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Apr 11 19:27:54 2023] GET /compute/v2.1/servers/aa0bb9aa-a93d-45bc-9f90-46eeb6416365/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:27:55 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [None req-13fe69ae-a917-4fc1-9956-997b881ff4a5 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Calling method '>' {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:27:55 user devstack@n-api.service[72089]: DEBUG nova.compute.api [None req-13fe69ae-a917-4fc1-9956-997b881ff4a5 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] [instance: f37ed08c-8c9a-4af7-ba5f-b8a942e54389] Fetching instance by UUID {{(pid=72089) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:27:55 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-13fe69ae-a917-4fc1-9956-997b881ff4a5 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:27:55 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-13fe69ae-a917-4fc1-9956-997b881ff4a5 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:27:55 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-13fe69ae-a917-4fc1-9956-997b881ff4a5 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:27:55 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-13fe69ae-a917-4fc1-9956-997b881ff4a5 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:27:55 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-13fe69ae-a917-4fc1-9956-997b881ff4a5 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:27:55 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-13fe69ae-a917-4fc1-9956-997b881ff4a5 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:27:55 user devstack@n-api.service[72089]: DEBUG nova.objects.instance [None req-13fe69ae-a917-4fc1-9956-997b881ff4a5 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Lazy-loading 'services' on Instance uuid f37ed08c-8c9a-4af7-ba5f-b8a942e54389 {{(pid=72089) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 11 19:27:56 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [None req-13fe69ae-a917-4fc1-9956-997b881ff4a5 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/f37ed08c-8c9a-4af7-ba5f-b8a942e54389/os-volume_attachments/a8c38948-98ba-4df2-9662-251d3da4b5d7" status: 202 len: 0 microversion: 2.1 time: 0.174618 Apr 11 19:27:56 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 140/409] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Apr 11 19:27:55 2023] DELETE /compute/v2.1/servers/f37ed08c-8c9a-4af7-ba5f-b8a942e54389/os-volume_attachments/a8c38948-98ba-4df2-9662-251d3da4b5d7 => generated 0 bytes in 177 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 19:27:56 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [None req-20d40989-978a-426d-a01e-77453ecd021f tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Calling method '>' {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:27:56 user devstack@n-api.service[72088]: DEBUG nova.compute.api [None req-20d40989-978a-426d-a01e-77453ecd021f tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] [instance: f37ed08c-8c9a-4af7-ba5f-b8a942e54389] Fetching instance by UUID {{(pid=72088) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:27:56 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-20d40989-978a-426d-a01e-77453ecd021f tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:27:56 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-20d40989-978a-426d-a01e-77453ecd021f tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:27:56 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-20d40989-978a-426d-a01e-77453ecd021f tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:27:56 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-20d40989-978a-426d-a01e-77453ecd021f tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:27:56 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-20d40989-978a-426d-a01e-77453ecd021f tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:27:56 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-20d40989-978a-426d-a01e-77453ecd021f tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:27:56 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [None req-20d40989-978a-426d-a01e-77453ecd021f tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f37ed08c-8c9a-4af7-ba5f-b8a942e54389/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059646 Apr 11 19:27:56 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 136/410] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Apr 11 19:27:56 2023] GET /compute/v2.1/servers/f37ed08c-8c9a-4af7-ba5f-b8a942e54389/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:27:56 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [req-f6346558-317e-44c0-9a3e-5f80bd6414f9 req-eb00d792-0648-4cb6-9a69-29a0ad4d0e4d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9941d033-15c2-4069-b9a6-f80840e95a38", "name": "network-vif-plugged", "status": "completed", "tag": "031df3cc-5433-459d-ab9b-484629289e90"}, {"server_uuid": "9941d033-15c2-4069-b9a6-f80840e95a38", "name": "network-vif-deleted", "tag": "031df3cc-5433-459d-ab9b-484629289e90"}]} {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:27:56 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-f6346558-317e-44c0-9a3e-5f80bd6414f9 req-eb00d792-0648-4cb6-9a69-29a0ad4d0e4d service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:27:56 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-f6346558-317e-44c0-9a3e-5f80bd6414f9 req-eb00d792-0648-4cb6-9a69-29a0ad4d0e4d service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:27:56 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-f6346558-317e-44c0-9a3e-5f80bd6414f9 req-eb00d792-0648-4cb6-9a69-29a0ad4d0e4d service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:27:56 user devstack@n-api.service[72090]: INFO nova.api.openstack.compute.server_external_events [req-f6346558-317e-44c0-9a3e-5f80bd6414f9 req-eb00d792-0648-4cb6-9a69-29a0ad4d0e4d service nova] Creating event network-vif-plugged:031df3cc-5433-459d-ab9b-484629289e90 for instance 9941d033-15c2-4069-b9a6-f80840e95a38 on user Apr 11 19:27:56 user devstack@n-api.service[72090]: INFO nova.api.openstack.compute.server_external_events [req-f6346558-317e-44c0-9a3e-5f80bd6414f9 req-eb00d792-0648-4cb6-9a69-29a0ad4d0e4d service nova] Creating event network-vif-deleted:031df3cc-5433-459d-ab9b-484629289e90 for instance 9941d033-15c2-4069-b9a6-f80840e95a38 on user Apr 11 19:27:56 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [req-f6346558-317e-44c0-9a3e-5f80bd6414f9 req-eb00d792-0648-4cb6-9a69-29a0ad4d0e4d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.034779 Apr 11 19:27:56 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 135/411] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:27:56 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:28:11 user devstack@n-api.service[72089]: DEBUG dbcounter [-] [72089] Writing DB stats nova_api:SELECT=3 {{(pid=72089) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:28:11 user devstack@n-api.service[72089]: DEBUG dbcounter [-] [72089] Writing DB stats nova_cell1:SELECT=17,nova_cell1:INSERT=2 {{(pid=72089) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:28:11 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [None req-8bc4ebdf-eaa6-450c-99cd-7f39835f59d2 tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] Calling method '>' {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:28:11 user devstack@n-api.service[72089]: DEBUG nova.compute.api [None req-8bc4ebdf-eaa6-450c-99cd-7f39835f59d2 tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] [instance: fc48e37f-8c00-4e48-bea3-f1c2e54d78b8] Fetching instance by UUID {{(pid=72089) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:28:11 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-8bc4ebdf-eaa6-450c-99cd-7f39835f59d2 tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:28:11 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-8bc4ebdf-eaa6-450c-99cd-7f39835f59d2 tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:28:11 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-8bc4ebdf-eaa6-450c-99cd-7f39835f59d2 tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:28:11 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-8bc4ebdf-eaa6-450c-99cd-7f39835f59d2 tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:28:11 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-8bc4ebdf-eaa6-450c-99cd-7f39835f59d2 tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:28:11 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-8bc4ebdf-eaa6-450c-99cd-7f39835f59d2 tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:28:12 user devstack@n-api.service[72089]: DEBUG nova.policy [None req-8bc4ebdf-eaa6-450c-99cd-7f39835f59d2 tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f44dfa2528b4540a81f4eb7c3f3f2f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5d7769df1e4974b295cb30407151dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72089) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:28:12 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [None req-8bc4ebdf-eaa6-450c-99cd-7f39835f59d2 tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fc48e37f-8c00-4e48-bea3-f1c2e54d78b8" status: 200 len: 1494 microversion: 2.1 time: 0.163887 Apr 11 19:28:12 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 141/412] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 19:28:11 2023] GET /compute/v2.1/servers/fc48e37f-8c00-4e48-bea3-f1c2e54d78b8 => generated 1494 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:28:14 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [None req-af9da1d3-c61a-4450-ab34-252265518c01 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Calling method '>' {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:28:14 user devstack@n-api.service[72088]: DEBUG nova.compute.api [None req-af9da1d3-c61a-4450-ab34-252265518c01 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] [instance: bed4001c-02c2-4c6b-84c8-61654df66d8b] Fetching instance by UUID {{(pid=72088) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:28:14 user devstack@n-api.service[72088]: DEBUG dbcounter [-] [72088] Writing DB stats nova_api:SELECT=10,nova_api:UPDATE=1 {{(pid=72088) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:28:14 user devstack@n-api.service[72088]: DEBUG dbcounter [-] [72088] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=72088) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:28:14 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-af9da1d3-c61a-4450-ab34-252265518c01 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:28:14 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-af9da1d3-c61a-4450-ab34-252265518c01 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:28:14 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-af9da1d3-c61a-4450-ab34-252265518c01 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:28:14 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-af9da1d3-c61a-4450-ab34-252265518c01 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:28:14 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-af9da1d3-c61a-4450-ab34-252265518c01 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:28:14 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-af9da1d3-c61a-4450-ab34-252265518c01 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:28:14 user devstack@n-api.service[72088]: INFO nova.api.openstack.wsgi [None req-af9da1d3-c61a-4450-ab34-252265518c01 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] HTTP exception thrown: Instance bed4001c-02c2-4c6b-84c8-61654df66d8b could not be found. Apr 11 19:28:14 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [None req-af9da1d3-c61a-4450-ab34-252265518c01 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Request method failure captured: Apr 11 19:28:14 user devstack@n-api.service[72088]: request: GET /compute/v2.1/servers/bed4001c-02c2-4c6b-84c8-61654df66d8b HTTP/1.1 Apr 11 19:28:14 user devstack@n-api.service[72088]: Accept: application/json Apr 11 19:28:14 user devstack@n-api.service[72088]: Accept-Encoding: identity Apr 11 19:28:14 user devstack@n-api.service[72088]: Connection: close Apr 11 19:28:14 user devstack@n-api.service[72088]: Content-Length: 0 Apr 11 19:28:14 user devstack@n-api.service[72088]: Content-Type: application/json Apr 11 19:28:14 user devstack@n-api.service[72088]: Host: 10.0.0.210 Apr 11 19:28:14 user devstack@n-api.service[72088]: Openstack-System-Scope: None Apr 11 19:28:14 user devstack@n-api.service[72088]: User-Agent: python-urllib3/1.26.15 Apr 11 19:28:14 user devstack@n-api.service[72088]: X-Auth-Token: gAAAAABkNbM9PPhjuxFro365bgGlzXmEeNXBFjH7B9DXRG846ZOMZNO8rjcHBUXZkmUpO9G06QygHvaEJVpRlrFcJIyDYtH16p4qIRFo8lVfjRkqkJh8soUAdF5jsPsH_hjCF2czbYEFIUpkQBo9PM7kG8byL_cnEa6VpD9RmxIaxcGcdobg_-U Apr 11 19:28:14 user devstack@n-api.service[72088]: X-Domain-Id: None Apr 11 19:28:14 user devstack@n-api.service[72088]: X-Domain-Name: None Apr 11 19:28:14 user devstack@n-api.service[72088]: X-Identity-Status: Confirmed Apr 11 19:28:14 user devstack@n-api.service[72088]: X-Is-Admin-Project: True Apr 11 19:28:14 user devstack@n-api.service[72088]: X-Project-Domain-Id: default Apr 11 19:28:14 user devstack@n-api.service[72088]: X-Project-Domain-Name: Default Apr 11 19:28:14 user devstack@n-api.service[72088]: X-Project-Id: 06966e2f4d3a4dec92282c7ad348635d Apr 11 19:28:14 user devstack@n-api.service[72088]: X-Project-Name: tempest-AttachVolumeNegativeTest-303418642 Apr 11 19:28:14 user devstack@n-api.service[72088]: X-Role: reader,member Apr 11 19:28:14 user devstack@n-api.service[72088]: X-Roles: reader,member Apr 11 19:28:14 user devstack@n-api.service[72088]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/06966e2f4d3a4dec92282c7ad348635d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/06966e2f4d3a4dec92282c7ad348635d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/06966e2f4d3a4dec92282c7ad348635d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 11 19:28:14 user devstack@n-api.service[72088]: X-Tenant: tempest-AttachVolumeNegativeTest-303418642 Apr 11 19:28:14 user devstack@n-api.service[72088]: X-Tenant-Id: 06966e2f4d3a4dec92282c7ad348635d Apr 11 19:28:14 user devstack@n-api.service[72088]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-303418642 Apr 11 19:28:14 user devstack@n-api.service[72088]: X-User: tempest-AttachVolumeNegativeTest-303418642-project-member Apr 11 19:28:14 user devstack@n-api.service[72088]: X-User-Domain-Id: default Apr 11 19:28:14 user devstack@n-api.service[72088]: X-User-Domain-Name: Default Apr 11 19:28:14 user devstack@n-api.service[72088]: X-User-Id: d5d405421ceb4d99967ef2e7f55e7809 Apr 11 19:28:14 user devstack@n-api.service[72088]: X-User-Name: tempest-AttachVolumeNegativeTest-303418642-project-member Apr 11 19:28:14 user devstack@n-api.service[72088]: method: > Apr 11 19:28:14 user devstack@n-api.service[72088]: exception: Instance bed4001c-02c2-4c6b-84c8-61654df66d8b could not be found. Apr 11 19:28:14 user devstack@n-api.service[72088]: action_args: {'id': 'bed4001c-02c2-4c6b-84c8-61654df66d8b'} Apr 11 19:28:14 user devstack@n-api.service[72088]: {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 19:28:14 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:28:14 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 19:28:14 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 19:28:14 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 19:28:14 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 19:28:14 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 19:28:14 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 19:28:14 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 19:28:14 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 19:28:14 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bed4001c-02c2-4c6b-84c8-61654df66d8b could not be found. Apr 11 19:28:14 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi Apr 11 19:28:14 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 19:28:14 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi Apr 11 19:28:14 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:28:14 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 19:28:14 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 19:28:14 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 19:28:14 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 19:28:14 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 19:28:14 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 19:28:14 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 19:28:14 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 19:28:14 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 19:28:14 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 19:28:14 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 19:28:14 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 19:28:14 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bed4001c-02c2-4c6b-84c8-61654df66d8b could not be found. Apr 11 19:28:14 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi Apr 11 19:28:14 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 19:28:14 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi Apr 11 19:28:14 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:28:14 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 19:28:14 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 19:28:14 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 19:28:14 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 19:28:14 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bed4001c-02c2-4c6b-84c8-61654df66d8b could not be found. Apr 11 19:28:14 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi Apr 11 19:28:14 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [None req-af9da1d3-c61a-4450-ab34-252265518c01 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Returning 404 to user: Instance bed4001c-02c2-4c6b-84c8-61654df66d8b could not be found. {{(pid=72088) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 19:28:14 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [None req-af9da1d3-c61a-4450-ab34-252265518c01 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bed4001c-02c2-4c6b-84c8-61654df66d8b" status: 404 len: 111 microversion: 2.1 time: 0.038384 Apr 11 19:28:14 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 137/413] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 19:28:14 2023] GET /compute/v2.1/servers/bed4001c-02c2-4c6b-84c8-61654df66d8b => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 19:28:14 user devstack@n-api.service[72090]: DEBUG dbcounter [-] [72090] Writing DB stats nova_api:SELECT=5 {{(pid=72090) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:28:14 user devstack@n-api.service[72090]: DEBUG dbcounter [-] [72090] Writing DB stats nova_cell1:SELECT=13 {{(pid=72090) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:28:14 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [None req-246ee6e3-2b67-4bcf-9400-ac4ad46c2549 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Calling method '.version_select at 0x7f119dc0d630>' {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:28:14 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [None req-246ee6e3-2b67-4bcf-9400-ac4ad46c2549 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-253891769" status: 202 len: 0 microversion: 2.1 time: 0.026509 Apr 11 19:28:14 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 136/414] 10.0.0.210 () {62 vars in 1295 bytes} [Tue Apr 11 19:28:14 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-253891769 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 19:28:14 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [None req-3c06ecda-fbc1-4506-a20e-4f9cee575604 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Action: 'create', calling method: .version_select at 0x7f119dbe9fc0>, body: {"keypair": {"name": "tempest-keypair-1056959304", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF0gNEuZy4WwlntDCrxaO0By8v6wh2LPSvcUjVDg7AoB9duP6CtOuqC+mGfVgzWe8DlNEj6aUlezeF0+IV6nwjLFlAzfgxa89U94DyhZnjYMUBWl9xaaflLwBRbhfRP9Mg=="}} {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:28:14 user devstack@n-api.service[72089]: DEBUG nova.quota [None req-3c06ecda-fbc1-4506-a20e-4f9cee575604 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Getting quotas for project 06966e2f4d3a4dec92282c7ad348635d. Resources: {'key_pairs'} {{(pid=72089) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 19:28:14 user devstack@n-api.service[72089]: DEBUG nova.quota [None req-3c06ecda-fbc1-4506-a20e-4f9cee575604 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Getting quotas for user d5d405421ceb4d99967ef2e7f55e7809 and project 06966e2f4d3a4dec92282c7ad348635d. Resources: {'key_pairs'} {{(pid=72089) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 19:28:14 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [None req-3c06ecda-fbc1-4506-a20e-4f9cee575604 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.046736 Apr 11 19:28:14 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 142/415] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Apr 11 19:28:14 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:28:16 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [None req-1f806d29-62f1-4e60-81a9-e75d9cfecac8 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-685848689", "imageRef": "4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "fb39619b-a298-4b28-9280-3fc309c5a229"}], "security_groups": [{"name": "tempest-securitygroup--1494852999"}], "key_name": "tempest-keypair-1056959304", "user_data": "}} {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:28:16 user devstack@n-api.service[72088]: DEBUG nova.network.neutron [None req-1f806d29-62f1-4e60-81a9-e75d9cfecac8 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] validate_networks() for [('fb39619b-a298-4b28-9280-3fc309c5a229', None, None, None, None, None)] {{(pid=72088) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 11 19:28:17 user devstack@n-api.service[72088]: DEBUG nova.virt.hardware [None req-1f806d29-62f1-4e60-81a9-e75d9cfecac8 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Flavor limits 0:0:0 {{(pid=72088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 19:28:17 user devstack@n-api.service[72088]: DEBUG nova.virt.hardware [None req-1f806d29-62f1-4e60-81a9-e75d9cfecac8 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Image limits 0:0:0 {{(pid=72088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 19:28:17 user devstack@n-api.service[72088]: DEBUG nova.virt.hardware [None req-1f806d29-62f1-4e60-81a9-e75d9cfecac8 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Flavor pref 0:0:0 {{(pid=72088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 19:28:17 user devstack@n-api.service[72088]: DEBUG nova.virt.hardware [None req-1f806d29-62f1-4e60-81a9-e75d9cfecac8 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Image pref 0:0:0 {{(pid=72088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 19:28:17 user devstack@n-api.service[72088]: DEBUG nova.virt.hardware [None req-1f806d29-62f1-4e60-81a9-e75d9cfecac8 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 19:28:17 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-1f806d29-62f1-4e60-81a9-e75d9cfecac8 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:28:17 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-1f806d29-62f1-4e60-81a9-e75d9cfecac8 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:28:17 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-1f806d29-62f1-4e60-81a9-e75d9cfecac8 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:28:17 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-1f806d29-62f1-4e60-81a9-e75d9cfecac8 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:28:17 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-1f806d29-62f1-4e60-81a9-e75d9cfecac8 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:28:17 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-1f806d29-62f1-4e60-81a9-e75d9cfecac8 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:28:17 user devstack@n-api.service[72088]: DEBUG nova.quota [None req-1f806d29-62f1-4e60-81a9-e75d9cfecac8 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Getting quotas for project 06966e2f4d3a4dec92282c7ad348635d. Resources: {'ram', 'instances', 'cores'} {{(pid=72088) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 19:28:17 user devstack@n-api.service[72088]: DEBUG nova.quota [None req-1f806d29-62f1-4e60-81a9-e75d9cfecac8 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Getting quotas for user d5d405421ceb4d99967ef2e7f55e7809 and project 06966e2f4d3a4dec92282c7ad348635d. Resources: {'ram', 'instances', 'cores'} {{(pid=72088) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 19:28:17 user devstack@n-api.service[72088]: DEBUG nova.compute.api [None req-1f806d29-62f1-4e60-81a9-e75d9cfecac8 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Going to run 1 instances... {{(pid=72088) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 11 19:28:17 user devstack@n-api.service[72088]: DEBUG nova.compute.api [None req-1f806d29-62f1-4e60-81a9-e75d9cfecac8 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] [instance: 558100b9-f3ac-47c7-9260-b897b0cae55f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=72088) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 11 19:28:17 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [None req-1f806d29-62f1-4e60-81a9-e75d9cfecac8 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 0.661180 Apr 11 19:28:17 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 138/416] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 11 19:28:16 2023] POST /compute/v2.1/servers => generated 400 bytes in 663 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 11 19:28:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [None req-44a7100a-cc1e-4127-8b12-12bd0ba74f8e tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Calling method '>' {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:28:17 user devstack@n-api.service[72090]: DEBUG nova.compute.api [None req-44a7100a-cc1e-4127-8b12-12bd0ba74f8e tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] [instance: 558100b9-f3ac-47c7-9260-b897b0cae55f] Fetching instance by UUID {{(pid=72090) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:28:17 user devstack@n-api.service[72090]: DEBUG nova.policy [None req-44a7100a-cc1e-4127-8b12-12bd0ba74f8e tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5d405421ceb4d99967ef2e7f55e7809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06966e2f4d3a4dec92282c7ad348635d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72090) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:28:17 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [None req-44a7100a-cc1e-4127-8b12-12bd0ba74f8e tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] 10.0.0.210 "GET /compute/v2.1/servers/558100b9-f3ac-47c7-9260-b897b0cae55f" status: 200 len: 1235 microversion: 2.1 time: 0.090088 Apr 11 19:28:17 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 137/417] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 19:28:17 2023] GET /compute/v2.1/servers/558100b9-f3ac-47c7-9260-b897b0cae55f => generated 1235 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:28:19 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [req-d4a1046f-cb3f-4000-87fd-862a1d720a20 req-c2d016ee-b57d-4973-a0bb-390f02b9bc31 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "558100b9-f3ac-47c7-9260-b897b0cae55f", "tag": "4f568bd5-7271-434e-a30e-beb13759e1f1"}]} {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:28:19 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-d4a1046f-cb3f-4000-87fd-862a1d720a20 req-c2d016ee-b57d-4973-a0bb-390f02b9bc31 service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:28:19 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-d4a1046f-cb3f-4000-87fd-862a1d720a20 req-c2d016ee-b57d-4973-a0bb-390f02b9bc31 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:28:19 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-d4a1046f-cb3f-4000-87fd-862a1d720a20 req-c2d016ee-b57d-4973-a0bb-390f02b9bc31 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:28:19 user devstack@n-api.service[72089]: INFO nova.api.openstack.compute.server_external_events [req-d4a1046f-cb3f-4000-87fd-862a1d720a20 req-c2d016ee-b57d-4973-a0bb-390f02b9bc31 service nova] Creating event network-changed:4f568bd5-7271-434e-a30e-beb13759e1f1 for instance 558100b9-f3ac-47c7-9260-b897b0cae55f on user Apr 11 19:28:19 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [req-d4a1046f-cb3f-4000-87fd-862a1d720a20 req-c2d016ee-b57d-4973-a0bb-390f02b9bc31 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028435 Apr 11 19:28:19 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 143/418] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:28:19 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:28:21 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [req-dfed92c9-ce3c-45f1-9c2f-129dffad2cf7 req-fd7efe52-8180-4803-a168-5c91007e50c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "558100b9-f3ac-47c7-9260-b897b0cae55f", "name": "network-vif-plugged", "status": "completed", "tag": "4f568bd5-7271-434e-a30e-beb13759e1f1"}]} {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:28:21 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-dfed92c9-ce3c-45f1-9c2f-129dffad2cf7 req-fd7efe52-8180-4803-a168-5c91007e50c0 service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:28:21 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-dfed92c9-ce3c-45f1-9c2f-129dffad2cf7 req-fd7efe52-8180-4803-a168-5c91007e50c0 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:28:21 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-dfed92c9-ce3c-45f1-9c2f-129dffad2cf7 req-fd7efe52-8180-4803-a168-5c91007e50c0 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:28:21 user devstack@n-api.service[72088]: INFO nova.api.openstack.compute.server_external_events [req-dfed92c9-ce3c-45f1-9c2f-129dffad2cf7 req-fd7efe52-8180-4803-a168-5c91007e50c0 service nova] Creating event network-vif-plugged:4f568bd5-7271-434e-a30e-beb13759e1f1 for instance 558100b9-f3ac-47c7-9260-b897b0cae55f on user Apr 11 19:28:21 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [req-dfed92c9-ce3c-45f1-9c2f-129dffad2cf7 req-fd7efe52-8180-4803-a168-5c91007e50c0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066724 Apr 11 19:28:21 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 139/419] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:28:21 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:28:24 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [req-9ca316e5-75bb-4031-b770-cd7b2a3c5554 req-dece3f83-fa7b-43d1-ba50-1259e2957dff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "558100b9-f3ac-47c7-9260-b897b0cae55f", "name": "network-vif-plugged", "status": "completed", "tag": "4f568bd5-7271-434e-a30e-beb13759e1f1"}]} {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:28:24 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-9ca316e5-75bb-4031-b770-cd7b2a3c5554 req-dece3f83-fa7b-43d1-ba50-1259e2957dff service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:28:24 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-9ca316e5-75bb-4031-b770-cd7b2a3c5554 req-dece3f83-fa7b-43d1-ba50-1259e2957dff service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:28:24 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-9ca316e5-75bb-4031-b770-cd7b2a3c5554 req-dece3f83-fa7b-43d1-ba50-1259e2957dff service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:28:24 user devstack@n-api.service[72090]: INFO nova.api.openstack.compute.server_external_events [req-9ca316e5-75bb-4031-b770-cd7b2a3c5554 req-dece3f83-fa7b-43d1-ba50-1259e2957dff service nova] Creating event network-vif-plugged:4f568bd5-7271-434e-a30e-beb13759e1f1 for instance 558100b9-f3ac-47c7-9260-b897b0cae55f on user Apr 11 19:28:24 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [req-9ca316e5-75bb-4031-b770-cd7b2a3c5554 req-dece3f83-fa7b-43d1-ba50-1259e2957dff service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029416 Apr 11 19:28:24 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 138/420] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:28:24 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:28:25 user devstack@n-api.service[72089]: DEBUG dbcounter [-] [72089] Writing DB stats nova_cell0:SELECT=4 {{(pid=72089) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:28:25 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [None req-69ee16cd-4e9c-4637-a7c1-e6d32d5969bd tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Calling method '>' {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:28:25 user devstack@n-api.service[72089]: DEBUG nova.compute.api [None req-69ee16cd-4e9c-4637-a7c1-e6d32d5969bd tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] [instance: 720c683f-c03a-444c-92a8-daf97c9f524b] Fetching instance by UUID {{(pid=72089) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:28:25 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-69ee16cd-4e9c-4637-a7c1-e6d32d5969bd tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:28:25 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-69ee16cd-4e9c-4637-a7c1-e6d32d5969bd tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:28:25 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-69ee16cd-4e9c-4637-a7c1-e6d32d5969bd tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:28:25 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-69ee16cd-4e9c-4637-a7c1-e6d32d5969bd tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:28:25 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-69ee16cd-4e9c-4637-a7c1-e6d32d5969bd tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:28:25 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-69ee16cd-4e9c-4637-a7c1-e6d32d5969bd tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:28:25 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [None req-69ee16cd-4e9c-4637-a7c1-e6d32d5969bd tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] 10.0.0.210 "GET /compute/v2.1/servers/720c683f-c03a-444c-92a8-daf97c9f524b/os-interface" status: 200 len: 282 microversion: 2.20 time: 0.113969 Apr 11 19:28:25 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 144/421] 10.0.0.210 () {64 vars in 1393 bytes} [Tue Apr 11 19:28:25 2023] GET /compute/v2.1/servers/720c683f-c03a-444c-92a8-daf97c9f524b/os-interface => generated 282 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:28:25 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [None req-1eabaf02-6180-4846-aff2-ceb2985813e1 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerBootFromVolumeStableRescueTest-server-2079796435", "imageRef": "4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b", "flavorRef": "42", "block_device_mapping_v2": [{"boot_index": "0", "source_type": "blank", "volume_size": 1, "destination_type": "volume"}], "networks": [{"uuid": "eeacad54-05f6-4aba-aed7-13baddfb50e2"}]}} {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:28:25 user devstack@n-api.service[72088]: DEBUG nova.network.neutron [None req-1eabaf02-6180-4846-aff2-ceb2985813e1 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] validate_networks() for [('eeacad54-05f6-4aba-aed7-13baddfb50e2', None, None, None, None, None)] {{(pid=72088) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 11 19:28:26 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [req-0ac74cec-c42d-4634-9bc3-7e40135d128b req-9b8d3400-c5b1-4464-869e-d7ec83ffd48b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "720c683f-c03a-444c-92a8-daf97c9f524b", "tag": "9e6087aa-464a-450d-bd04-2653d9420094"}]} {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:28:26 user devstack@n-api.service[72088]: DEBUG nova.virt.hardware [None req-1eabaf02-6180-4846-aff2-ceb2985813e1 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Flavor limits 0:0:0 {{(pid=72088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 19:28:26 user devstack@n-api.service[72088]: DEBUG nova.virt.hardware [None req-1eabaf02-6180-4846-aff2-ceb2985813e1 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Image limits 0:0:0 {{(pid=72088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 19:28:26 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-0ac74cec-c42d-4634-9bc3-7e40135d128b req-9b8d3400-c5b1-4464-869e-d7ec83ffd48b service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:28:26 user devstack@n-api.service[72088]: DEBUG nova.virt.hardware [None req-1eabaf02-6180-4846-aff2-ceb2985813e1 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Flavor pref 0:0:0 {{(pid=72088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 19:28:26 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-0ac74cec-c42d-4634-9bc3-7e40135d128b req-9b8d3400-c5b1-4464-869e-d7ec83ffd48b service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:28:26 user devstack@n-api.service[72088]: DEBUG nova.virt.hardware [None req-1eabaf02-6180-4846-aff2-ceb2985813e1 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Image pref 0:0:0 {{(pid=72088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 19:28:26 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-0ac74cec-c42d-4634-9bc3-7e40135d128b req-9b8d3400-c5b1-4464-869e-d7ec83ffd48b service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:28:26 user devstack@n-api.service[72088]: DEBUG nova.virt.hardware [None req-1eabaf02-6180-4846-aff2-ceb2985813e1 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 19:28:26 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-1eabaf02-6180-4846-aff2-ceb2985813e1 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:28:26 user devstack@n-api.service[72090]: INFO nova.api.openstack.compute.server_external_events [req-0ac74cec-c42d-4634-9bc3-7e40135d128b req-9b8d3400-c5b1-4464-869e-d7ec83ffd48b service nova] Creating event network-changed:9e6087aa-464a-450d-bd04-2653d9420094 for instance 720c683f-c03a-444c-92a8-daf97c9f524b on user Apr 11 19:28:26 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-1eabaf02-6180-4846-aff2-ceb2985813e1 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:28:26 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-1eabaf02-6180-4846-aff2-ceb2985813e1 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:28:26 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-1eabaf02-6180-4846-aff2-ceb2985813e1 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:28:26 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-1eabaf02-6180-4846-aff2-ceb2985813e1 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:28:26 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-1eabaf02-6180-4846-aff2-ceb2985813e1 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:28:26 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [req-0ac74cec-c42d-4634-9bc3-7e40135d128b req-9b8d3400-c5b1-4464-869e-d7ec83ffd48b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047031 Apr 11 19:28:26 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 139/422] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:28:26 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:28:26 user devstack@n-api.service[72088]: DEBUG nova.quota [None req-1eabaf02-6180-4846-aff2-ceb2985813e1 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Getting quotas for project eb91586feb3f4a4c84fa8c2183baaf8c. Resources: {'ram', 'instances', 'cores'} {{(pid=72088) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 19:28:26 user devstack@n-api.service[72088]: DEBUG nova.quota [None req-1eabaf02-6180-4846-aff2-ceb2985813e1 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Getting quotas for user 1b3adca432b04d70818a51d1366f5c6d and project eb91586feb3f4a4c84fa8c2183baaf8c. Resources: {'ram', 'instances', 'cores'} {{(pid=72088) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 19:28:26 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [None req-e03b1d99-9011-4ec0-b5a2-8222b04cb5c2 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Calling method '>' {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:28:26 user devstack@n-api.service[72089]: DEBUG nova.compute.api [None req-e03b1d99-9011-4ec0-b5a2-8222b04cb5c2 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] [instance: 720c683f-c03a-444c-92a8-daf97c9f524b] Fetching instance by UUID {{(pid=72089) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:28:26 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-e03b1d99-9011-4ec0-b5a2-8222b04cb5c2 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:28:26 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-e03b1d99-9011-4ec0-b5a2-8222b04cb5c2 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:28:26 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-e03b1d99-9011-4ec0-b5a2-8222b04cb5c2 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:28:26 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-e03b1d99-9011-4ec0-b5a2-8222b04cb5c2 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:28:26 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-e03b1d99-9011-4ec0-b5a2-8222b04cb5c2 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:28:26 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-e03b1d99-9011-4ec0-b5a2-8222b04cb5c2 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:28:26 user devstack@n-api.service[72088]: DEBUG nova.compute.api [None req-1eabaf02-6180-4846-aff2-ceb2985813e1 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Going to run 1 instances... {{(pid=72088) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 11 19:28:26 user devstack@n-api.service[72088]: DEBUG nova.compute.api [None req-1eabaf02-6180-4846-aff2-ceb2985813e1 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] [instance: 864fcd9b-8e5b-4de8-a2e6-292a8907a834] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='blank',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=72088) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 11 19:28:26 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [None req-e03b1d99-9011-4ec0-b5a2-8222b04cb5c2 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] 10.0.0.210 "GET /compute/v2.1/servers/720c683f-c03a-444c-92a8-daf97c9f524b/ips" status: 200 len: 109 microversion: 2.20 time: 0.059842 Apr 11 19:28:26 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 145/423] 10.0.0.210 () {64 vars in 1366 bytes} [Tue Apr 11 19:28:26 2023] GET /compute/v2.1/servers/720c683f-c03a-444c-92a8-daf97c9f524b/ips => generated 109 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 11 19:28:26 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [None req-1eabaf02-6180-4846-aff2-ceb2985813e1 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.87 time: 0.802457 Apr 11 19:28:26 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 140/424] 10.0.0.210 () {66 vars in 1265 bytes} [Tue Apr 11 19:28:25 2023] POST /compute/v2.1/servers => generated 378 bytes in 804 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 11 19:28:26 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [None req-a0ed4cfa-6a5d-4c6b-84dc-eee4466a3a56 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Calling method '>' {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:28:26 user devstack@n-api.service[72090]: DEBUG nova.compute.api [None req-a0ed4cfa-6a5d-4c6b-84dc-eee4466a3a56 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] [instance: 864fcd9b-8e5b-4de8-a2e6-292a8907a834] Fetching instance by UUID {{(pid=72090) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:28:26 user devstack@n-api.service[72090]: DEBUG nova.policy [None req-a0ed4cfa-6a5d-4c6b-84dc-eee4466a3a56 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b3adca432b04d70818a51d1366f5c6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb91586feb3f4a4c84fa8c2183baaf8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72090) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:28:26 user devstack@n-api.service[72090]: DEBUG nova.policy [None req-a0ed4cfa-6a5d-4c6b-84dc-eee4466a3a56 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b3adca432b04d70818a51d1366f5c6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb91586feb3f4a4c84fa8c2183baaf8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72090) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:28:26 user devstack@n-api.service[72090]: DEBUG nova.policy [None req-a0ed4cfa-6a5d-4c6b-84dc-eee4466a3a56 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b3adca432b04d70818a51d1366f5c6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb91586feb3f4a4c84fa8c2183baaf8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72090) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:28:26 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [None req-a0ed4cfa-6a5d-4c6b-84dc-eee4466a3a56 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] 10.0.0.210 "GET /compute/v2.1/servers/864fcd9b-8e5b-4de8-a2e6-292a8907a834" status: 200 len: 1395 microversion: 2.87 time: 0.092623 Apr 11 19:28:26 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 140/425] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 19:28:26 2023] GET /compute/v2.1/servers/864fcd9b-8e5b-4de8-a2e6-292a8907a834 => generated 1395 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 19:28:28 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [None req-ba3137fa-968c-4e4a-9651-e643da41d2e7 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:28:28 user devstack@n-api.service[72089]: DEBUG nova.compute.api [None req-ba3137fa-968c-4e4a-9651-e643da41d2e7 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] [instance: 720c683f-c03a-444c-92a8-daf97c9f524b] Fetching instance by UUID {{(pid=72089) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:28:28 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-ba3137fa-968c-4e4a-9651-e643da41d2e7 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:28:28 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-ba3137fa-968c-4e4a-9651-e643da41d2e7 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:28:28 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-ba3137fa-968c-4e4a-9651-e643da41d2e7 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:28:28 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-ba3137fa-968c-4e4a-9651-e643da41d2e7 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:28:28 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-ba3137fa-968c-4e4a-9651-e643da41d2e7 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:28:28 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-ba3137fa-968c-4e4a-9651-e643da41d2e7 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:28:28 user devstack@n-api.service[72089]: DEBUG nova.objects.instance [None req-ba3137fa-968c-4e4a-9651-e643da41d2e7 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Lazy-loading 'flavor' on Instance uuid 720c683f-c03a-444c-92a8-daf97c9f524b {{(pid=72089) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 11 19:28:29 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [None req-ba3137fa-968c-4e4a-9651-e643da41d2e7 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] 10.0.0.210 "POST /compute/v2.1/servers/720c683f-c03a-444c-92a8-daf97c9f524b/action" status: 202 len: 0 microversion: 2.20 time: 0.930114 Apr 11 19:28:29 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 146/426] 10.0.0.210 () {66 vars in 1396 bytes} [Tue Apr 11 19:28:28 2023] POST /compute/v2.1/servers/720c683f-c03a-444c-92a8-daf97c9f524b/action => generated 0 bytes in 932 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 11 19:28:29 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [None req-d8d9ef2c-04ab-44e6-9832-fe185e7c0941 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Calling method '>' {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:28:29 user devstack@n-api.service[72088]: DEBUG nova.compute.api [None req-d8d9ef2c-04ab-44e6-9832-fe185e7c0941 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] [instance: 720c683f-c03a-444c-92a8-daf97c9f524b] Fetching instance by UUID {{(pid=72088) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:28:29 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-d8d9ef2c-04ab-44e6-9832-fe185e7c0941 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:28:29 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-d8d9ef2c-04ab-44e6-9832-fe185e7c0941 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:28:29 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-d8d9ef2c-04ab-44e6-9832-fe185e7c0941 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:28:29 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-d8d9ef2c-04ab-44e6-9832-fe185e7c0941 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:28:29 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-d8d9ef2c-04ab-44e6-9832-fe185e7c0941 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:28:29 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-d8d9ef2c-04ab-44e6-9832-fe185e7c0941 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:28:29 user devstack@n-api.service[72088]: DEBUG nova.policy [None req-d8d9ef2c-04ab-44e6-9832-fe185e7c0941 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0558ba5a2b04d36ba2f2411090cc4e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d8b189667e34931aa36149620a036e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72088) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:28:29 user devstack@n-api.service[72088]: DEBUG nova.policy [None req-d8d9ef2c-04ab-44e6-9832-fe185e7c0941 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0558ba5a2b04d36ba2f2411090cc4e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d8b189667e34931aa36149620a036e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72088) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:28:29 user devstack@n-api.service[72088]: DEBUG nova.policy [None req-d8d9ef2c-04ab-44e6-9832-fe185e7c0941 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0558ba5a2b04d36ba2f2411090cc4e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d8b189667e34931aa36149620a036e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72088) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:28:29 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [None req-d8d9ef2c-04ab-44e6-9832-fe185e7c0941 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] 10.0.0.210 "GET /compute/v2.1/servers/720c683f-c03a-444c-92a8-daf97c9f524b" status: 200 len: 1709 microversion: 2.20 time: 0.238848 Apr 11 19:28:29 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 141/427] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 19:28:29 2023] GET /compute/v2.1/servers/720c683f-c03a-444c-92a8-daf97c9f524b => generated 1709 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 19:28:29 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [req-a72559eb-538c-47d3-a14b-f7f52ab7a9a6 req-17b11c5a-07e0-444a-8fe1-207c2c53d101 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "720c683f-c03a-444c-92a8-daf97c9f524b", "name": "network-vif-unplugged", "status": "completed", "tag": "9e6087aa-464a-450d-bd04-2653d9420094"}]} {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:28:29 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-a72559eb-538c-47d3-a14b-f7f52ab7a9a6 req-17b11c5a-07e0-444a-8fe1-207c2c53d101 service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:28:29 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-a72559eb-538c-47d3-a14b-f7f52ab7a9a6 req-17b11c5a-07e0-444a-8fe1-207c2c53d101 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:28:29 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-a72559eb-538c-47d3-a14b-f7f52ab7a9a6 req-17b11c5a-07e0-444a-8fe1-207c2c53d101 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:28:29 user devstack@n-api.service[72090]: INFO nova.api.openstack.compute.server_external_events [req-a72559eb-538c-47d3-a14b-f7f52ab7a9a6 req-17b11c5a-07e0-444a-8fe1-207c2c53d101 service nova] Creating event network-vif-unplugged:9e6087aa-464a-450d-bd04-2653d9420094 for instance 720c683f-c03a-444c-92a8-daf97c9f524b on user Apr 11 19:28:29 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [req-a72559eb-538c-47d3-a14b-f7f52ab7a9a6 req-17b11c5a-07e0-444a-8fe1-207c2c53d101 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.041122 Apr 11 19:28:29 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 141/428] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:28:29 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:28:29 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [req-51966969-21bf-402f-9c28-24e332fe1bc1 req-a0519e4b-5038-48aa-afa5-375f8b831a88 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "864fcd9b-8e5b-4de8-a2e6-292a8907a834", "tag": "60f272b0-f7d2-408b-b99b-9bcfcd3f23ff"}]} {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:28:29 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-51966969-21bf-402f-9c28-24e332fe1bc1 req-a0519e4b-5038-48aa-afa5-375f8b831a88 service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:28:29 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-51966969-21bf-402f-9c28-24e332fe1bc1 req-a0519e4b-5038-48aa-afa5-375f8b831a88 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:28:29 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-51966969-21bf-402f-9c28-24e332fe1bc1 req-a0519e4b-5038-48aa-afa5-375f8b831a88 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:28:29 user devstack@n-api.service[72089]: INFO nova.api.openstack.compute.server_external_events [req-51966969-21bf-402f-9c28-24e332fe1bc1 req-a0519e4b-5038-48aa-afa5-375f8b831a88 service nova] Creating event network-changed:60f272b0-f7d2-408b-b99b-9bcfcd3f23ff for instance 864fcd9b-8e5b-4de8-a2e6-292a8907a834 on user Apr 11 19:28:29 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [req-51966969-21bf-402f-9c28-24e332fe1bc1 req-a0519e4b-5038-48aa-afa5-375f8b831a88 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047493 Apr 11 19:28:29 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 147/429] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:28:29 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:28:31 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [req-1c6036f1-2c37-4fb7-a7e4-83fd70d1932e req-2f3f45c3-2baf-4694-aaad-a5a91a8e44bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "720c683f-c03a-444c-92a8-daf97c9f524b", "name": "network-vif-plugged", "status": "completed", "tag": "9e6087aa-464a-450d-bd04-2653d9420094"}]} {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:28:31 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-1c6036f1-2c37-4fb7-a7e4-83fd70d1932e req-2f3f45c3-2baf-4694-aaad-a5a91a8e44bd service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:28:31 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-1c6036f1-2c37-4fb7-a7e4-83fd70d1932e req-2f3f45c3-2baf-4694-aaad-a5a91a8e44bd service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:28:31 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-1c6036f1-2c37-4fb7-a7e4-83fd70d1932e req-2f3f45c3-2baf-4694-aaad-a5a91a8e44bd service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:28:31 user devstack@n-api.service[72088]: INFO nova.api.openstack.compute.server_external_events [req-1c6036f1-2c37-4fb7-a7e4-83fd70d1932e req-2f3f45c3-2baf-4694-aaad-a5a91a8e44bd service nova] Creating event network-vif-plugged:9e6087aa-464a-450d-bd04-2653d9420094 for instance 720c683f-c03a-444c-92a8-daf97c9f524b on user Apr 11 19:28:31 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [req-1c6036f1-2c37-4fb7-a7e4-83fd70d1932e req-2f3f45c3-2baf-4694-aaad-a5a91a8e44bd service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028988 Apr 11 19:28:31 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 142/430] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:28:31 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:28:34 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [req-43df0799-5a11-4d36-bf20-ad808eb6f610 req-e5aa259f-d8bd-45ee-a21d-ed860db0e0fe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "720c683f-c03a-444c-92a8-daf97c9f524b", "tag": "9e6087aa-464a-450d-bd04-2653d9420094"}]} {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:28:34 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-43df0799-5a11-4d36-bf20-ad808eb6f610 req-e5aa259f-d8bd-45ee-a21d-ed860db0e0fe service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:28:34 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-43df0799-5a11-4d36-bf20-ad808eb6f610 req-e5aa259f-d8bd-45ee-a21d-ed860db0e0fe service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:28:34 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-43df0799-5a11-4d36-bf20-ad808eb6f610 req-e5aa259f-d8bd-45ee-a21d-ed860db0e0fe service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:28:34 user devstack@n-api.service[72090]: INFO nova.api.openstack.compute.server_external_events [req-43df0799-5a11-4d36-bf20-ad808eb6f610 req-e5aa259f-d8bd-45ee-a21d-ed860db0e0fe service nova] Creating event network-changed:9e6087aa-464a-450d-bd04-2653d9420094 for instance 720c683f-c03a-444c-92a8-daf97c9f524b on user Apr 11 19:28:34 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [req-43df0799-5a11-4d36-bf20-ad808eb6f610 req-e5aa259f-d8bd-45ee-a21d-ed860db0e0fe service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038399 Apr 11 19:28:34 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 142/431] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:28:34 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:28:38 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [None req-ce7f5420-a25e-4e7e-a044-98ded7f5a401 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:28:38 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-ce7f5420-a25e-4e7e-a044-98ded7f5a401 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:28:38 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-ce7f5420-a25e-4e7e-a044-98ded7f5a401 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:28:38 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-ce7f5420-a25e-4e7e-a044-98ded7f5a401 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:28:38 user devstack@n-api.service[72089]: DEBUG nova.compute.api [None req-ce7f5420-a25e-4e7e-a044-98ded7f5a401 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] [instance: 6802f099-9236-4c79-a892-2963f1b15b0e] Going to try to start instance {{(pid=72089) start /opt/stack/nova/nova/compute/api.py:2787}} Apr 11 19:28:38 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [None req-ce7f5420-a25e-4e7e-a044-98ded7f5a401 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] 10.0.0.210 "POST /compute/v2.1/servers/6802f099-9236-4c79-a892-2963f1b15b0e/action" status: 202 len: 0 microversion: 2.1 time: 0.115130 Apr 11 19:28:38 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 148/432] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Apr 11 19:28:38 2023] POST /compute/v2.1/servers/6802f099-9236-4c79-a892-2963f1b15b0e/action => generated 0 bytes in 117 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 19:28:38 user devstack@n-api.service[72088]: DEBUG dbcounter [-] [72088] Writing DB stats nova_cell0:SELECT=4 {{(pid=72088) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:28:38 user devstack@n-api.service[72088]: DEBUG dbcounter [-] [72088] Writing DB stats nova_cell0:SELECT=12 {{(pid=72088) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:28:38 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [None req-9ef4b1aa-2d92-4f5e-98fc-cc87779173c6 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Calling method '>' {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:28:38 user devstack@n-api.service[72088]: DEBUG nova.compute.api [None req-9ef4b1aa-2d92-4f5e-98fc-cc87779173c6 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] [instance: 6802f099-9236-4c79-a892-2963f1b15b0e] Fetching instance by UUID {{(pid=72088) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:28:38 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-9ef4b1aa-2d92-4f5e-98fc-cc87779173c6 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:28:38 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-9ef4b1aa-2d92-4f5e-98fc-cc87779173c6 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:28:38 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-9ef4b1aa-2d92-4f5e-98fc-cc87779173c6 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:28:38 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-9ef4b1aa-2d92-4f5e-98fc-cc87779173c6 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:28:38 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-9ef4b1aa-2d92-4f5e-98fc-cc87779173c6 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:28:38 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-9ef4b1aa-2d92-4f5e-98fc-cc87779173c6 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:28:38 user devstack@n-api.service[72088]: DEBUG nova.policy [None req-9ef4b1aa-2d92-4f5e-98fc-cc87779173c6 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31c237e142784bd6aa460d6f1bf33400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd886d2ec5fc946b49af3c8ca7c8556c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72088) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:28:38 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [None req-9ef4b1aa-2d92-4f5e-98fc-cc87779173c6 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6802f099-9236-4c79-a892-2963f1b15b0e" status: 200 len: 1699 microversion: 2.1 time: 0.162681 Apr 11 19:28:38 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 143/433] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 19:28:38 2023] GET /compute/v2.1/servers/6802f099-9236-4c79-a892-2963f1b15b0e => generated 1699 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:28:40 user devstack@n-api.service[72090]: DEBUG dbcounter [-] [72090] Writing DB stats nova_cell0:SELECT=4 {{(pid=72090) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:28:40 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [req-ea05dd9c-67f3-48c8-bcd7-4c7e817d331b req-9efa4a5c-a188-49e4-8fda-2eb2a75fbf55 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "864fcd9b-8e5b-4de8-a2e6-292a8907a834", "name": "network-vif-plugged", "status": "completed", "tag": "60f272b0-f7d2-408b-b99b-9bcfcd3f23ff"}]} {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:28:40 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-ea05dd9c-67f3-48c8-bcd7-4c7e817d331b req-9efa4a5c-a188-49e4-8fda-2eb2a75fbf55 service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:28:40 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-ea05dd9c-67f3-48c8-bcd7-4c7e817d331b req-9efa4a5c-a188-49e4-8fda-2eb2a75fbf55 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:28:40 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-ea05dd9c-67f3-48c8-bcd7-4c7e817d331b req-9efa4a5c-a188-49e4-8fda-2eb2a75fbf55 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:28:40 user devstack@n-api.service[72090]: INFO nova.api.openstack.compute.server_external_events [req-ea05dd9c-67f3-48c8-bcd7-4c7e817d331b req-9efa4a5c-a188-49e4-8fda-2eb2a75fbf55 service nova] Creating event network-vif-plugged:60f272b0-f7d2-408b-b99b-9bcfcd3f23ff for instance 864fcd9b-8e5b-4de8-a2e6-292a8907a834 on user Apr 11 19:28:40 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [req-ea05dd9c-67f3-48c8-bcd7-4c7e817d331b req-9efa4a5c-a188-49e4-8fda-2eb2a75fbf55 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033200 Apr 11 19:28:40 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 143/434] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:28:40 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:28:41 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [None req-fdd4c970-ac89-44d0-9188-591f7d94640d tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Calling method '>' {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:28:41 user devstack@n-api.service[72089]: DEBUG nova.compute.api [None req-fdd4c970-ac89-44d0-9188-591f7d94640d tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] [instance: 647674d8-af53-405a-8116-4b7a01549bdf] Fetching instance by UUID {{(pid=72089) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:28:41 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-fdd4c970-ac89-44d0-9188-591f7d94640d tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:28:41 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-fdd4c970-ac89-44d0-9188-591f7d94640d tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:28:41 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-fdd4c970-ac89-44d0-9188-591f7d94640d tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:28:41 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-fdd4c970-ac89-44d0-9188-591f7d94640d tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:28:41 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-fdd4c970-ac89-44d0-9188-591f7d94640d tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:28:41 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-fdd4c970-ac89-44d0-9188-591f7d94640d tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:28:41 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [None req-fdd4c970-ac89-44d0-9188-591f7d94640d tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] 10.0.0.210 "GET /compute/v2.1/servers/647674d8-af53-405a-8116-4b7a01549bdf/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.088476 Apr 11 19:28:41 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 149/435] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Apr 11 19:28:41 2023] GET /compute/v2.1/servers/647674d8-af53-405a-8116-4b7a01549bdf/os-interface => generated 283 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:28:42 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [req-a6c7fafc-de76-4212-b635-640ea1294593 req-73935045-1783-40ed-8a29-93ddbd881783 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "647674d8-af53-405a-8116-4b7a01549bdf", "tag": "e4e4888a-168a-4fe8-a43e-ee683b50a39a"}]} {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:28:42 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-a6c7fafc-de76-4212-b635-640ea1294593 req-73935045-1783-40ed-8a29-93ddbd881783 service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:28:42 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-a6c7fafc-de76-4212-b635-640ea1294593 req-73935045-1783-40ed-8a29-93ddbd881783 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:28:42 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-a6c7fafc-de76-4212-b635-640ea1294593 req-73935045-1783-40ed-8a29-93ddbd881783 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:28:42 user devstack@n-api.service[72088]: INFO nova.api.openstack.compute.server_external_events [req-a6c7fafc-de76-4212-b635-640ea1294593 req-73935045-1783-40ed-8a29-93ddbd881783 service nova] Creating event network-changed:e4e4888a-168a-4fe8-a43e-ee683b50a39a for instance 647674d8-af53-405a-8116-4b7a01549bdf on user Apr 11 19:28:42 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [req-a6c7fafc-de76-4212-b635-640ea1294593 req-73935045-1783-40ed-8a29-93ddbd881783 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033340 Apr 11 19:28:42 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 144/436] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:28:42 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:28:42 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [None req-c9f730d4-ff95-4de8-97a1-b9d3211cdfb8 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Calling method '>' {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:28:42 user devstack@n-api.service[72090]: DEBUG nova.compute.api [None req-c9f730d4-ff95-4de8-97a1-b9d3211cdfb8 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] [instance: 647674d8-af53-405a-8116-4b7a01549bdf] Fetching instance by UUID {{(pid=72090) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:28:42 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-c9f730d4-ff95-4de8-97a1-b9d3211cdfb8 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:28:42 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-c9f730d4-ff95-4de8-97a1-b9d3211cdfb8 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:28:42 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-c9f730d4-ff95-4de8-97a1-b9d3211cdfb8 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:28:42 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-c9f730d4-ff95-4de8-97a1-b9d3211cdfb8 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:28:42 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-c9f730d4-ff95-4de8-97a1-b9d3211cdfb8 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:28:42 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-c9f730d4-ff95-4de8-97a1-b9d3211cdfb8 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:28:42 user devstack@n-api.service[72090]: DEBUG nova.policy [None req-c9f730d4-ff95-4de8-97a1-b9d3211cdfb8 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05fb551c320a48f98a4ec00a7f7492d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60a7381a31b84e97a068528f90813773', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72090) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:28:42 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [None req-c9f730d4-ff95-4de8-97a1-b9d3211cdfb8 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] 10.0.0.210 "GET /compute/v2.1/servers/647674d8-af53-405a-8116-4b7a01549bdf" status: 200 len: 1538 microversion: 2.1 time: 0.152953 Apr 11 19:28:42 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 144/437] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 19:28:42 2023] GET /compute/v2.1/servers/647674d8-af53-405a-8116-4b7a01549bdf => generated 1538 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:28:42 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [None req-b5bab650-d2e7-4c68-af58-234a8ffea790 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Calling method '>' {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:28:42 user devstack@n-api.service[72089]: DEBUG nova.compute.api [None req-b5bab650-d2e7-4c68-af58-234a8ffea790 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] [instance: 647674d8-af53-405a-8116-4b7a01549bdf] Fetching instance by UUID {{(pid=72089) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:28:42 user devstack@n-api.service[72089]: DEBUG dbcounter [-] [72089] Writing DB stats nova_api:SELECT=28,nova_api:INSERT=1 {{(pid=72089) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:28:42 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-b5bab650-d2e7-4c68-af58-234a8ffea790 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:28:42 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-b5bab650-d2e7-4c68-af58-234a8ffea790 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:28:42 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-b5bab650-d2e7-4c68-af58-234a8ffea790 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:28:42 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-b5bab650-d2e7-4c68-af58-234a8ffea790 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:28:42 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-b5bab650-d2e7-4c68-af58-234a8ffea790 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:28:42 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-b5bab650-d2e7-4c68-af58-234a8ffea790 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:28:42 user devstack@n-api.service[72089]: DEBUG dbcounter [-] [72089] Writing DB stats nova_cell1:SELECT=48,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=72089) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:28:42 user devstack@n-api.service[72089]: DEBUG nova.policy [None req-b5bab650-d2e7-4c68-af58-234a8ffea790 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05fb551c320a48f98a4ec00a7f7492d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60a7381a31b84e97a068528f90813773', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72089) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:28:42 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [None req-b5bab650-d2e7-4c68-af58-234a8ffea790 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] 10.0.0.210 "GET /compute/v2.1/servers/647674d8-af53-405a-8116-4b7a01549bdf" status: 200 len: 1538 microversion: 2.1 time: 0.258446 Apr 11 19:28:42 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 150/438] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 19:28:42 2023] GET /compute/v2.1/servers/647674d8-af53-405a-8116-4b7a01549bdf => generated 1538 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:28:42 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [req-c87a6fad-a4e1-481b-9ca6-7f93e8335015 req-10a7c2fc-d8d9-4035-821a-c8668562929e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "864fcd9b-8e5b-4de8-a2e6-292a8907a834", "name": "network-vif-plugged", "status": "completed", "tag": "60f272b0-f7d2-408b-b99b-9bcfcd3f23ff"}]} {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:28:42 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-c87a6fad-a4e1-481b-9ca6-7f93e8335015 req-10a7c2fc-d8d9-4035-821a-c8668562929e service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:28:42 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-c87a6fad-a4e1-481b-9ca6-7f93e8335015 req-10a7c2fc-d8d9-4035-821a-c8668562929e service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:28:42 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-c87a6fad-a4e1-481b-9ca6-7f93e8335015 req-10a7c2fc-d8d9-4035-821a-c8668562929e service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:28:43 user devstack@n-api.service[72088]: INFO nova.api.openstack.compute.server_external_events [req-c87a6fad-a4e1-481b-9ca6-7f93e8335015 req-10a7c2fc-d8d9-4035-821a-c8668562929e service nova] Creating event network-vif-plugged:60f272b0-f7d2-408b-b99b-9bcfcd3f23ff for instance 864fcd9b-8e5b-4de8-a2e6-292a8907a834 on user Apr 11 19:28:43 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [req-c87a6fad-a4e1-481b-9ca6-7f93e8335015 req-10a7c2fc-d8d9-4035-821a-c8668562929e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093416 Apr 11 19:28:43 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 145/439] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:28:42 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:28:44 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [None req-78492845-45ca-4877-ac48-ecc9be6810a6 tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] Calling method '>' {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:28:44 user devstack@n-api.service[72090]: DEBUG nova.compute.api [None req-78492845-45ca-4877-ac48-ecc9be6810a6 tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] [instance: 9941d033-15c2-4069-b9a6-f80840e95a38] Fetching instance by UUID {{(pid=72090) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:28:44 user devstack@n-api.service[72090]: DEBUG dbcounter [-] [72090] Writing DB stats nova_api:SELECT=26,nova_api:DELETE=1 {{(pid=72090) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:28:44 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-78492845-45ca-4877-ac48-ecc9be6810a6 tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:28:44 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-78492845-45ca-4877-ac48-ecc9be6810a6 tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:28:44 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-78492845-45ca-4877-ac48-ecc9be6810a6 tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:28:44 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-78492845-45ca-4877-ac48-ecc9be6810a6 tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:28:44 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-78492845-45ca-4877-ac48-ecc9be6810a6 tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:28:44 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-78492845-45ca-4877-ac48-ecc9be6810a6 tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:28:44 user devstack@n-api.service[72090]: DEBUG dbcounter [-] [72090] Writing DB stats nova_cell1:SELECT=17 {{(pid=72090) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:28:44 user devstack@n-api.service[72090]: INFO nova.api.openstack.wsgi [None req-78492845-45ca-4877-ac48-ecc9be6810a6 tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] HTTP exception thrown: Instance 9941d033-15c2-4069-b9a6-f80840e95a38 could not be found. Apr 11 19:28:44 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [None req-78492845-45ca-4877-ac48-ecc9be6810a6 tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] Request method failure captured: Apr 11 19:28:44 user devstack@n-api.service[72090]: request: GET /compute/v2.1/servers/9941d033-15c2-4069-b9a6-f80840e95a38 HTTP/1.1 Apr 11 19:28:44 user devstack@n-api.service[72090]: Accept: application/json Apr 11 19:28:44 user devstack@n-api.service[72090]: Accept-Encoding: identity Apr 11 19:28:44 user devstack@n-api.service[72090]: Connection: close Apr 11 19:28:44 user devstack@n-api.service[72090]: Content-Length: 0 Apr 11 19:28:44 user devstack@n-api.service[72090]: Content-Type: application/json Apr 11 19:28:44 user devstack@n-api.service[72090]: Host: 10.0.0.210 Apr 11 19:28:44 user devstack@n-api.service[72090]: Openstack-System-Scope: None Apr 11 19:28:44 user devstack@n-api.service[72090]: User-Agent: python-urllib3/1.26.15 Apr 11 19:28:44 user devstack@n-api.service[72090]: X-Auth-Token: gAAAAABkNbNIE1hvjNylQegbrNw45pSfdo-34pgb_xwbAMt6-K8u7ip8VALOzQp-LTfmOsIxGEXav7XpdztLmMLa-gLQ1EJabTxBdl4KqGNKMlGTJ7qj666StYT9PeGkP7m_OvL1IyzQJofX8M44yuPP0JiV8yRZFlbzZEL6xekDsrvkTouUXPo Apr 11 19:28:44 user devstack@n-api.service[72090]: X-Domain-Id: None Apr 11 19:28:44 user devstack@n-api.service[72090]: X-Domain-Name: None Apr 11 19:28:44 user devstack@n-api.service[72090]: X-Identity-Status: Confirmed Apr 11 19:28:44 user devstack@n-api.service[72090]: X-Is-Admin-Project: True Apr 11 19:28:44 user devstack@n-api.service[72090]: X-Project-Domain-Id: default Apr 11 19:28:44 user devstack@n-api.service[72090]: X-Project-Domain-Name: Default Apr 11 19:28:44 user devstack@n-api.service[72090]: X-Project-Id: f153e6b272924b8fa0ef28fb5f0970bb Apr 11 19:28:44 user devstack@n-api.service[72090]: X-Project-Name: tempest-VolumesAdminNegativeTest-1308264816 Apr 11 19:28:44 user devstack@n-api.service[72090]: X-Role: reader,member Apr 11 19:28:44 user devstack@n-api.service[72090]: X-Roles: reader,member Apr 11 19:28:44 user devstack@n-api.service[72090]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f153e6b272924b8fa0ef28fb5f0970bb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/f153e6b272924b8fa0ef28fb5f0970bb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f153e6b272924b8fa0ef28fb5f0970bb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 11 19:28:44 user devstack@n-api.service[72090]: X-Tenant: tempest-VolumesAdminNegativeTest-1308264816 Apr 11 19:28:44 user devstack@n-api.service[72090]: X-Tenant-Id: f153e6b272924b8fa0ef28fb5f0970bb Apr 11 19:28:44 user devstack@n-api.service[72090]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1308264816 Apr 11 19:28:44 user devstack@n-api.service[72090]: X-User: tempest-VolumesAdminNegativeTest-1308264816-project-member Apr 11 19:28:44 user devstack@n-api.service[72090]: X-User-Domain-Id: default Apr 11 19:28:44 user devstack@n-api.service[72090]: X-User-Domain-Name: Default Apr 11 19:28:44 user devstack@n-api.service[72090]: X-User-Id: 54b4a383f04d4269a0099a738e14807e Apr 11 19:28:44 user devstack@n-api.service[72090]: X-User-Name: tempest-VolumesAdminNegativeTest-1308264816-project-member Apr 11 19:28:44 user devstack@n-api.service[72090]: method: > Apr 11 19:28:44 user devstack@n-api.service[72090]: exception: Instance 9941d033-15c2-4069-b9a6-f80840e95a38 could not be found. Apr 11 19:28:44 user devstack@n-api.service[72090]: action_args: {'id': '9941d033-15c2-4069-b9a6-f80840e95a38'} Apr 11 19:28:44 user devstack@n-api.service[72090]: {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 19:28:44 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:28:44 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 19:28:44 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 19:28:44 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 19:28:44 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 19:28:44 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 19:28:44 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 19:28:44 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 19:28:44 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 19:28:44 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9941d033-15c2-4069-b9a6-f80840e95a38 could not be found. Apr 11 19:28:44 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi Apr 11 19:28:44 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 19:28:44 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi Apr 11 19:28:44 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:28:44 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 19:28:44 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 19:28:44 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 19:28:44 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 19:28:44 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 19:28:44 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 19:28:44 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 19:28:44 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 19:28:44 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 19:28:44 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 19:28:44 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 19:28:44 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 19:28:44 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9941d033-15c2-4069-b9a6-f80840e95a38 could not be found. Apr 11 19:28:44 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi Apr 11 19:28:44 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 19:28:44 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi Apr 11 19:28:44 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:28:44 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 19:28:44 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 19:28:44 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 19:28:44 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 19:28:44 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9941d033-15c2-4069-b9a6-f80840e95a38 could not be found. Apr 11 19:28:44 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi Apr 11 19:28:44 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [None req-78492845-45ca-4877-ac48-ecc9be6810a6 tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] Returning 404 to user: Instance 9941d033-15c2-4069-b9a6-f80840e95a38 could not be found. {{(pid=72090) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 19:28:44 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [None req-78492845-45ca-4877-ac48-ecc9be6810a6 tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9941d033-15c2-4069-b9a6-f80840e95a38" status: 404 len: 111 microversion: 2.1 time: 0.055249 Apr 11 19:28:44 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 145/440] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 19:28:44 2023] GET /compute/v2.1/servers/9941d033-15c2-4069-b9a6-f80840e95a38 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 19:28:44 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [None req-4d55bd85-8ed6-4cf3-bd24-34d09a121d90 tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] Calling method '.version_select at 0x7f119dbe95a0>' {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:28:44 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [None req-4d55bd85-8ed6-4cf3-bd24-34d09a121d90 tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-837441637" status: 202 len: 0 microversion: 2.1 time: 0.026956 Apr 11 19:28:44 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 151/441] 10.0.0.210 () {62 vars in 1295 bytes} [Tue Apr 11 19:28:44 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-837441637 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 19:28:44 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [None req-645db58a-2e8e-42a5-a125-77a186087aec tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] Calling method '>' {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:28:44 user devstack@n-api.service[72088]: DEBUG nova.compute.api [None req-645db58a-2e8e-42a5-a125-77a186087aec tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] [instance: aa0bb9aa-a93d-45bc-9f90-46eeb6416365] Fetching instance by UUID {{(pid=72088) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:28:44 user devstack@n-api.service[72088]: DEBUG dbcounter [-] [72088] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=6 {{(pid=72088) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:28:44 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-645db58a-2e8e-42a5-a125-77a186087aec tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:28:44 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-645db58a-2e8e-42a5-a125-77a186087aec tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:28:44 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-645db58a-2e8e-42a5-a125-77a186087aec tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:28:44 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-645db58a-2e8e-42a5-a125-77a186087aec tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:28:44 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-645db58a-2e8e-42a5-a125-77a186087aec tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:28:44 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-645db58a-2e8e-42a5-a125-77a186087aec tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:28:44 user devstack@n-api.service[72088]: DEBUG dbcounter [-] [72088] Writing DB stats nova_cell1:SELECT=27 {{(pid=72088) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:28:44 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [None req-645db58a-2e8e-42a5-a125-77a186087aec tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] 10.0.0.210 "GET /compute/v2.1/servers/aa0bb9aa-a93d-45bc-9f90-46eeb6416365/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050146 Apr 11 19:28:44 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 146/442] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Apr 11 19:28:44 2023] GET /compute/v2.1/servers/aa0bb9aa-a93d-45bc-9f90-46eeb6416365/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 11 19:28:45 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [None req-3564b031-781a-4292-8ff6-f0bf6530228e tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] Calling method '.version_select at 0x7f119db6be20>' {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:28:46 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [None req-3564b031-781a-4292-8ff6-f0bf6530228e tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] 10.0.0.210 "DELETE /compute/v2.1/images/6a269858-cd4f-452f-ae3e-e35cf198749c" status: 204 len: 0 microversion: 2.1 time: 0.237619 Apr 11 19:28:46 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 146/443] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 19:28:45 2023] DELETE /compute/v2.1/images/6a269858-cd4f-452f-ae3e-e35cf198749c => generated 0 bytes in 239 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 11 19:28:46 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [None req-d9d2736e-0ff3-428a-82f2-d0542c00eb7f tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Calling method '>' {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:28:46 user devstack@n-api.service[72089]: DEBUG nova.compute.api [None req-d9d2736e-0ff3-428a-82f2-d0542c00eb7f tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] [instance: f37ed08c-8c9a-4af7-ba5f-b8a942e54389] Fetching instance by UUID {{(pid=72089) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:28:46 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [None req-b1c7d88f-38fb-4306-a47b-9395fb550cb2 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] Calling method '>' {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:28:46 user devstack@n-api.service[72088]: DEBUG nova.compute.api [None req-b1c7d88f-38fb-4306-a47b-9395fb550cb2 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] [instance: aa0bb9aa-a93d-45bc-9f90-46eeb6416365] Fetching instance by UUID {{(pid=72088) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:28:46 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-d9d2736e-0ff3-428a-82f2-d0542c00eb7f tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:28:46 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-d9d2736e-0ff3-428a-82f2-d0542c00eb7f tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:28:46 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-d9d2736e-0ff3-428a-82f2-d0542c00eb7f tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:28:46 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-d9d2736e-0ff3-428a-82f2-d0542c00eb7f tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:28:46 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-b1c7d88f-38fb-4306-a47b-9395fb550cb2 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:28:46 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-d9d2736e-0ff3-428a-82f2-d0542c00eb7f tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:28:46 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-b1c7d88f-38fb-4306-a47b-9395fb550cb2 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:28:46 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-d9d2736e-0ff3-428a-82f2-d0542c00eb7f tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:28:46 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-b1c7d88f-38fb-4306-a47b-9395fb550cb2 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:28:46 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-b1c7d88f-38fb-4306-a47b-9395fb550cb2 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:28:46 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-b1c7d88f-38fb-4306-a47b-9395fb550cb2 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:28:46 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-b1c7d88f-38fb-4306-a47b-9395fb550cb2 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:28:46 user devstack@n-api.service[72088]: DEBUG nova.compute.api [None req-b1c7d88f-38fb-4306-a47b-9395fb550cb2 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] [instance: aa0bb9aa-a93d-45bc-9f90-46eeb6416365] Going to try to terminate instance {{(pid=72088) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 11 19:28:46 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [None req-d9d2736e-0ff3-428a-82f2-d0542c00eb7f tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f37ed08c-8c9a-4af7-ba5f-b8a942e54389/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.051200 Apr 11 19:28:46 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 152/444] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Apr 11 19:28:46 2023] GET /compute/v2.1/servers/f37ed08c-8c9a-4af7-ba5f-b8a942e54389/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 11 19:28:46 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [None req-b1c7d88f-38fb-4306-a47b-9395fb550cb2 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/aa0bb9aa-a93d-45bc-9f90-46eeb6416365" status: 204 len: 0 microversion: 2.1 time: 0.133650 Apr 11 19:28:46 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 147/445] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 19:28:46 2023] DELETE /compute/v2.1/servers/aa0bb9aa-a93d-45bc-9f90-46eeb6416365 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 11 19:28:46 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [None req-b71c1ba4-c059-4943-acfd-316218a00970 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] Calling method '>' {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:28:46 user devstack@n-api.service[72090]: DEBUG nova.compute.api [None req-b71c1ba4-c059-4943-acfd-316218a00970 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] [instance: aa0bb9aa-a93d-45bc-9f90-46eeb6416365] Fetching instance by UUID {{(pid=72090) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:28:46 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-b71c1ba4-c059-4943-acfd-316218a00970 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:28:46 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-b71c1ba4-c059-4943-acfd-316218a00970 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:28:46 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-b71c1ba4-c059-4943-acfd-316218a00970 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:28:46 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-b71c1ba4-c059-4943-acfd-316218a00970 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:28:46 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-b71c1ba4-c059-4943-acfd-316218a00970 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:28:46 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-b71c1ba4-c059-4943-acfd-316218a00970 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:28:46 user devstack@n-api.service[72090]: DEBUG nova.policy [None req-b71c1ba4-c059-4943-acfd-316218a00970 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26f091a1508b4d2689005b660f6a1380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ee7c68b277420ba524c2a99cd444ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72090) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:28:46 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [None req-b71c1ba4-c059-4943-acfd-316218a00970 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] 10.0.0.210 "GET /compute/v2.1/servers/aa0bb9aa-a93d-45bc-9f90-46eeb6416365" status: 200 len: 1677 microversion: 2.1 time: 0.200711 Apr 11 19:28:46 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 147/446] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 19:28:46 2023] GET /compute/v2.1/servers/aa0bb9aa-a93d-45bc-9f90-46eeb6416365 => generated 1677 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:28:46 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [req-e323e1df-e033-4c0e-b7d8-901491175e23 req-b63837ea-7926-40d7-ac80-8b238883fa92 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa0bb9aa-a93d-45bc-9f90-46eeb6416365", "name": "network-vif-unplugged", "status": "completed", "tag": "5a15e207-1839-4be5-80b2-fc995098dbbf"}]} {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:28:46 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-e323e1df-e033-4c0e-b7d8-901491175e23 req-b63837ea-7926-40d7-ac80-8b238883fa92 service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:28:46 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-e323e1df-e033-4c0e-b7d8-901491175e23 req-b63837ea-7926-40d7-ac80-8b238883fa92 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:28:46 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-e323e1df-e033-4c0e-b7d8-901491175e23 req-b63837ea-7926-40d7-ac80-8b238883fa92 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:28:46 user devstack@n-api.service[72089]: INFO nova.api.openstack.compute.server_external_events [req-e323e1df-e033-4c0e-b7d8-901491175e23 req-b63837ea-7926-40d7-ac80-8b238883fa92 service nova] Creating event network-vif-unplugged:5a15e207-1839-4be5-80b2-fc995098dbbf for instance aa0bb9aa-a93d-45bc-9f90-46eeb6416365 on user Apr 11 19:28:46 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [req-e323e1df-e033-4c0e-b7d8-901491175e23 req-b63837ea-7926-40d7-ac80-8b238883fa92 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030265 Apr 11 19:28:46 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 153/447] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:28:46 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:28:46 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [None req-cfcd89ca-e290-4ba7-9ffd-7937aac48bba tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Calling method '>' {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:28:46 user devstack@n-api.service[72088]: DEBUG nova.compute.api [None req-cfcd89ca-e290-4ba7-9ffd-7937aac48bba tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] [instance: f37ed08c-8c9a-4af7-ba5f-b8a942e54389] Fetching instance by UUID {{(pid=72088) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:28:46 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-cfcd89ca-e290-4ba7-9ffd-7937aac48bba tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:28:46 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-cfcd89ca-e290-4ba7-9ffd-7937aac48bba tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:28:46 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-cfcd89ca-e290-4ba7-9ffd-7937aac48bba tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:28:46 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-cfcd89ca-e290-4ba7-9ffd-7937aac48bba tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:28:46 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-cfcd89ca-e290-4ba7-9ffd-7937aac48bba tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:28:46 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-cfcd89ca-e290-4ba7-9ffd-7937aac48bba tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:28:46 user devstack@n-api.service[72088]: DEBUG nova.compute.api [None req-cfcd89ca-e290-4ba7-9ffd-7937aac48bba tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] [instance: f37ed08c-8c9a-4af7-ba5f-b8a942e54389] Going to try to terminate instance {{(pid=72088) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 11 19:28:47 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [None req-cfcd89ca-e290-4ba7-9ffd-7937aac48bba tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/f37ed08c-8c9a-4af7-ba5f-b8a942e54389" status: 204 len: 0 microversion: 2.1 time: 0.138064 Apr 11 19:28:47 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 148/448] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 19:28:46 2023] DELETE /compute/v2.1/servers/f37ed08c-8c9a-4af7-ba5f-b8a942e54389 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Apr 11 19:28:47 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [None req-8e5d8bfa-ba36-4166-bd16-95a22c60958b tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Calling method '>' {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:28:47 user devstack@n-api.service[72090]: DEBUG nova.compute.api [None req-8e5d8bfa-ba36-4166-bd16-95a22c60958b tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] [instance: f37ed08c-8c9a-4af7-ba5f-b8a942e54389] Fetching instance by UUID {{(pid=72090) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:28:47 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-8e5d8bfa-ba36-4166-bd16-95a22c60958b tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:28:47 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-8e5d8bfa-ba36-4166-bd16-95a22c60958b tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:28:47 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-8e5d8bfa-ba36-4166-bd16-95a22c60958b tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:28:47 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-8e5d8bfa-ba36-4166-bd16-95a22c60958b tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:28:47 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-8e5d8bfa-ba36-4166-bd16-95a22c60958b tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:28:47 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-8e5d8bfa-ba36-4166-bd16-95a22c60958b tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:28:48 user devstack@n-api.service[72090]: DEBUG nova.policy [None req-8e5d8bfa-ba36-4166-bd16-95a22c60958b tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a32a5d0547141a180f655e98567ed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bceca6e3506e43f68f9cf8d0b56d141b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72090) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:28:48 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [None req-8e5d8bfa-ba36-4166-bd16-95a22c60958b tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f37ed08c-8c9a-4af7-ba5f-b8a942e54389" status: 200 len: 1662 microversion: 2.1 time: 1.150736 Apr 11 19:28:48 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 148/449] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 19:28:47 2023] GET /compute/v2.1/servers/f37ed08c-8c9a-4af7-ba5f-b8a942e54389 => generated 1662 bytes in 1153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:28:48 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [req-374cbf31-86bb-4cc1-89b0-9ab965b78e8e req-3abd8b6d-599e-405a-9886-0b43ec13173e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f37ed08c-8c9a-4af7-ba5f-b8a942e54389", "name": "network-vif-unplugged", "status": "completed", "tag": "77bd0f58-75d0-4cc3-ab98-4f4b31401482"}]} {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:28:48 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-374cbf31-86bb-4cc1-89b0-9ab965b78e8e req-3abd8b6d-599e-405a-9886-0b43ec13173e service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:28:48 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-374cbf31-86bb-4cc1-89b0-9ab965b78e8e req-3abd8b6d-599e-405a-9886-0b43ec13173e service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:28:48 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-374cbf31-86bb-4cc1-89b0-9ab965b78e8e req-3abd8b6d-599e-405a-9886-0b43ec13173e service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:28:48 user devstack@n-api.service[72089]: INFO nova.api.openstack.compute.server_external_events [req-374cbf31-86bb-4cc1-89b0-9ab965b78e8e req-3abd8b6d-599e-405a-9886-0b43ec13173e service nova] Creating event network-vif-unplugged:77bd0f58-75d0-4cc3-ab98-4f4b31401482 for instance f37ed08c-8c9a-4af7-ba5f-b8a942e54389 on user Apr 11 19:28:48 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [req-374cbf31-86bb-4cc1-89b0-9ab965b78e8e req-3abd8b6d-599e-405a-9886-0b43ec13173e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031676 Apr 11 19:28:48 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 154/450] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:28:48 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 11 19:28:48 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [req-95f22689-c73f-4eee-913b-2da0d8691755 req-17bbe51e-3cac-465e-8ced-16c814dd81ca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f37ed08c-8c9a-4af7-ba5f-b8a942e54389", "tag": "77bd0f58-75d0-4cc3-ab98-4f4b31401482"}, {"server_uuid": "aa0bb9aa-a93d-45bc-9f90-46eeb6416365", "name": "network-vif-plugged", "status": "completed", "tag": "5a15e207-1839-4be5-80b2-fc995098dbbf"}, {"server_uuid": "6802f099-9236-4c79-a892-2963f1b15b0e", "name": "network-vif-plugged", "status": "completed", "tag": "6193819b-0c1b-476b-b89e-dbbfc7938fc5"}, {"server_uuid": "6802f099-9236-4c79-a892-2963f1b15b0e", "name": "network-vif-plugged", "status": "completed", "tag": "6193819b-0c1b-476b-b89e-dbbfc7938fc5"}, {"server_uuid": "aa0bb9aa-a93d-45bc-9f90-46eeb6416365", "name": "network-vif-deleted", "tag": "5a15e207-1839-4be5-80b2-fc995098dbbf"}]} {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:28:48 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-95f22689-c73f-4eee-913b-2da0d8691755 req-17bbe51e-3cac-465e-8ced-16c814dd81ca service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:28:48 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-95f22689-c73f-4eee-913b-2da0d8691755 req-17bbe51e-3cac-465e-8ced-16c814dd81ca service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:28:48 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-95f22689-c73f-4eee-913b-2da0d8691755 req-17bbe51e-3cac-465e-8ced-16c814dd81ca service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:28:48 user devstack@n-api.service[72088]: INFO nova.api.openstack.compute.server_external_events [req-95f22689-c73f-4eee-913b-2da0d8691755 req-17bbe51e-3cac-465e-8ced-16c814dd81ca service nova] Creating event network-changed:77bd0f58-75d0-4cc3-ab98-4f4b31401482 for instance f37ed08c-8c9a-4af7-ba5f-b8a942e54389 on user Apr 11 19:28:48 user devstack@n-api.service[72088]: INFO nova.api.openstack.compute.server_external_events [req-95f22689-c73f-4eee-913b-2da0d8691755 req-17bbe51e-3cac-465e-8ced-16c814dd81ca service nova] Creating event network-vif-plugged:5a15e207-1839-4be5-80b2-fc995098dbbf for instance aa0bb9aa-a93d-45bc-9f90-46eeb6416365 on user Apr 11 19:28:48 user devstack@n-api.service[72088]: INFO nova.api.openstack.compute.server_external_events [req-95f22689-c73f-4eee-913b-2da0d8691755 req-17bbe51e-3cac-465e-8ced-16c814dd81ca service nova] Creating event network-vif-plugged:6193819b-0c1b-476b-b89e-dbbfc7938fc5 for instance 6802f099-9236-4c79-a892-2963f1b15b0e on user Apr 11 19:28:48 user devstack@n-api.service[72088]: INFO nova.api.openstack.compute.server_external_events [req-95f22689-c73f-4eee-913b-2da0d8691755 req-17bbe51e-3cac-465e-8ced-16c814dd81ca service nova] Creating event network-vif-plugged:6193819b-0c1b-476b-b89e-dbbfc7938fc5 for instance 6802f099-9236-4c79-a892-2963f1b15b0e on user Apr 11 19:28:48 user devstack@n-api.service[72088]: INFO nova.api.openstack.compute.server_external_events [req-95f22689-c73f-4eee-913b-2da0d8691755 req-17bbe51e-3cac-465e-8ced-16c814dd81ca service nova] Creating event network-vif-deleted:5a15e207-1839-4be5-80b2-fc995098dbbf for instance aa0bb9aa-a93d-45bc-9f90-46eeb6416365 on user Apr 11 19:28:48 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [req-95f22689-c73f-4eee-913b-2da0d8691755 req-17bbe51e-3cac-465e-8ced-16c814dd81ca service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 863 microversion: 2.1 time: 0.042958 Apr 11 19:28:48 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 149/451] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:28:48 2023] POST /compute/v2.1/os-server-external-events => generated 863 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 11 19:28:50 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [req-29c48184-d60d-4774-805e-7f410a513b37 req-f3cf5331-d6a2-480c-9858-364f8c227759 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f37ed08c-8c9a-4af7-ba5f-b8a942e54389", "name": "network-vif-plugged", "status": "completed", "tag": "77bd0f58-75d0-4cc3-ab98-4f4b31401482"}, {"server_uuid": "f37ed08c-8c9a-4af7-ba5f-b8a942e54389", "name": "network-vif-deleted", "tag": "77bd0f58-75d0-4cc3-ab98-4f4b31401482"}]} {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:28:50 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-29c48184-d60d-4774-805e-7f410a513b37 req-f3cf5331-d6a2-480c-9858-364f8c227759 service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:28:50 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-29c48184-d60d-4774-805e-7f410a513b37 req-f3cf5331-d6a2-480c-9858-364f8c227759 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:28:50 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-29c48184-d60d-4774-805e-7f410a513b37 req-f3cf5331-d6a2-480c-9858-364f8c227759 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:28:50 user devstack@n-api.service[72090]: INFO nova.api.openstack.compute.server_external_events [req-29c48184-d60d-4774-805e-7f410a513b37 req-f3cf5331-d6a2-480c-9858-364f8c227759 service nova] Creating event network-vif-plugged:77bd0f58-75d0-4cc3-ab98-4f4b31401482 for instance f37ed08c-8c9a-4af7-ba5f-b8a942e54389 on user Apr 11 19:28:50 user devstack@n-api.service[72090]: INFO nova.api.openstack.compute.server_external_events [req-29c48184-d60d-4774-805e-7f410a513b37 req-f3cf5331-d6a2-480c-9858-364f8c227759 service nova] Creating event network-vif-deleted:77bd0f58-75d0-4cc3-ab98-4f4b31401482 for instance f37ed08c-8c9a-4af7-ba5f-b8a942e54389 on user Apr 11 19:28:50 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [req-29c48184-d60d-4774-805e-7f410a513b37 req-f3cf5331-d6a2-480c-9858-364f8c227759 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.033911 Apr 11 19:28:50 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 149/452] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:28:50 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:29:07 user devstack@n-api.service[72089]: DEBUG dbcounter [-] [72089] Writing DB stats nova_api:SELECT=10,nova_api:DELETE=1 {{(pid=72089) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:29:07 user devstack@n-api.service[72089]: DEBUG dbcounter [-] [72089] Writing DB stats nova_cell1:SELECT=15 {{(pid=72089) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:29:07 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [None req-fa15e514-90a1-4a81-b409-fc11f3a2a132 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Calling method '>' {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:29:07 user devstack@n-api.service[72089]: DEBUG nova.compute.api [None req-fa15e514-90a1-4a81-b409-fc11f3a2a132 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] [instance: 558100b9-f3ac-47c7-9260-b897b0cae55f] Fetching instance by UUID {{(pid=72089) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:29:07 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-fa15e514-90a1-4a81-b409-fc11f3a2a132 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:29:07 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-fa15e514-90a1-4a81-b409-fc11f3a2a132 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:29:07 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-fa15e514-90a1-4a81-b409-fc11f3a2a132 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:29:07 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-fa15e514-90a1-4a81-b409-fc11f3a2a132 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:29:07 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-fa15e514-90a1-4a81-b409-fc11f3a2a132 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:29:07 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-fa15e514-90a1-4a81-b409-fc11f3a2a132 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:29:07 user devstack@n-api.service[72089]: DEBUG nova.policy [None req-fa15e514-90a1-4a81-b409-fc11f3a2a132 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5d405421ceb4d99967ef2e7f55e7809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06966e2f4d3a4dec92282c7ad348635d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72089) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:29:07 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [None req-fa15e514-90a1-4a81-b409-fc11f3a2a132 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] 10.0.0.210 "GET /compute/v2.1/servers/558100b9-f3ac-47c7-9260-b897b0cae55f" status: 200 len: 1544 microversion: 2.1 time: 0.168876 Apr 11 19:29:07 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 155/453] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 19:29:07 2023] GET /compute/v2.1/servers/558100b9-f3ac-47c7-9260-b897b0cae55f => generated 1544 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:29:09 user devstack@n-api.service[72088]: DEBUG dbcounter [-] [72088] Writing DB stats nova_api:SELECT=17,nova_api:UPDATE=2 {{(pid=72088) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:29:09 user devstack@n-api.service[72088]: DEBUG dbcounter [-] [72088] Writing DB stats nova_cell1:SELECT=37,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=72088) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:29:09 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [None req-3d87739a-d9e7-43fd-af3b-50df459faa58 tempest-VolumesNegativeTest-1402597116 tempest-VolumesNegativeTest-1402597116-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1598011629", "imageRef": "4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b", "flavorRef": "42"}} {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:29:09 user devstack@n-api.service[72088]: DEBUG nova.network.neutron [None req-3d87739a-d9e7-43fd-af3b-50df459faa58 tempest-VolumesNegativeTest-1402597116 tempest-VolumesNegativeTest-1402597116-project-member] validate_networks() for None {{(pid=72088) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 11 19:29:09 user devstack@n-api.service[72088]: DEBUG nova.virt.hardware [None req-3d87739a-d9e7-43fd-af3b-50df459faa58 tempest-VolumesNegativeTest-1402597116 tempest-VolumesNegativeTest-1402597116-project-member] Flavor limits 0:0:0 {{(pid=72088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 19:29:09 user devstack@n-api.service[72088]: DEBUG nova.virt.hardware [None req-3d87739a-d9e7-43fd-af3b-50df459faa58 tempest-VolumesNegativeTest-1402597116 tempest-VolumesNegativeTest-1402597116-project-member] Image limits 0:0:0 {{(pid=72088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 19:29:09 user devstack@n-api.service[72088]: DEBUG nova.virt.hardware [None req-3d87739a-d9e7-43fd-af3b-50df459faa58 tempest-VolumesNegativeTest-1402597116 tempest-VolumesNegativeTest-1402597116-project-member] Flavor pref 0:0:0 {{(pid=72088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 19:29:09 user devstack@n-api.service[72088]: DEBUG nova.virt.hardware [None req-3d87739a-d9e7-43fd-af3b-50df459faa58 tempest-VolumesNegativeTest-1402597116 tempest-VolumesNegativeTest-1402597116-project-member] Image pref 0:0:0 {{(pid=72088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 19:29:09 user devstack@n-api.service[72088]: DEBUG nova.virt.hardware [None req-3d87739a-d9e7-43fd-af3b-50df459faa58 tempest-VolumesNegativeTest-1402597116 tempest-VolumesNegativeTest-1402597116-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 19:29:09 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-3d87739a-d9e7-43fd-af3b-50df459faa58 tempest-VolumesNegativeTest-1402597116 tempest-VolumesNegativeTest-1402597116-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:29:09 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-3d87739a-d9e7-43fd-af3b-50df459faa58 tempest-VolumesNegativeTest-1402597116 tempest-VolumesNegativeTest-1402597116-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:29:09 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-3d87739a-d9e7-43fd-af3b-50df459faa58 tempest-VolumesNegativeTest-1402597116 tempest-VolumesNegativeTest-1402597116-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:29:09 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-3d87739a-d9e7-43fd-af3b-50df459faa58 tempest-VolumesNegativeTest-1402597116 tempest-VolumesNegativeTest-1402597116-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:29:09 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-3d87739a-d9e7-43fd-af3b-50df459faa58 tempest-VolumesNegativeTest-1402597116 tempest-VolumesNegativeTest-1402597116-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:29:09 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-3d87739a-d9e7-43fd-af3b-50df459faa58 tempest-VolumesNegativeTest-1402597116 tempest-VolumesNegativeTest-1402597116-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:29:09 user devstack@n-api.service[72088]: DEBUG nova.quota [None req-3d87739a-d9e7-43fd-af3b-50df459faa58 tempest-VolumesNegativeTest-1402597116 tempest-VolumesNegativeTest-1402597116-project-member] Getting quotas for project e983656394754cf68837587d74f9fbb3. Resources: {'ram', 'instances', 'cores'} {{(pid=72088) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 19:29:09 user devstack@n-api.service[72088]: DEBUG nova.quota [None req-3d87739a-d9e7-43fd-af3b-50df459faa58 tempest-VolumesNegativeTest-1402597116 tempest-VolumesNegativeTest-1402597116-project-member] Getting quotas for user 996881d74ec246f0ac53411a8ca0e7c4 and project e983656394754cf68837587d74f9fbb3. Resources: {'ram', 'instances', 'cores'} {{(pid=72088) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 19:29:09 user devstack@n-api.service[72088]: DEBUG nova.compute.api [None req-3d87739a-d9e7-43fd-af3b-50df459faa58 tempest-VolumesNegativeTest-1402597116 tempest-VolumesNegativeTest-1402597116-project-member] Going to run 1 instances... {{(pid=72088) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 11 19:29:09 user devstack@n-api.service[72088]: DEBUG nova.compute.api [None req-3d87739a-d9e7-43fd-af3b-50df459faa58 tempest-VolumesNegativeTest-1402597116 tempest-VolumesNegativeTest-1402597116-project-member] [instance: 9466c3da-2c99-41ea-9fb4-41ffbaa9910a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=72088) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 11 19:29:09 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [None req-3d87739a-d9e7-43fd-af3b-50df459faa58 tempest-VolumesNegativeTest-1402597116 tempest-VolumesNegativeTest-1402597116-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.458619 Apr 11 19:29:09 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 150/454] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 11 19:29:08 2023] POST /compute/v2.1/servers => generated 378 bytes in 460 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 11 19:29:09 user devstack@n-api.service[72090]: DEBUG dbcounter [-] [72090] Writing DB stats nova_api:SELECT=7 {{(pid=72090) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:29:09 user devstack@n-api.service[72090]: DEBUG dbcounter [-] [72090] Writing DB stats nova_cell1:SELECT=15 {{(pid=72090) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:29:09 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [None req-c1b53c2c-9b40-406d-8b15-8a72b7f06b22 tempest-VolumesNegativeTest-1402597116 tempest-VolumesNegativeTest-1402597116-project-member] Calling method '>' {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:29:09 user devstack@n-api.service[72090]: DEBUG nova.compute.api [None req-c1b53c2c-9b40-406d-8b15-8a72b7f06b22 tempest-VolumesNegativeTest-1402597116 tempest-VolumesNegativeTest-1402597116-project-member] [instance: 9466c3da-2c99-41ea-9fb4-41ffbaa9910a] Fetching instance by UUID {{(pid=72090) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:29:09 user devstack@n-api.service[72090]: DEBUG nova.policy [None req-c1b53c2c-9b40-406d-8b15-8a72b7f06b22 tempest-VolumesNegativeTest-1402597116 tempest-VolumesNegativeTest-1402597116-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '996881d74ec246f0ac53411a8ca0e7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e983656394754cf68837587d74f9fbb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72090) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:29:09 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [None req-c1b53c2c-9b40-406d-8b15-8a72b7f06b22 tempest-VolumesNegativeTest-1402597116 tempest-VolumesNegativeTest-1402597116-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9466c3da-2c99-41ea-9fb4-41ffbaa9910a" status: 200 len: 1209 microversion: 2.1 time: 0.065990 Apr 11 19:29:09 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 150/455] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 19:29:09 2023] GET /compute/v2.1/servers/9466c3da-2c99-41ea-9fb4-41ffbaa9910a => generated 1209 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:29:11 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [req-b23df32d-9586-467b-a410-e1cf962877ec req-bc039218-c1a4-4a62-be71-cb1c38905bcb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9466c3da-2c99-41ea-9fb4-41ffbaa9910a", "tag": "32cb9325-7443-4bd8-ad26-e54700ba6bf4"}]} {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:29:11 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-b23df32d-9586-467b-a410-e1cf962877ec req-bc039218-c1a4-4a62-be71-cb1c38905bcb service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:29:11 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-b23df32d-9586-467b-a410-e1cf962877ec req-bc039218-c1a4-4a62-be71-cb1c38905bcb service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:29:11 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-b23df32d-9586-467b-a410-e1cf962877ec req-bc039218-c1a4-4a62-be71-cb1c38905bcb service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:29:11 user devstack@n-api.service[72089]: INFO nova.api.openstack.compute.server_external_events [req-b23df32d-9586-467b-a410-e1cf962877ec req-bc039218-c1a4-4a62-be71-cb1c38905bcb service nova] Creating event network-changed:32cb9325-7443-4bd8-ad26-e54700ba6bf4 for instance 9466c3da-2c99-41ea-9fb4-41ffbaa9910a on user Apr 11 19:29:11 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [req-b23df32d-9586-467b-a410-e1cf962877ec req-bc039218-c1a4-4a62-be71-cb1c38905bcb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028280 Apr 11 19:29:11 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 156/456] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:29:11 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:29:13 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [None req-a061a8da-c13b-45ab-ae2f-792e1bc5bfa1 tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1850571950", "imageRef": "4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b", "flavorRef": "42", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b", "destination_type": "local"}, {"source_type": "volume", "uuid": "a2e18e49-1de5-4125-93aa-b10061512e20", "destination_type": "invalid"}], "networks": [{"uuid": "b29e55eb-c801-47f0-8cb7-be11e1471261"}]}} {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:29:13 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [None req-a061a8da-c13b-45ab-ae2f-792e1bc5bfa1 tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] Request method failure captured: Apr 11 19:29:13 user devstack@n-api.service[72088]: request: POST /compute/v2.1/servers HTTP/1.1 Apr 11 19:29:13 user devstack@n-api.service[72088]: Accept: application/json Apr 11 19:29:13 user devstack@n-api.service[72088]: Accept-Encoding: identity Apr 11 19:29:13 user devstack@n-api.service[72088]: Connection: close Apr 11 19:29:13 user devstack@n-api.service[72088]: Content-Length: 494 Apr 11 19:29:13 user devstack@n-api.service[72088]: Content-Type: application/json Apr 11 19:29:13 user devstack@n-api.service[72088]: Host: 10.0.0.210 Apr 11 19:29:13 user devstack@n-api.service[72088]: Openstack-System-Scope: None Apr 11 19:29:13 user devstack@n-api.service[72088]: User-Agent: python-urllib3/1.26.15 Apr 11 19:29:13 user devstack@n-api.service[72088]: X-Auth-Token: gAAAAABkNbM9ghjK_EzyGnW10Ps6cv4IuUgiOsH3-4CZQwwhssOT7z-coBiD1Tdn5TLuazoYlNl2MKZxDC8EHQ-1kxF1ymJhDXjVHNMOdUuaIOx6Zld44aVLhO1ciOh-QMlmbYyfhSKlVncwSZpaRu_co_jrVH31BrJgKqwLygUbeq6C-c51jnQ Apr 11 19:29:13 user devstack@n-api.service[72088]: X-Domain-Id: None Apr 11 19:29:13 user devstack@n-api.service[72088]: X-Domain-Name: None Apr 11 19:29:13 user devstack@n-api.service[72088]: X-Identity-Status: Confirmed Apr 11 19:29:13 user devstack@n-api.service[72088]: X-Is-Admin-Project: True Apr 11 19:29:13 user devstack@n-api.service[72088]: X-Project-Domain-Id: default Apr 11 19:29:13 user devstack@n-api.service[72088]: X-Project-Domain-Name: Default Apr 11 19:29:13 user devstack@n-api.service[72088]: X-Project-Id: 0d5d7769df1e4974b295cb30407151dd Apr 11 19:29:13 user devstack@n-api.service[72088]: X-Project-Name: tempest-ServersNegativeTestJSON-1311045721 Apr 11 19:29:13 user devstack@n-api.service[72088]: X-Role: reader,member Apr 11 19:29:13 user devstack@n-api.service[72088]: X-Roles: reader,member Apr 11 19:29:13 user devstack@n-api.service[72088]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0d5d7769df1e4974b295cb30407151dd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/0d5d7769df1e4974b295cb30407151dd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0d5d7769df1e4974b295cb30407151dd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 11 19:29:13 user devstack@n-api.service[72088]: X-Tenant: tempest-ServersNegativeTestJSON-1311045721 Apr 11 19:29:13 user devstack@n-api.service[72088]: X-Tenant-Id: 0d5d7769df1e4974b295cb30407151dd Apr 11 19:29:13 user devstack@n-api.service[72088]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1311045721 Apr 11 19:29:13 user devstack@n-api.service[72088]: X-User: tempest-ServersNegativeTestJSON-1311045721-project-member Apr 11 19:29:13 user devstack@n-api.service[72088]: X-User-Domain-Id: default Apr 11 19:29:13 user devstack@n-api.service[72088]: X-User-Domain-Name: Default Apr 11 19:29:13 user devstack@n-api.service[72088]: X-User-Id: 2f44dfa2528b4540a81f4eb7c3f3f2f5 Apr 11 19:29:13 user devstack@n-api.service[72088]: X-User-Name: tempest-ServersNegativeTestJSON-1311045721-project-member Apr 11 19:29:13 user devstack@n-api.service[72088]: Apr 11 19:29:13 user devstack@n-api.service[72088]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1850571950", "imageRef": "4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b", "flavorRef": "42", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b", "destination_type": "local"}, {"source_type": "volume", "uuid": "a2e18e49-1de5-4125-93aa-b10061512e20", "destination_type": "invalid"}], "networks": [{"uuid": "b29e55eb-c801-47f0-8cb7-be11e1471261"}]}} Apr 11 19:29:13 user devstack@n-api.service[72088]: method: > Apr 11 19:29:13 user devstack@n-api.service[72088]: exception: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Apr 11 19:29:13 user devstack@n-api.service[72088]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1850571950', 'imageRef': '4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b', 'flavorRef': '42', 'block_device_mapping_v2': [{'source_type': 'image', 'delete_on_termination': True, 'boot_index': 0, 'uuid': '4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b', 'destination_type': 'local'}, {'source_type': 'volume', 'uuid': 'a2e18e49-1de5-4125-93aa-b10061512e20', 'destination_type': 'invalid'}], 'networks': [{'uuid': 'b29e55eb-c801-47f0-8cb7-be11e1471261'}]}}} Apr 11 19:29:13 user devstack@n-api.service[72088]: {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 19:29:13 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:29:13 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Apr 11 19:29:13 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Apr 11 19:29:13 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/jsonschema/validators.py", line 314, in validate Apr 11 19:29:13 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi raise error Apr 11 19:29:13 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['local', 'volume'] Apr 11 19:29:13 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi Apr 11 19:29:13 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['server']['properties']['block_device_mapping_v2']['items']['properties']['destination_type']: Apr 11 19:29:13 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi {'enum': ['local', 'volume'], 'type': 'string'} Apr 11 19:29:13 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi Apr 11 19:29:13 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi On instance['server']['block_device_mapping_v2'][1]: Apr 11 19:29:13 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi 'invalid' Apr 11 19:29:13 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi Apr 11 19:29:13 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 19:29:13 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi Apr 11 19:29:13 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:29:13 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 19:29:13 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 19:29:13 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 19:29:13 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 19:29:13 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 19:29:13 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 19:29:13 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 11 19:29:13 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 11 19:29:13 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Apr 11 19:29:13 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Apr 11 19:29:13 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Apr 11 19:29:13 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Apr 11 19:29:13 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Apr 11 19:29:13 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Apr 11 19:29:13 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Apr 11 19:29:13 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi Apr 11 19:29:13 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 19:29:13 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi Apr 11 19:29:13 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:29:13 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 19:29:13 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 19:29:13 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Apr 11 19:29:13 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Apr 11 19:29:13 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Apr 11 19:29:13 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi Apr 11 19:29:13 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [None req-a061a8da-c13b-45ab-ae2f-792e1bc5bfa1 tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] Returning 400 to user: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] {{(pid=72088) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 19:29:13 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [None req-a061a8da-c13b-45ab-ae2f-792e1bc5bfa1 tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 400 len: 155 microversion: 2.1 time: 0.011273 Apr 11 19:29:13 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 151/457] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 11 19:29:13 2023] POST /compute/v2.1/servers => generated 155 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 11 19:29:13 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [None req-4d098872-456e-4739-8621-a19fe0eb6af6 tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] Calling method '>' {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:29:13 user devstack@n-api.service[72090]: DEBUG nova.compute.api [None req-4d098872-456e-4739-8621-a19fe0eb6af6 tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] [instance: fc48e37f-8c00-4e48-bea3-f1c2e54d78b8] Fetching instance by UUID {{(pid=72090) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:29:13 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-4d098872-456e-4739-8621-a19fe0eb6af6 tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:29:13 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-4d098872-456e-4739-8621-a19fe0eb6af6 tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:29:13 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-4d098872-456e-4739-8621-a19fe0eb6af6 tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:29:13 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-4d098872-456e-4739-8621-a19fe0eb6af6 tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:29:13 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-4d098872-456e-4739-8621-a19fe0eb6af6 tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:29:13 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-4d098872-456e-4739-8621-a19fe0eb6af6 tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:29:13 user devstack@n-api.service[72090]: DEBUG nova.policy [None req-4d098872-456e-4739-8621-a19fe0eb6af6 tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f44dfa2528b4540a81f4eb7c3f3f2f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5d7769df1e4974b295cb30407151dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72090) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:29:13 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [None req-4d098872-456e-4739-8621-a19fe0eb6af6 tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fc48e37f-8c00-4e48-bea3-f1c2e54d78b8" status: 200 len: 1494 microversion: 2.1 time: 0.192957 Apr 11 19:29:13 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 151/458] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 19:29:13 2023] GET /compute/v2.1/servers/fc48e37f-8c00-4e48-bea3-f1c2e54d78b8 => generated 1494 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:29:13 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [req-133d2d87-afbb-4c27-b6e9-0f426677170d req-e842361b-8bac-482e-a739-93d86968d01f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9466c3da-2c99-41ea-9fb4-41ffbaa9910a", "name": "network-vif-plugged", "status": "completed", "tag": "32cb9325-7443-4bd8-ad26-e54700ba6bf4"}]} {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:29:13 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-133d2d87-afbb-4c27-b6e9-0f426677170d req-e842361b-8bac-482e-a739-93d86968d01f service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:29:13 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-133d2d87-afbb-4c27-b6e9-0f426677170d req-e842361b-8bac-482e-a739-93d86968d01f service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:29:13 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-133d2d87-afbb-4c27-b6e9-0f426677170d req-e842361b-8bac-482e-a739-93d86968d01f service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:29:14 user devstack@n-api.service[72089]: INFO nova.api.openstack.compute.server_external_events [req-133d2d87-afbb-4c27-b6e9-0f426677170d req-e842361b-8bac-482e-a739-93d86968d01f service nova] Creating event network-vif-plugged:32cb9325-7443-4bd8-ad26-e54700ba6bf4 for instance 9466c3da-2c99-41ea-9fb4-41ffbaa9910a on user Apr 11 19:29:14 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [req-133d2d87-afbb-4c27-b6e9-0f426677170d req-e842361b-8bac-482e-a739-93d86968d01f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034693 Apr 11 19:29:14 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 157/459] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:29:13 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:29:16 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [req-8361fb9d-c8c2-4f7e-b5d9-8575e25eef9d req-239b9a00-1eac-41a6-a6e7-2c0e1aa031c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9466c3da-2c99-41ea-9fb4-41ffbaa9910a", "name": "network-vif-plugged", "status": "completed", "tag": "32cb9325-7443-4bd8-ad26-e54700ba6bf4"}]} {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:29:16 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-8361fb9d-c8c2-4f7e-b5d9-8575e25eef9d req-239b9a00-1eac-41a6-a6e7-2c0e1aa031c5 service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:29:16 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-8361fb9d-c8c2-4f7e-b5d9-8575e25eef9d req-239b9a00-1eac-41a6-a6e7-2c0e1aa031c5 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:29:16 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-8361fb9d-c8c2-4f7e-b5d9-8575e25eef9d req-239b9a00-1eac-41a6-a6e7-2c0e1aa031c5 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:29:16 user devstack@n-api.service[72088]: INFO nova.api.openstack.compute.server_external_events [req-8361fb9d-c8c2-4f7e-b5d9-8575e25eef9d req-239b9a00-1eac-41a6-a6e7-2c0e1aa031c5 service nova] Creating event network-vif-plugged:32cb9325-7443-4bd8-ad26-e54700ba6bf4 for instance 9466c3da-2c99-41ea-9fb4-41ffbaa9910a on user Apr 11 19:29:16 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [req-8361fb9d-c8c2-4f7e-b5d9-8575e25eef9d req-239b9a00-1eac-41a6-a6e7-2c0e1aa031c5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033867 Apr 11 19:29:16 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 152/460] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:29:16 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:29:16 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [None req-5c56d57b-c4f3-41b9-8ef7-7ae71be055dc tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Calling method '>' {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:29:16 user devstack@n-api.service[72090]: DEBUG nova.compute.api [None req-5c56d57b-c4f3-41b9-8ef7-7ae71be055dc tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] [instance: 864fcd9b-8e5b-4de8-a2e6-292a8907a834] Fetching instance by UUID {{(pid=72090) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:29:16 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-5c56d57b-c4f3-41b9-8ef7-7ae71be055dc tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:29:16 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-5c56d57b-c4f3-41b9-8ef7-7ae71be055dc tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:29:16 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-5c56d57b-c4f3-41b9-8ef7-7ae71be055dc tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:29:16 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-5c56d57b-c4f3-41b9-8ef7-7ae71be055dc tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:29:16 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-5c56d57b-c4f3-41b9-8ef7-7ae71be055dc tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:29:16 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-5c56d57b-c4f3-41b9-8ef7-7ae71be055dc tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:29:17 user devstack@n-api.service[72090]: DEBUG nova.policy [None req-5c56d57b-c4f3-41b9-8ef7-7ae71be055dc tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b3adca432b04d70818a51d1366f5c6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb91586feb3f4a4c84fa8c2183baaf8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72090) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:29:17 user devstack@n-api.service[72090]: DEBUG nova.policy [None req-5c56d57b-c4f3-41b9-8ef7-7ae71be055dc tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b3adca432b04d70818a51d1366f5c6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb91586feb3f4a4c84fa8c2183baaf8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72090) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:29:17 user devstack@n-api.service[72090]: DEBUG nova.policy [None req-5c56d57b-c4f3-41b9-8ef7-7ae71be055dc tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b3adca432b04d70818a51d1366f5c6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb91586feb3f4a4c84fa8c2183baaf8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72090) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:29:17 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [None req-5c56d57b-c4f3-41b9-8ef7-7ae71be055dc tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] 10.0.0.210 "GET /compute/v2.1/servers/864fcd9b-8e5b-4de8-a2e6-292a8907a834" status: 200 len: 1769 microversion: 2.87 time: 0.151401 Apr 11 19:29:17 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 152/461] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 19:29:16 2023] GET /compute/v2.1/servers/864fcd9b-8e5b-4de8-a2e6-292a8907a834 => generated 1769 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 19:29:19 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [None req-3a932fef-d561-4ed2-80f7-263c69d8428c tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Calling method '>' {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:29:19 user devstack@n-api.service[72089]: DEBUG nova.compute.api [None req-3a932fef-d561-4ed2-80f7-263c69d8428c tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] [instance: 720c683f-c03a-444c-92a8-daf97c9f524b] Fetching instance by UUID {{(pid=72089) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:29:19 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-3a932fef-d561-4ed2-80f7-263c69d8428c tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:29:19 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-3a932fef-d561-4ed2-80f7-263c69d8428c tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:29:19 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-3a932fef-d561-4ed2-80f7-263c69d8428c tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:29:19 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-3a932fef-d561-4ed2-80f7-263c69d8428c tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:29:19 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-3a932fef-d561-4ed2-80f7-263c69d8428c tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:29:19 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-3a932fef-d561-4ed2-80f7-263c69d8428c tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:29:19 user devstack@n-api.service[72089]: DEBUG nova.policy [None req-3a932fef-d561-4ed2-80f7-263c69d8428c tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0558ba5a2b04d36ba2f2411090cc4e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d8b189667e34931aa36149620a036e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72089) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:29:19 user devstack@n-api.service[72089]: DEBUG nova.policy [None req-3a932fef-d561-4ed2-80f7-263c69d8428c tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0558ba5a2b04d36ba2f2411090cc4e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d8b189667e34931aa36149620a036e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72089) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:29:19 user devstack@n-api.service[72089]: DEBUG nova.policy [None req-3a932fef-d561-4ed2-80f7-263c69d8428c tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0558ba5a2b04d36ba2f2411090cc4e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d8b189667e34931aa36149620a036e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72089) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:29:19 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [None req-3a932fef-d561-4ed2-80f7-263c69d8428c tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] 10.0.0.210 "GET /compute/v2.1/servers/720c683f-c03a-444c-92a8-daf97c9f524b" status: 200 len: 1650 microversion: 2.20 time: 0.154026 Apr 11 19:29:19 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 158/462] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 19:29:19 2023] GET /compute/v2.1/servers/720c683f-c03a-444c-92a8-daf97c9f524b => generated 1650 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 19:29:28 user devstack@n-api.service[72088]: DEBUG dbcounter [-] [72088] Writing DB stats nova_cell0:SELECT=2 {{(pid=72088) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:29:28 user devstack@n-api.service[72088]: DEBUG dbcounter [-] [72088] Writing DB stats nova_cell0:SELECT=6 {{(pid=72088) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:29:28 user devstack@n-api.service[72088]: DEBUG dbcounter [-] [72088] Writing DB stats nova_api:SELECT=15,nova_api:INSERT=3 {{(pid=72088) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:29:28 user devstack@n-api.service[72088]: DEBUG dbcounter [-] [72088] Writing DB stats nova_cell1:SELECT=4 {{(pid=72088) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:29:28 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [None req-49791b18-6b93-4ee8-941d-b16cc5a9c702 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Calling method '>' {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:29:28 user devstack@n-api.service[72088]: DEBUG nova.compute.api [None req-49791b18-6b93-4ee8-941d-b16cc5a9c702 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] [instance: 6802f099-9236-4c79-a892-2963f1b15b0e] Fetching instance by UUID {{(pid=72088) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:29:28 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-49791b18-6b93-4ee8-941d-b16cc5a9c702 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:29:28 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-49791b18-6b93-4ee8-941d-b16cc5a9c702 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:29:28 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-49791b18-6b93-4ee8-941d-b16cc5a9c702 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:29:28 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-49791b18-6b93-4ee8-941d-b16cc5a9c702 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:29:28 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-49791b18-6b93-4ee8-941d-b16cc5a9c702 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:29:28 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-49791b18-6b93-4ee8-941d-b16cc5a9c702 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:29:28 user devstack@n-api.service[72088]: DEBUG nova.policy [None req-49791b18-6b93-4ee8-941d-b16cc5a9c702 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31c237e142784bd6aa460d6f1bf33400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd886d2ec5fc946b49af3c8ca7c8556c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72088) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:29:28 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [None req-49791b18-6b93-4ee8-941d-b16cc5a9c702 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6802f099-9236-4c79-a892-2963f1b15b0e" status: 200 len: 1703 microversion: 2.1 time: 0.197399 Apr 11 19:29:28 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 153/463] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 19:29:28 2023] GET /compute/v2.1/servers/6802f099-9236-4c79-a892-2963f1b15b0e => generated 1703 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:29:32 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [None req-94a2e9fa-8c6c-4af0-a83e-e656b487aa6f tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Calling method '>' {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:29:32 user devstack@n-api.service[72090]: DEBUG nova.compute.api [None req-94a2e9fa-8c6c-4af0-a83e-e656b487aa6f tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] [instance: 647674d8-af53-405a-8116-4b7a01549bdf] Fetching instance by UUID {{(pid=72090) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:29:32 user devstack@n-api.service[72090]: DEBUG dbcounter [-] [72090] Writing DB stats nova_cell0:SELECT=2 {{(pid=72090) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:29:32 user devstack@n-api.service[72090]: DEBUG dbcounter [-] [72090] Writing DB stats nova_cell1:SELECT=12 {{(pid=72090) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:29:32 user devstack@n-api.service[72090]: DEBUG dbcounter [-] [72090] Writing DB stats nova_api:SELECT=10 {{(pid=72090) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:29:32 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-94a2e9fa-8c6c-4af0-a83e-e656b487aa6f tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:29:32 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-94a2e9fa-8c6c-4af0-a83e-e656b487aa6f tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:29:32 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-94a2e9fa-8c6c-4af0-a83e-e656b487aa6f tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:29:32 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-94a2e9fa-8c6c-4af0-a83e-e656b487aa6f tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:29:32 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-94a2e9fa-8c6c-4af0-a83e-e656b487aa6f tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:29:32 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-94a2e9fa-8c6c-4af0-a83e-e656b487aa6f tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:29:33 user devstack@n-api.service[72090]: DEBUG nova.policy [None req-94a2e9fa-8c6c-4af0-a83e-e656b487aa6f tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05fb551c320a48f98a4ec00a7f7492d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60a7381a31b84e97a068528f90813773', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72090) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:29:33 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [None req-94a2e9fa-8c6c-4af0-a83e-e656b487aa6f tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] 10.0.0.210 "GET /compute/v2.1/servers/647674d8-af53-405a-8116-4b7a01549bdf" status: 200 len: 1657 microversion: 2.1 time: 0.151987 Apr 11 19:29:33 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 153/464] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 19:29:32 2023] GET /compute/v2.1/servers/647674d8-af53-405a-8116-4b7a01549bdf => generated 1657 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:29:33 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [None req-e1f629b0-778c-4457-a048-3ab123807ab2 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Calling method '>' {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:29:33 user devstack@n-api.service[72089]: DEBUG nova.compute.api [None req-e1f629b0-778c-4457-a048-3ab123807ab2 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] [instance: 647674d8-af53-405a-8116-4b7a01549bdf] Fetching instance by UUID {{(pid=72089) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:29:33 user devstack@n-api.service[72089]: DEBUG dbcounter [-] [72089] Writing DB stats nova_api:SELECT=8 {{(pid=72089) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:29:33 user devstack@n-api.service[72089]: DEBUG dbcounter [-] [72089] Writing DB stats nova_cell1:SELECT=16 {{(pid=72089) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:29:33 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-e1f629b0-778c-4457-a048-3ab123807ab2 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:29:33 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-e1f629b0-778c-4457-a048-3ab123807ab2 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:29:33 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-e1f629b0-778c-4457-a048-3ab123807ab2 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:29:33 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-e1f629b0-778c-4457-a048-3ab123807ab2 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:29:33 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-e1f629b0-778c-4457-a048-3ab123807ab2 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:29:33 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-e1f629b0-778c-4457-a048-3ab123807ab2 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:29:33 user devstack@n-api.service[72089]: DEBUG nova.policy [None req-e1f629b0-778c-4457-a048-3ab123807ab2 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05fb551c320a48f98a4ec00a7f7492d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60a7381a31b84e97a068528f90813773', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72089) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:29:33 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [None req-e1f629b0-778c-4457-a048-3ab123807ab2 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] 10.0.0.210 "GET /compute/v2.1/servers/647674d8-af53-405a-8116-4b7a01549bdf" status: 200 len: 1657 microversion: 2.1 time: 0.143613 Apr 11 19:29:33 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 159/465] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 19:29:33 2023] GET /compute/v2.1/servers/647674d8-af53-405a-8116-4b7a01549bdf => generated 1657 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:29:36 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [None req-311bc1e9-6c27-4999-a85d-7369b9f47b39 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] Calling method '>' {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:29:36 user devstack@n-api.service[72088]: DEBUG nova.compute.api [None req-311bc1e9-6c27-4999-a85d-7369b9f47b39 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] [instance: aa0bb9aa-a93d-45bc-9f90-46eeb6416365] Fetching instance by UUID {{(pid=72088) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:29:36 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-311bc1e9-6c27-4999-a85d-7369b9f47b39 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:29:36 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-311bc1e9-6c27-4999-a85d-7369b9f47b39 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:29:36 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-311bc1e9-6c27-4999-a85d-7369b9f47b39 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:29:36 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-311bc1e9-6c27-4999-a85d-7369b9f47b39 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:29:36 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-311bc1e9-6c27-4999-a85d-7369b9f47b39 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:29:36 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-311bc1e9-6c27-4999-a85d-7369b9f47b39 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:29:36 user devstack@n-api.service[72088]: INFO nova.api.openstack.wsgi [None req-311bc1e9-6c27-4999-a85d-7369b9f47b39 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] HTTP exception thrown: Instance aa0bb9aa-a93d-45bc-9f90-46eeb6416365 could not be found. Apr 11 19:29:36 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [None req-311bc1e9-6c27-4999-a85d-7369b9f47b39 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] Request method failure captured: Apr 11 19:29:36 user devstack@n-api.service[72088]: request: GET /compute/v2.1/servers/aa0bb9aa-a93d-45bc-9f90-46eeb6416365 HTTP/1.1 Apr 11 19:29:36 user devstack@n-api.service[72088]: Accept: application/json Apr 11 19:29:36 user devstack@n-api.service[72088]: Accept-Encoding: identity Apr 11 19:29:36 user devstack@n-api.service[72088]: Connection: close Apr 11 19:29:36 user devstack@n-api.service[72088]: Content-Length: 0 Apr 11 19:29:36 user devstack@n-api.service[72088]: Content-Type: application/json Apr 11 19:29:36 user devstack@n-api.service[72088]: Host: 10.0.0.210 Apr 11 19:29:36 user devstack@n-api.service[72088]: Openstack-System-Scope: None Apr 11 19:29:36 user devstack@n-api.service[72088]: User-Agent: python-urllib3/1.26.15 Apr 11 19:29:36 user devstack@n-api.service[72088]: X-Auth-Token: gAAAAABkNbNGZZM7xYK9ONsCwt-Pv2e7tGohAPd4pjsuwZJfBDAfF9sliNlgAXXI9DQhFyMWpsMxXSVc8iFAlfbPziVwQiLqTeEOaQdrlb7xCPpB7TeaKlIdUEv570axR8luovCYUStjwKIuujFbI8799bVVR8s8LNxS41KhLoESbgmwSucUP2Q Apr 11 19:29:36 user devstack@n-api.service[72088]: X-Domain-Id: None Apr 11 19:29:36 user devstack@n-api.service[72088]: X-Domain-Name: None Apr 11 19:29:36 user devstack@n-api.service[72088]: X-Identity-Status: Confirmed Apr 11 19:29:36 user devstack@n-api.service[72088]: X-Is-Admin-Project: True Apr 11 19:29:36 user devstack@n-api.service[72088]: X-Project-Domain-Id: default Apr 11 19:29:36 user devstack@n-api.service[72088]: X-Project-Domain-Name: Default Apr 11 19:29:36 user devstack@n-api.service[72088]: X-Project-Id: 11ee7c68b277420ba524c2a99cd444ea Apr 11 19:29:36 user devstack@n-api.service[72088]: X-Project-Name: tempest-ServerStableDeviceRescueTest-400855764 Apr 11 19:29:36 user devstack@n-api.service[72088]: X-Role: reader,member Apr 11 19:29:36 user devstack@n-api.service[72088]: X-Roles: reader,member Apr 11 19:29:36 user devstack@n-api.service[72088]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/11ee7c68b277420ba524c2a99cd444ea"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/11ee7c68b277420ba524c2a99cd444ea"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/11ee7c68b277420ba524c2a99cd444ea"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 11 19:29:36 user devstack@n-api.service[72088]: X-Tenant: tempest-ServerStableDeviceRescueTest-400855764 Apr 11 19:29:36 user devstack@n-api.service[72088]: X-Tenant-Id: 11ee7c68b277420ba524c2a99cd444ea Apr 11 19:29:36 user devstack@n-api.service[72088]: X-Tenant-Name: tempest-ServerStableDeviceRescueTest-400855764 Apr 11 19:29:36 user devstack@n-api.service[72088]: X-User: tempest-ServerStableDeviceRescueTest-400855764-project-member Apr 11 19:29:36 user devstack@n-api.service[72088]: X-User-Domain-Id: default Apr 11 19:29:36 user devstack@n-api.service[72088]: X-User-Domain-Name: Default Apr 11 19:29:36 user devstack@n-api.service[72088]: X-User-Id: 26f091a1508b4d2689005b660f6a1380 Apr 11 19:29:36 user devstack@n-api.service[72088]: X-User-Name: tempest-ServerStableDeviceRescueTest-400855764-project-member Apr 11 19:29:36 user devstack@n-api.service[72088]: method: > Apr 11 19:29:36 user devstack@n-api.service[72088]: exception: Instance aa0bb9aa-a93d-45bc-9f90-46eeb6416365 could not be found. Apr 11 19:29:36 user devstack@n-api.service[72088]: action_args: {'id': 'aa0bb9aa-a93d-45bc-9f90-46eeb6416365'} Apr 11 19:29:36 user devstack@n-api.service[72088]: {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 19:29:36 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:29:36 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 19:29:36 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 19:29:36 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 19:29:36 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 19:29:36 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 19:29:36 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 19:29:36 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 19:29:36 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 19:29:36 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aa0bb9aa-a93d-45bc-9f90-46eeb6416365 could not be found. Apr 11 19:29:36 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi Apr 11 19:29:36 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 19:29:36 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi Apr 11 19:29:36 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:29:36 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 19:29:36 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 19:29:36 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 19:29:36 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 19:29:36 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 19:29:36 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 19:29:36 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 19:29:36 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 19:29:36 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 19:29:36 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 19:29:36 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 19:29:36 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 19:29:36 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aa0bb9aa-a93d-45bc-9f90-46eeb6416365 could not be found. Apr 11 19:29:36 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi Apr 11 19:29:36 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 19:29:36 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi Apr 11 19:29:36 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:29:36 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 19:29:36 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 19:29:36 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 19:29:36 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 19:29:36 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aa0bb9aa-a93d-45bc-9f90-46eeb6416365 could not be found. Apr 11 19:29:36 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi Apr 11 19:29:36 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [None req-311bc1e9-6c27-4999-a85d-7369b9f47b39 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] Returning 404 to user: Instance aa0bb9aa-a93d-45bc-9f90-46eeb6416365 could not be found. {{(pid=72088) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 19:29:36 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [None req-311bc1e9-6c27-4999-a85d-7369b9f47b39 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] 10.0.0.210 "GET /compute/v2.1/servers/aa0bb9aa-a93d-45bc-9f90-46eeb6416365" status: 404 len: 111 microversion: 2.1 time: 0.027333 Apr 11 19:29:36 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 154/466] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 19:29:36 2023] GET /compute/v2.1/servers/aa0bb9aa-a93d-45bc-9f90-46eeb6416365 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 19:29:36 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [None req-0221db33-c124-4800-9415-769927926549 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] Calling method '.version_select at 0x7f119dc0fa30>' {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:29:36 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [None req-0221db33-c124-4800-9415-769927926549 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-909036118" status: 202 len: 0 microversion: 2.1 time: 0.023057 Apr 11 19:29:36 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 154/467] 10.0.0.210 () {62 vars in 1295 bytes} [Tue Apr 11 19:29:36 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-909036118 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 19:29:38 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [None req-fcd28e89-8017-4080-8de7-a7434f4efa3c tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Calling method '>' {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:29:38 user devstack@n-api.service[72089]: DEBUG nova.compute.api [None req-fcd28e89-8017-4080-8de7-a7434f4efa3c tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] [instance: f37ed08c-8c9a-4af7-ba5f-b8a942e54389] Fetching instance by UUID {{(pid=72089) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:29:38 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-fcd28e89-8017-4080-8de7-a7434f4efa3c tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:29:38 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-fcd28e89-8017-4080-8de7-a7434f4efa3c tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:29:38 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-fcd28e89-8017-4080-8de7-a7434f4efa3c tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:29:38 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-fcd28e89-8017-4080-8de7-a7434f4efa3c tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:29:38 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-fcd28e89-8017-4080-8de7-a7434f4efa3c tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:29:38 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-fcd28e89-8017-4080-8de7-a7434f4efa3c tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:29:38 user devstack@n-api.service[72089]: INFO nova.api.openstack.wsgi [None req-fcd28e89-8017-4080-8de7-a7434f4efa3c tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] HTTP exception thrown: Instance f37ed08c-8c9a-4af7-ba5f-b8a942e54389 could not be found. Apr 11 19:29:38 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [None req-fcd28e89-8017-4080-8de7-a7434f4efa3c tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Request method failure captured: Apr 11 19:29:38 user devstack@n-api.service[72089]: request: GET /compute/v2.1/servers/f37ed08c-8c9a-4af7-ba5f-b8a942e54389 HTTP/1.1 Apr 11 19:29:38 user devstack@n-api.service[72089]: Accept: application/json Apr 11 19:29:38 user devstack@n-api.service[72089]: Accept-Encoding: identity Apr 11 19:29:38 user devstack@n-api.service[72089]: Connection: close Apr 11 19:29:38 user devstack@n-api.service[72089]: Content-Length: 0 Apr 11 19:29:38 user devstack@n-api.service[72089]: Content-Type: application/json Apr 11 19:29:38 user devstack@n-api.service[72089]: Host: 10.0.0.210 Apr 11 19:29:38 user devstack@n-api.service[72089]: Openstack-System-Scope: None Apr 11 19:29:38 user devstack@n-api.service[72089]: User-Agent: python-urllib3/1.26.15 Apr 11 19:29:38 user devstack@n-api.service[72089]: X-Auth-Token: gAAAAABkNbN4-SiDHVXgGAq1Livx4Ms1sGx-fp2WG3x_Y0m9pBMANUHYyXMsJQp9hD4u3xpw-neOtr5XlKMUkx8fei57P418d_RqgO--MD5ohJi_XiONiYrdn7gKPJL36-NgiQN546w40ULZ0D1v3ZDDmhVchguBy0oqaJnEY21gDX2_BouIjIo Apr 11 19:29:38 user devstack@n-api.service[72089]: X-Domain-Id: None Apr 11 19:29:38 user devstack@n-api.service[72089]: X-Domain-Name: None Apr 11 19:29:38 user devstack@n-api.service[72089]: X-Identity-Status: Confirmed Apr 11 19:29:38 user devstack@n-api.service[72089]: X-Is-Admin-Project: True Apr 11 19:29:38 user devstack@n-api.service[72089]: X-Project-Domain-Id: default Apr 11 19:29:38 user devstack@n-api.service[72089]: X-Project-Domain-Name: Default Apr 11 19:29:38 user devstack@n-api.service[72089]: X-Project-Id: bceca6e3506e43f68f9cf8d0b56d141b Apr 11 19:29:38 user devstack@n-api.service[72089]: X-Project-Name: tempest-TestStampPattern-497408287 Apr 11 19:29:38 user devstack@n-api.service[72089]: X-Role: reader,member Apr 11 19:29:38 user devstack@n-api.service[72089]: X-Roles: reader,member Apr 11 19:29:38 user devstack@n-api.service[72089]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/bceca6e3506e43f68f9cf8d0b56d141b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/bceca6e3506e43f68f9cf8d0b56d141b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/bceca6e3506e43f68f9cf8d0b56d141b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 11 19:29:38 user devstack@n-api.service[72089]: X-Tenant: tempest-TestStampPattern-497408287 Apr 11 19:29:38 user devstack@n-api.service[72089]: X-Tenant-Id: bceca6e3506e43f68f9cf8d0b56d141b Apr 11 19:29:38 user devstack@n-api.service[72089]: X-Tenant-Name: tempest-TestStampPattern-497408287 Apr 11 19:29:38 user devstack@n-api.service[72089]: X-User: tempest-TestStampPattern-497408287-project-member Apr 11 19:29:38 user devstack@n-api.service[72089]: X-User-Domain-Id: default Apr 11 19:29:38 user devstack@n-api.service[72089]: X-User-Domain-Name: Default Apr 11 19:29:38 user devstack@n-api.service[72089]: X-User-Id: 3a32a5d0547141a180f655e98567ed9a Apr 11 19:29:38 user devstack@n-api.service[72089]: X-User-Name: tempest-TestStampPattern-497408287-project-member Apr 11 19:29:38 user devstack@n-api.service[72089]: method: > Apr 11 19:29:38 user devstack@n-api.service[72089]: exception: Instance f37ed08c-8c9a-4af7-ba5f-b8a942e54389 could not be found. Apr 11 19:29:38 user devstack@n-api.service[72089]: action_args: {'id': 'f37ed08c-8c9a-4af7-ba5f-b8a942e54389'} Apr 11 19:29:38 user devstack@n-api.service[72089]: {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 19:29:38 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:29:38 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 19:29:38 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 19:29:38 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 19:29:38 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 19:29:38 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 19:29:38 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 19:29:38 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 19:29:38 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 19:29:38 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f37ed08c-8c9a-4af7-ba5f-b8a942e54389 could not be found. Apr 11 19:29:38 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi Apr 11 19:29:38 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 19:29:38 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi Apr 11 19:29:38 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:29:38 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 19:29:38 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 19:29:38 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 19:29:38 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 19:29:38 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 19:29:38 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 19:29:38 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 19:29:38 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 19:29:38 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 19:29:38 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 19:29:38 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 19:29:38 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 19:29:38 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f37ed08c-8c9a-4af7-ba5f-b8a942e54389 could not be found. Apr 11 19:29:38 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi Apr 11 19:29:38 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 19:29:38 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi Apr 11 19:29:38 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:29:38 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 19:29:38 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 19:29:38 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 19:29:38 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 19:29:38 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f37ed08c-8c9a-4af7-ba5f-b8a942e54389 could not be found. Apr 11 19:29:38 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi Apr 11 19:29:38 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [None req-fcd28e89-8017-4080-8de7-a7434f4efa3c tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Returning 404 to user: Instance f37ed08c-8c9a-4af7-ba5f-b8a942e54389 could not be found. {{(pid=72089) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 19:29:38 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [None req-fcd28e89-8017-4080-8de7-a7434f4efa3c tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f37ed08c-8c9a-4af7-ba5f-b8a942e54389" status: 404 len: 111 microversion: 2.1 time: 0.030252 Apr 11 19:29:38 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 160/468] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 19:29:38 2023] GET /compute/v2.1/servers/f37ed08c-8c9a-4af7-ba5f-b8a942e54389 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 19:29:40 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [None req-cb5cc17a-9bc0-4cdd-818d-ece24cae2043 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Calling method '>' {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:29:40 user devstack@n-api.service[72088]: DEBUG nova.compute.api [None req-cb5cc17a-9bc0-4cdd-818d-ece24cae2043 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] [instance: d424f88d-5f82-4cac-aa0f-4f99624bd3e7] Fetching instance by UUID {{(pid=72088) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:29:40 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-cb5cc17a-9bc0-4cdd-818d-ece24cae2043 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:29:40 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-cb5cc17a-9bc0-4cdd-818d-ece24cae2043 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:29:40 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-cb5cc17a-9bc0-4cdd-818d-ece24cae2043 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:29:40 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-cb5cc17a-9bc0-4cdd-818d-ece24cae2043 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:29:40 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-cb5cc17a-9bc0-4cdd-818d-ece24cae2043 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:29:40 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-cb5cc17a-9bc0-4cdd-818d-ece24cae2043 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:29:40 user devstack@n-api.service[72088]: INFO nova.api.openstack.wsgi [None req-cb5cc17a-9bc0-4cdd-818d-ece24cae2043 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] HTTP exception thrown: Instance d424f88d-5f82-4cac-aa0f-4f99624bd3e7 is not attached to volume 6c80ed14-155b-4ad7-94d3-a2f3616e15a1 Apr 11 19:29:40 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [None req-cb5cc17a-9bc0-4cdd-818d-ece24cae2043 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Request method failure captured: Apr 11 19:29:40 user devstack@n-api.service[72088]: request: DELETE /compute/v2.1/servers/d424f88d-5f82-4cac-aa0f-4f99624bd3e7/os-volume_attachments/6c80ed14-155b-4ad7-94d3-a2f3616e15a1 HTTP/1.1 Apr 11 19:29:40 user devstack@n-api.service[72088]: Accept: application/json Apr 11 19:29:40 user devstack@n-api.service[72088]: Accept-Encoding: identity Apr 11 19:29:40 user devstack@n-api.service[72088]: Connection: close Apr 11 19:29:40 user devstack@n-api.service[72088]: Content-Length: 0 Apr 11 19:29:40 user devstack@n-api.service[72088]: Content-Type: application/json Apr 11 19:29:40 user devstack@n-api.service[72088]: Host: 10.0.0.210 Apr 11 19:29:40 user devstack@n-api.service[72088]: Openstack-System-Scope: None Apr 11 19:29:40 user devstack@n-api.service[72088]: User-Agent: python-urllib3/1.26.15 Apr 11 19:29:40 user devstack@n-api.service[72088]: X-Auth-Token: gAAAAABkNbN4-SiDHVXgGAq1Livx4Ms1sGx-fp2WG3x_Y0m9pBMANUHYyXMsJQp9hD4u3xpw-neOtr5XlKMUkx8fei57P418d_RqgO--MD5ohJi_XiONiYrdn7gKPJL36-NgiQN546w40ULZ0D1v3ZDDmhVchguBy0oqaJnEY21gDX2_BouIjIo Apr 11 19:29:40 user devstack@n-api.service[72088]: X-Domain-Id: None Apr 11 19:29:40 user devstack@n-api.service[72088]: X-Domain-Name: None Apr 11 19:29:40 user devstack@n-api.service[72088]: X-Identity-Status: Confirmed Apr 11 19:29:40 user devstack@n-api.service[72088]: X-Is-Admin-Project: True Apr 11 19:29:40 user devstack@n-api.service[72088]: X-Project-Domain-Id: default Apr 11 19:29:40 user devstack@n-api.service[72088]: X-Project-Domain-Name: Default Apr 11 19:29:40 user devstack@n-api.service[72088]: X-Project-Id: bceca6e3506e43f68f9cf8d0b56d141b Apr 11 19:29:40 user devstack@n-api.service[72088]: X-Project-Name: tempest-TestStampPattern-497408287 Apr 11 19:29:40 user devstack@n-api.service[72088]: X-Role: reader,member Apr 11 19:29:40 user devstack@n-api.service[72088]: X-Roles: reader,member Apr 11 19:29:40 user devstack@n-api.service[72088]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/bceca6e3506e43f68f9cf8d0b56d141b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/bceca6e3506e43f68f9cf8d0b56d141b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/bceca6e3506e43f68f9cf8d0b56d141b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 11 19:29:40 user devstack@n-api.service[72088]: X-Tenant: tempest-TestStampPattern-497408287 Apr 11 19:29:40 user devstack@n-api.service[72088]: X-Tenant-Id: bceca6e3506e43f68f9cf8d0b56d141b Apr 11 19:29:40 user devstack@n-api.service[72088]: X-Tenant-Name: tempest-TestStampPattern-497408287 Apr 11 19:29:40 user devstack@n-api.service[72088]: X-User: tempest-TestStampPattern-497408287-project-member Apr 11 19:29:40 user devstack@n-api.service[72088]: X-User-Domain-Id: default Apr 11 19:29:40 user devstack@n-api.service[72088]: X-User-Domain-Name: Default Apr 11 19:29:40 user devstack@n-api.service[72088]: X-User-Id: 3a32a5d0547141a180f655e98567ed9a Apr 11 19:29:40 user devstack@n-api.service[72088]: X-User-Name: tempest-TestStampPattern-497408287-project-member Apr 11 19:29:40 user devstack@n-api.service[72088]: method: > Apr 11 19:29:40 user devstack@n-api.service[72088]: exception: Instance d424f88d-5f82-4cac-aa0f-4f99624bd3e7 is not attached to volume 6c80ed14-155b-4ad7-94d3-a2f3616e15a1 Apr 11 19:29:40 user devstack@n-api.service[72088]: action_args: {'server_id': 'd424f88d-5f82-4cac-aa0f-4f99624bd3e7', 'id': '6c80ed14-155b-4ad7-94d3-a2f3616e15a1'} Apr 11 19:29:40 user devstack@n-api.service[72088]: {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 19:29:40 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:29:40 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Apr 11 19:29:40 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Apr 11 19:29:40 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Apr 11 19:29:40 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Apr 11 19:29:40 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Apr 11 19:29:40 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Apr 11 19:29:40 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 6c80ed14-155b-4ad7-94d3-a2f3616e15a1. Apr 11 19:29:40 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi Apr 11 19:29:40 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 19:29:40 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi Apr 11 19:29:40 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:29:40 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 19:29:40 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 19:29:40 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 19:29:40 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 19:29:40 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 19:29:40 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 19:29:40 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Apr 11 19:29:40 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Apr 11 19:29:40 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d424f88d-5f82-4cac-aa0f-4f99624bd3e7 is not attached to volume 6c80ed14-155b-4ad7-94d3-a2f3616e15a1 Apr 11 19:29:40 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi Apr 11 19:29:40 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 19:29:40 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi Apr 11 19:29:40 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:29:40 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 19:29:40 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 19:29:40 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 19:29:40 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 19:29:40 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d424f88d-5f82-4cac-aa0f-4f99624bd3e7 is not attached to volume 6c80ed14-155b-4ad7-94d3-a2f3616e15a1 Apr 11 19:29:40 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi Apr 11 19:29:40 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [None req-cb5cc17a-9bc0-4cdd-818d-ece24cae2043 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Returning 404 to user: Instance d424f88d-5f82-4cac-aa0f-4f99624bd3e7 is not attached to volume 6c80ed14-155b-4ad7-94d3-a2f3616e15a1 {{(pid=72088) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 19:29:40 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [None req-cb5cc17a-9bc0-4cdd-818d-ece24cae2043 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/d424f88d-5f82-4cac-aa0f-4f99624bd3e7/os-volume_attachments/6c80ed14-155b-4ad7-94d3-a2f3616e15a1" status: 404 len: 154 microversion: 2.1 time: 0.096707 Apr 11 19:29:40 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 155/469] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Apr 11 19:29:40 2023] DELETE /compute/v2.1/servers/d424f88d-5f82-4cac-aa0f-4f99624bd3e7/os-volume_attachments/6c80ed14-155b-4ad7-94d3-a2f3616e15a1 => generated 154 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 19:29:41 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [None req-1b78c20d-cf75-4eef-a033-43f9f8f1e6a6 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Calling method '>' {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:29:41 user devstack@n-api.service[72090]: DEBUG nova.compute.api [None req-1b78c20d-cf75-4eef-a033-43f9f8f1e6a6 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] [instance: d424f88d-5f82-4cac-aa0f-4f99624bd3e7] Fetching instance by UUID {{(pid=72090) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:29:41 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-1b78c20d-cf75-4eef-a033-43f9f8f1e6a6 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:29:41 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-1b78c20d-cf75-4eef-a033-43f9f8f1e6a6 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:29:41 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-1b78c20d-cf75-4eef-a033-43f9f8f1e6a6 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:29:41 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-1b78c20d-cf75-4eef-a033-43f9f8f1e6a6 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:29:41 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-1b78c20d-cf75-4eef-a033-43f9f8f1e6a6 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:29:41 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-1b78c20d-cf75-4eef-a033-43f9f8f1e6a6 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:29:41 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [req-e01c2441-c224-47d1-8bda-7573ec01aedb req-b2098a0a-0064-49d7-9c28-cb5c4b8fe454 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d424f88d-5f82-4cac-aa0f-4f99624bd3e7", "tag": "93054605-985d-4168-9809-21feb31c1346"}]} {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:29:41 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-e01c2441-c224-47d1-8bda-7573ec01aedb req-b2098a0a-0064-49d7-9c28-cb5c4b8fe454 service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:29:41 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-e01c2441-c224-47d1-8bda-7573ec01aedb req-b2098a0a-0064-49d7-9c28-cb5c4b8fe454 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:29:41 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-e01c2441-c224-47d1-8bda-7573ec01aedb req-b2098a0a-0064-49d7-9c28-cb5c4b8fe454 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:29:41 user devstack@n-api.service[72090]: DEBUG nova.compute.api [None req-1b78c20d-cf75-4eef-a033-43f9f8f1e6a6 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] [instance: d424f88d-5f82-4cac-aa0f-4f99624bd3e7] Going to try to terminate instance {{(pid=72090) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 11 19:29:41 user devstack@n-api.service[72089]: INFO nova.api.openstack.compute.server_external_events [req-e01c2441-c224-47d1-8bda-7573ec01aedb req-b2098a0a-0064-49d7-9c28-cb5c4b8fe454 service nova] Creating event network-changed:93054605-985d-4168-9809-21feb31c1346 for instance d424f88d-5f82-4cac-aa0f-4f99624bd3e7 on user Apr 11 19:29:41 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [req-e01c2441-c224-47d1-8bda-7573ec01aedb req-b2098a0a-0064-49d7-9c28-cb5c4b8fe454 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032721 Apr 11 19:29:41 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 161/470] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:29:41 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:29:41 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [None req-1b78c20d-cf75-4eef-a033-43f9f8f1e6a6 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/d424f88d-5f82-4cac-aa0f-4f99624bd3e7" status: 204 len: 0 microversion: 2.1 time: 0.119982 Apr 11 19:29:41 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 155/471] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 19:29:41 2023] DELETE /compute/v2.1/servers/d424f88d-5f82-4cac-aa0f-4f99624bd3e7 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 11 19:29:41 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [None req-2649c2d5-ca72-4782-835a-535b594ea50f tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Calling method '>' {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:29:41 user devstack@n-api.service[72088]: DEBUG nova.compute.api [None req-2649c2d5-ca72-4782-835a-535b594ea50f tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] [instance: d424f88d-5f82-4cac-aa0f-4f99624bd3e7] Fetching instance by UUID {{(pid=72088) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:29:41 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-2649c2d5-ca72-4782-835a-535b594ea50f tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:29:41 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-2649c2d5-ca72-4782-835a-535b594ea50f tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:29:41 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-2649c2d5-ca72-4782-835a-535b594ea50f tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:29:41 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-2649c2d5-ca72-4782-835a-535b594ea50f tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:29:41 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-2649c2d5-ca72-4782-835a-535b594ea50f tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:29:41 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-2649c2d5-ca72-4782-835a-535b594ea50f tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:29:41 user devstack@n-api.service[72088]: DEBUG nova.policy [None req-2649c2d5-ca72-4782-835a-535b594ea50f tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a32a5d0547141a180f655e98567ed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bceca6e3506e43f68f9cf8d0b56d141b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72088) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:29:41 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [None req-2649c2d5-ca72-4782-835a-535b594ea50f tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d424f88d-5f82-4cac-aa0f-4f99624bd3e7" status: 200 len: 1661 microversion: 2.1 time: 0.256789 Apr 11 19:29:41 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 156/472] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 19:29:41 2023] GET /compute/v2.1/servers/d424f88d-5f82-4cac-aa0f-4f99624bd3e7 => generated 1661 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:29:41 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [req-89f93d6f-06a7-4ce2-ae43-8c6db29272cd req-fe60861c-fa66-473c-ad13-f1e8db46743e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d424f88d-5f82-4cac-aa0f-4f99624bd3e7", "name": "network-vif-unplugged", "status": "completed", "tag": "93054605-985d-4168-9809-21feb31c1346"}]} {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:29:41 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-89f93d6f-06a7-4ce2-ae43-8c6db29272cd req-fe60861c-fa66-473c-ad13-f1e8db46743e service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:29:41 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-89f93d6f-06a7-4ce2-ae43-8c6db29272cd req-fe60861c-fa66-473c-ad13-f1e8db46743e service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:29:41 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-89f93d6f-06a7-4ce2-ae43-8c6db29272cd req-fe60861c-fa66-473c-ad13-f1e8db46743e service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:29:41 user devstack@n-api.service[72089]: INFO nova.api.openstack.compute.server_external_events [req-89f93d6f-06a7-4ce2-ae43-8c6db29272cd req-fe60861c-fa66-473c-ad13-f1e8db46743e service nova] Creating event network-vif-unplugged:93054605-985d-4168-9809-21feb31c1346 for instance d424f88d-5f82-4cac-aa0f-4f99624bd3e7 on user Apr 11 19:29:41 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [req-89f93d6f-06a7-4ce2-ae43-8c6db29272cd req-fe60861c-fa66-473c-ad13-f1e8db46743e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.040643 Apr 11 19:29:41 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 162/473] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:29:41 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:29:43 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [req-0befb0df-2548-46e8-96e6-eef7c0051c50 req-90dc4759-c2b4-4977-9b5d-d53b9445f9ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d424f88d-5f82-4cac-aa0f-4f99624bd3e7", "name": "network-vif-deleted", "tag": "93054605-985d-4168-9809-21feb31c1346"}]} {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:29:43 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-0befb0df-2548-46e8-96e6-eef7c0051c50 req-90dc4759-c2b4-4977-9b5d-d53b9445f9ee service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:29:43 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-0befb0df-2548-46e8-96e6-eef7c0051c50 req-90dc4759-c2b4-4977-9b5d-d53b9445f9ee service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:29:43 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-0befb0df-2548-46e8-96e6-eef7c0051c50 req-90dc4759-c2b4-4977-9b5d-d53b9445f9ee service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:29:43 user devstack@n-api.service[72090]: INFO nova.api.openstack.compute.server_external_events [req-0befb0df-2548-46e8-96e6-eef7c0051c50 req-90dc4759-c2b4-4977-9b5d-d53b9445f9ee service nova] Creating event network-vif-deleted:93054605-985d-4168-9809-21feb31c1346 for instance d424f88d-5f82-4cac-aa0f-4f99624bd3e7 on user Apr 11 19:29:43 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [req-0befb0df-2548-46e8-96e6-eef7c0051c50 req-90dc4759-c2b4-4977-9b5d-d53b9445f9ee service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029018 Apr 11 19:29:43 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 156/474] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:29:43 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:29:43 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [req-59a73105-e7b1-42c7-949c-e622a7514c65 req-ba649d38-92e9-4643-9c7e-b620e016500a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d424f88d-5f82-4cac-aa0f-4f99624bd3e7", "name": "network-vif-plugged", "status": "completed", "tag": "93054605-985d-4168-9809-21feb31c1346"}]} {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:29:43 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-59a73105-e7b1-42c7-949c-e622a7514c65 req-ba649d38-92e9-4643-9c7e-b620e016500a service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:29:43 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-59a73105-e7b1-42c7-949c-e622a7514c65 req-ba649d38-92e9-4643-9c7e-b620e016500a service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:29:43 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-59a73105-e7b1-42c7-949c-e622a7514c65 req-ba649d38-92e9-4643-9c7e-b620e016500a service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:29:43 user devstack@n-api.service[72088]: INFO nova.api.openstack.compute.server_external_events [req-59a73105-e7b1-42c7-949c-e622a7514c65 req-ba649d38-92e9-4643-9c7e-b620e016500a service nova] Creating event network-vif-plugged:93054605-985d-4168-9809-21feb31c1346 for instance d424f88d-5f82-4cac-aa0f-4f99624bd3e7 on user Apr 11 19:29:43 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [req-59a73105-e7b1-42c7-949c-e622a7514c65 req-ba649d38-92e9-4643-9c7e-b620e016500a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030395 Apr 11 19:29:43 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 157/475] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:29:43 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:29:48 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [None req-4dfa21dc-0845-4206-b4b4-983b87e3fbc0 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-706054067", "imageRef": "4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:29:49 user devstack@n-api.service[72089]: DEBUG nova.network.neutron [None req-4dfa21dc-0845-4206-b4b4-983b87e3fbc0 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] validate_networks() for [('c1382921-467f-4bd9-a91e-24ffb75a9553', None, None, None, None, None)] {{(pid=72089) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 11 19:29:49 user devstack@n-api.service[72089]: DEBUG nova.virt.hardware [None req-4dfa21dc-0845-4206-b4b4-983b87e3fbc0 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Flavor limits 0:0:0 {{(pid=72089) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 19:29:49 user devstack@n-api.service[72089]: DEBUG nova.virt.hardware [None req-4dfa21dc-0845-4206-b4b4-983b87e3fbc0 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Image limits 0:0:0 {{(pid=72089) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 19:29:49 user devstack@n-api.service[72089]: DEBUG nova.virt.hardware [None req-4dfa21dc-0845-4206-b4b4-983b87e3fbc0 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Flavor pref 0:0:0 {{(pid=72089) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 19:29:49 user devstack@n-api.service[72089]: DEBUG nova.virt.hardware [None req-4dfa21dc-0845-4206-b4b4-983b87e3fbc0 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Image pref 0:0:0 {{(pid=72089) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 19:29:49 user devstack@n-api.service[72089]: DEBUG nova.virt.hardware [None req-4dfa21dc-0845-4206-b4b4-983b87e3fbc0 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72089) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 19:29:49 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-4dfa21dc-0845-4206-b4b4-983b87e3fbc0 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:29:49 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-4dfa21dc-0845-4206-b4b4-983b87e3fbc0 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:29:49 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-4dfa21dc-0845-4206-b4b4-983b87e3fbc0 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:29:49 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-4dfa21dc-0845-4206-b4b4-983b87e3fbc0 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:29:49 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-4dfa21dc-0845-4206-b4b4-983b87e3fbc0 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:29:49 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-4dfa21dc-0845-4206-b4b4-983b87e3fbc0 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:29:49 user devstack@n-api.service[72089]: DEBUG nova.quota [None req-4dfa21dc-0845-4206-b4b4-983b87e3fbc0 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Getting quotas for project b8e3a291c54b49db8e12a88ba41865e3. Resources: {'ram', 'instances', 'cores'} {{(pid=72089) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 19:29:49 user devstack@n-api.service[72089]: DEBUG nova.quota [None req-4dfa21dc-0845-4206-b4b4-983b87e3fbc0 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Getting quotas for user ba7f82b529e74d99838b6264b94d823b and project b8e3a291c54b49db8e12a88ba41865e3. Resources: {'ram', 'instances', 'cores'} {{(pid=72089) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 19:29:49 user devstack@n-api.service[72089]: DEBUG nova.compute.api [None req-4dfa21dc-0845-4206-b4b4-983b87e3fbc0 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Going to run 1 instances... {{(pid=72089) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 11 19:29:49 user devstack@n-api.service[72089]: DEBUG nova.compute.api [None req-4dfa21dc-0845-4206-b4b4-983b87e3fbc0 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] [instance: 267c17c1-f0b6-4e18-8c18-5e5bbe8a2251] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=72089) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 11 19:29:49 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [None req-4dfa21dc-0845-4206-b4b4-983b87e3fbc0 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 381 microversion: 2.1 time: 0.726010 Apr 11 19:29:49 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 163/476] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 11 19:29:48 2023] POST /compute/v2.1/servers => generated 381 bytes in 729 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 11 19:29:49 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [None req-c06bae3f-db42-41f5-b3c6-e5784be7df2f tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Calling method '>' {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:29:49 user devstack@n-api.service[72090]: DEBUG nova.compute.api [None req-c06bae3f-db42-41f5-b3c6-e5784be7df2f tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] [instance: 267c17c1-f0b6-4e18-8c18-5e5bbe8a2251] Fetching instance by UUID {{(pid=72090) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:29:49 user devstack@n-api.service[72090]: DEBUG nova.policy [None req-c06bae3f-db42-41f5-b3c6-e5784be7df2f tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba7f82b529e74d99838b6264b94d823b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e3a291c54b49db8e12a88ba41865e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72090) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:29:49 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [None req-c06bae3f-db42-41f5-b3c6-e5784be7df2f tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] 10.0.0.210 "GET /compute/v2.1/servers/267c17c1-f0b6-4e18-8c18-5e5bbe8a2251" status: 200 len: 1215 microversion: 2.1 time: 0.066884 Apr 11 19:29:49 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 157/477] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 19:29:49 2023] GET /compute/v2.1/servers/267c17c1-f0b6-4e18-8c18-5e5bbe8a2251 => generated 1215 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:29:49 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [None req-1f58cfbb-4553-4dfb-8f50-85214e9bbe88 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1478797351", "imageRef": "4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:29:49 user devstack@n-api.service[72088]: DEBUG nova.network.neutron [None req-1f58cfbb-4553-4dfb-8f50-85214e9bbe88 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] validate_networks() for [('c1382921-467f-4bd9-a91e-24ffb75a9553', None, None, None, None, None)] {{(pid=72088) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 11 19:29:50 user devstack@n-api.service[72088]: DEBUG nova.virt.hardware [None req-1f58cfbb-4553-4dfb-8f50-85214e9bbe88 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Flavor limits 0:0:0 {{(pid=72088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 19:29:50 user devstack@n-api.service[72088]: DEBUG nova.virt.hardware [None req-1f58cfbb-4553-4dfb-8f50-85214e9bbe88 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Image limits 0:0:0 {{(pid=72088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 19:29:50 user devstack@n-api.service[72088]: DEBUG nova.virt.hardware [None req-1f58cfbb-4553-4dfb-8f50-85214e9bbe88 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Flavor pref 0:0:0 {{(pid=72088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 19:29:50 user devstack@n-api.service[72088]: DEBUG nova.virt.hardware [None req-1f58cfbb-4553-4dfb-8f50-85214e9bbe88 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Image pref 0:0:0 {{(pid=72088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 19:29:50 user devstack@n-api.service[72088]: DEBUG nova.virt.hardware [None req-1f58cfbb-4553-4dfb-8f50-85214e9bbe88 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 19:29:50 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-1f58cfbb-4553-4dfb-8f50-85214e9bbe88 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:29:50 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-1f58cfbb-4553-4dfb-8f50-85214e9bbe88 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:29:50 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-1f58cfbb-4553-4dfb-8f50-85214e9bbe88 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:29:50 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-1f58cfbb-4553-4dfb-8f50-85214e9bbe88 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:29:50 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-1f58cfbb-4553-4dfb-8f50-85214e9bbe88 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:29:50 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-1f58cfbb-4553-4dfb-8f50-85214e9bbe88 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:29:50 user devstack@n-api.service[72088]: DEBUG nova.quota [None req-1f58cfbb-4553-4dfb-8f50-85214e9bbe88 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Getting quotas for project b8e3a291c54b49db8e12a88ba41865e3. Resources: {'ram', 'instances', 'cores'} {{(pid=72088) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 19:29:50 user devstack@n-api.service[72088]: DEBUG nova.quota [None req-1f58cfbb-4553-4dfb-8f50-85214e9bbe88 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Getting quotas for user ba7f82b529e74d99838b6264b94d823b and project b8e3a291c54b49db8e12a88ba41865e3. Resources: {'ram', 'instances', 'cores'} {{(pid=72088) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 19:29:50 user devstack@n-api.service[72088]: DEBUG nova.compute.api [None req-1f58cfbb-4553-4dfb-8f50-85214e9bbe88 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Going to run 1 instances... {{(pid=72088) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 11 19:29:50 user devstack@n-api.service[72088]: DEBUG nova.compute.api [None req-1f58cfbb-4553-4dfb-8f50-85214e9bbe88 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] [instance: 6f2616ce-4924-4b82-996a-2596ae8856a4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=72088) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 11 19:29:50 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [None req-1f58cfbb-4553-4dfb-8f50-85214e9bbe88 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 381 microversion: 2.1 time: 0.909974 Apr 11 19:29:50 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 158/478] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 11 19:29:49 2023] POST /compute/v2.1/servers => generated 381 bytes in 914 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 11 19:29:50 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [None req-c736a8a4-eb3c-4dee-a0fa-38d4a7c6b256 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Calling method '>' {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:29:50 user devstack@n-api.service[72089]: DEBUG nova.compute.api [None req-c736a8a4-eb3c-4dee-a0fa-38d4a7c6b256 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] [instance: 6f2616ce-4924-4b82-996a-2596ae8856a4] Fetching instance by UUID {{(pid=72089) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:29:50 user devstack@n-api.service[72089]: DEBUG nova.policy [None req-c736a8a4-eb3c-4dee-a0fa-38d4a7c6b256 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba7f82b529e74d99838b6264b94d823b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e3a291c54b49db8e12a88ba41865e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72089) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:29:50 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [None req-c736a8a4-eb3c-4dee-a0fa-38d4a7c6b256 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6f2616ce-4924-4b82-996a-2596ae8856a4" status: 200 len: 1216 microversion: 2.1 time: 0.100171 Apr 11 19:29:50 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 164/479] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 19:29:50 2023] GET /compute/v2.1/servers/6f2616ce-4924-4b82-996a-2596ae8856a4 => generated 1216 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:29:52 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [req-ecc7baf3-6b60-4ce9-9c4b-b92e516cbfa0 req-a58fd92d-2629-4d85-a7d3-54a8d9e49a55 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "267c17c1-f0b6-4e18-8c18-5e5bbe8a2251", "tag": "06fea704-e356-4605-811e-aac91617290e"}]} {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:29:52 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-ecc7baf3-6b60-4ce9-9c4b-b92e516cbfa0 req-a58fd92d-2629-4d85-a7d3-54a8d9e49a55 service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:29:52 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-ecc7baf3-6b60-4ce9-9c4b-b92e516cbfa0 req-a58fd92d-2629-4d85-a7d3-54a8d9e49a55 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:29:52 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-ecc7baf3-6b60-4ce9-9c4b-b92e516cbfa0 req-a58fd92d-2629-4d85-a7d3-54a8d9e49a55 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:29:52 user devstack@n-api.service[72090]: INFO nova.api.openstack.compute.server_external_events [req-ecc7baf3-6b60-4ce9-9c4b-b92e516cbfa0 req-a58fd92d-2629-4d85-a7d3-54a8d9e49a55 service nova] Creating event network-changed:06fea704-e356-4605-811e-aac91617290e for instance 267c17c1-f0b6-4e18-8c18-5e5bbe8a2251 on user Apr 11 19:29:52 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [req-ecc7baf3-6b60-4ce9-9c4b-b92e516cbfa0 req-a58fd92d-2629-4d85-a7d3-54a8d9e49a55 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.027167 Apr 11 19:29:52 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 158/480] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:29:52 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:29:53 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [req-5c53355f-52bc-4f8e-9b74-1e10eb524b41 req-7660290b-ecec-4e58-989d-55d577b95e4b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6f2616ce-4924-4b82-996a-2596ae8856a4", "tag": "1c929bc1-2708-4e38-80b3-354812ccb529"}]} {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:29:53 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-5c53355f-52bc-4f8e-9b74-1e10eb524b41 req-7660290b-ecec-4e58-989d-55d577b95e4b service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:29:53 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-5c53355f-52bc-4f8e-9b74-1e10eb524b41 req-7660290b-ecec-4e58-989d-55d577b95e4b service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:29:53 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-5c53355f-52bc-4f8e-9b74-1e10eb524b41 req-7660290b-ecec-4e58-989d-55d577b95e4b service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:29:53 user devstack@n-api.service[72088]: INFO nova.api.openstack.compute.server_external_events [req-5c53355f-52bc-4f8e-9b74-1e10eb524b41 req-7660290b-ecec-4e58-989d-55d577b95e4b service nova] Creating event network-changed:1c929bc1-2708-4e38-80b3-354812ccb529 for instance 6f2616ce-4924-4b82-996a-2596ae8856a4 on user Apr 11 19:29:53 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [req-5c53355f-52bc-4f8e-9b74-1e10eb524b41 req-7660290b-ecec-4e58-989d-55d577b95e4b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029191 Apr 11 19:29:53 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 159/481] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:29:53 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 11 19:29:55 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [req-44764536-ec8c-4131-a6a3-940f27943e00 req-435614ff-5bc5-49db-aa8f-a24910227bdc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "267c17c1-f0b6-4e18-8c18-5e5bbe8a2251", "name": "network-vif-plugged", "status": "completed", "tag": "06fea704-e356-4605-811e-aac91617290e"}, {"server_uuid": "267c17c1-f0b6-4e18-8c18-5e5bbe8a2251", "name": "network-vif-plugged", "status": "completed", "tag": "06fea704-e356-4605-811e-aac91617290e"}]} {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:29:55 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-44764536-ec8c-4131-a6a3-940f27943e00 req-435614ff-5bc5-49db-aa8f-a24910227bdc service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:29:55 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-44764536-ec8c-4131-a6a3-940f27943e00 req-435614ff-5bc5-49db-aa8f-a24910227bdc service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:29:55 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-44764536-ec8c-4131-a6a3-940f27943e00 req-435614ff-5bc5-49db-aa8f-a24910227bdc service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:29:55 user devstack@n-api.service[72089]: INFO nova.api.openstack.compute.server_external_events [req-44764536-ec8c-4131-a6a3-940f27943e00 req-435614ff-5bc5-49db-aa8f-a24910227bdc service nova] Creating event network-vif-plugged:06fea704-e356-4605-811e-aac91617290e for instance 267c17c1-f0b6-4e18-8c18-5e5bbe8a2251 on user Apr 11 19:29:55 user devstack@n-api.service[72089]: INFO nova.api.openstack.compute.server_external_events [req-44764536-ec8c-4131-a6a3-940f27943e00 req-435614ff-5bc5-49db-aa8f-a24910227bdc service nova] Creating event network-vif-plugged:06fea704-e356-4605-811e-aac91617290e for instance 267c17c1-f0b6-4e18-8c18-5e5bbe8a2251 on user Apr 11 19:29:55 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [req-44764536-ec8c-4131-a6a3-940f27943e00 req-435614ff-5bc5-49db-aa8f-a24910227bdc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.028831 Apr 11 19:29:55 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 165/482] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:29:55 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:29:55 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [req-def02d6f-58c8-4c57-947a-90457b464179 req-a543143a-c0db-4d64-8150-03ae0fbb504d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f2616ce-4924-4b82-996a-2596ae8856a4", "name": "network-vif-plugged", "status": "completed", "tag": "1c929bc1-2708-4e38-80b3-354812ccb529"}]} {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:29:56 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-def02d6f-58c8-4c57-947a-90457b464179 req-a543143a-c0db-4d64-8150-03ae0fbb504d service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:29:56 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-def02d6f-58c8-4c57-947a-90457b464179 req-a543143a-c0db-4d64-8150-03ae0fbb504d service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:29:56 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-def02d6f-58c8-4c57-947a-90457b464179 req-a543143a-c0db-4d64-8150-03ae0fbb504d service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:29:56 user devstack@n-api.service[72090]: INFO nova.api.openstack.compute.server_external_events [req-def02d6f-58c8-4c57-947a-90457b464179 req-a543143a-c0db-4d64-8150-03ae0fbb504d service nova] Creating event network-vif-plugged:1c929bc1-2708-4e38-80b3-354812ccb529 for instance 6f2616ce-4924-4b82-996a-2596ae8856a4 on user Apr 11 19:29:56 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [req-def02d6f-58c8-4c57-947a-90457b464179 req-a543143a-c0db-4d64-8150-03ae0fbb504d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028215 Apr 11 19:29:56 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 159/483] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:29:55 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:29:58 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [req-6531260b-3f8f-4751-bdd1-30080e77fbdf req-4e5b64b7-828d-432d-808f-1ac9fcc6a710 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f2616ce-4924-4b82-996a-2596ae8856a4", "name": "network-vif-plugged", "status": "completed", "tag": "1c929bc1-2708-4e38-80b3-354812ccb529"}]} {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:29:58 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-6531260b-3f8f-4751-bdd1-30080e77fbdf req-4e5b64b7-828d-432d-808f-1ac9fcc6a710 service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:29:58 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-6531260b-3f8f-4751-bdd1-30080e77fbdf req-4e5b64b7-828d-432d-808f-1ac9fcc6a710 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:29:58 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-6531260b-3f8f-4751-bdd1-30080e77fbdf req-4e5b64b7-828d-432d-808f-1ac9fcc6a710 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:29:58 user devstack@n-api.service[72088]: INFO nova.api.openstack.compute.server_external_events [req-6531260b-3f8f-4751-bdd1-30080e77fbdf req-4e5b64b7-828d-432d-808f-1ac9fcc6a710 service nova] Creating event network-vif-plugged:1c929bc1-2708-4e38-80b3-354812ccb529 for instance 6f2616ce-4924-4b82-996a-2596ae8856a4 on user Apr 11 19:29:58 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [req-6531260b-3f8f-4751-bdd1-30080e77fbdf req-4e5b64b7-828d-432d-808f-1ac9fcc6a710 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071881 Apr 11 19:29:58 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 160/484] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:29:58 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:29:59 user devstack@n-api.service[72089]: DEBUG dbcounter [-] [72089] Writing DB stats nova_cell0:SELECT=2 {{(pid=72089) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:29:59 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [None req-10e0203c-6654-472e-9f5f-29fb59116e49 tempest-VolumesNegativeTest-1402597116 tempest-VolumesNegativeTest-1402597116-project-member] Calling method '>' {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:29:59 user devstack@n-api.service[72089]: DEBUG nova.compute.api [None req-10e0203c-6654-472e-9f5f-29fb59116e49 tempest-VolumesNegativeTest-1402597116 tempest-VolumesNegativeTest-1402597116-project-member] [instance: 9466c3da-2c99-41ea-9fb4-41ffbaa9910a] Fetching instance by UUID {{(pid=72089) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:29:59 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-10e0203c-6654-472e-9f5f-29fb59116e49 tempest-VolumesNegativeTest-1402597116 tempest-VolumesNegativeTest-1402597116-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:29:59 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-10e0203c-6654-472e-9f5f-29fb59116e49 tempest-VolumesNegativeTest-1402597116 tempest-VolumesNegativeTest-1402597116-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:29:59 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-10e0203c-6654-472e-9f5f-29fb59116e49 tempest-VolumesNegativeTest-1402597116 tempest-VolumesNegativeTest-1402597116-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:29:59 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-10e0203c-6654-472e-9f5f-29fb59116e49 tempest-VolumesNegativeTest-1402597116 tempest-VolumesNegativeTest-1402597116-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:29:59 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-10e0203c-6654-472e-9f5f-29fb59116e49 tempest-VolumesNegativeTest-1402597116 tempest-VolumesNegativeTest-1402597116-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:29:59 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-10e0203c-6654-472e-9f5f-29fb59116e49 tempest-VolumesNegativeTest-1402597116 tempest-VolumesNegativeTest-1402597116-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:29:59 user devstack@n-api.service[72089]: DEBUG nova.policy [None req-10e0203c-6654-472e-9f5f-29fb59116e49 tempest-VolumesNegativeTest-1402597116 tempest-VolumesNegativeTest-1402597116-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '996881d74ec246f0ac53411a8ca0e7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e983656394754cf68837587d74f9fbb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72089) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:29:59 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [None req-10e0203c-6654-472e-9f5f-29fb59116e49 tempest-VolumesNegativeTest-1402597116 tempest-VolumesNegativeTest-1402597116-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9466c3da-2c99-41ea-9fb4-41ffbaa9910a" status: 200 len: 1455 microversion: 2.1 time: 0.176302 Apr 11 19:29:59 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 166/485] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 19:29:59 2023] GET /compute/v2.1/servers/9466c3da-2c99-41ea-9fb4-41ffbaa9910a => generated 1455 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:30:07 user devstack@n-api.service[72090]: DEBUG dbcounter [-] [72090] Writing DB stats nova_cell0:SELECT=2 {{(pid=72090) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:30:07 user devstack@n-api.service[72090]: DEBUG dbcounter [-] [72090] Writing DB stats nova_api:SELECT=22,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=72090) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:30:07 user devstack@n-api.service[72090]: DEBUG dbcounter [-] [72090] Writing DB stats nova_cell1:SELECT=27,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=72090) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:30:07 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [None req-06c62946-6fb2-46aa-af83-5593715ef53a tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Calling method '>' {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:30:07 user devstack@n-api.service[72090]: DEBUG nova.compute.api [None req-06c62946-6fb2-46aa-af83-5593715ef53a tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] [instance: 558100b9-f3ac-47c7-9260-b897b0cae55f] Fetching instance by UUID {{(pid=72090) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:30:07 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-06c62946-6fb2-46aa-af83-5593715ef53a tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:30:07 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-06c62946-6fb2-46aa-af83-5593715ef53a tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:30:07 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-06c62946-6fb2-46aa-af83-5593715ef53a tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:30:07 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-06c62946-6fb2-46aa-af83-5593715ef53a tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:30:07 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-06c62946-6fb2-46aa-af83-5593715ef53a tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:30:07 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-06c62946-6fb2-46aa-af83-5593715ef53a tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:30:07 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [None req-06c62946-6fb2-46aa-af83-5593715ef53a tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] 10.0.0.210 "GET /compute/v2.1/servers/558100b9-f3ac-47c7-9260-b897b0cae55f/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.101938 Apr 11 19:30:07 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 160/486] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Apr 11 19:30:07 2023] GET /compute/v2.1/servers/558100b9-f3ac-47c7-9260-b897b0cae55f/os-interface => generated 282 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:30:08 user devstack@n-api.service[72088]: DEBUG dbcounter [-] [72088] Writing DB stats nova_cell0:SELECT=2 {{(pid=72088) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:30:08 user devstack@n-api.service[72088]: DEBUG dbcounter [-] [72088] Writing DB stats nova_cell0:SELECT=6 {{(pid=72088) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:30:08 user devstack@n-api.service[72088]: DEBUG dbcounter [-] [72088] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=3 {{(pid=72088) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:30:08 user devstack@n-api.service[72088]: DEBUG dbcounter [-] [72088] Writing DB stats nova_cell1:SELECT=28 {{(pid=72088) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:30:08 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [req-78b60368-e3c9-489e-b5ee-3d940344127d req-ad101cbe-a08d-46c9-a166-6bb3df117c2e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "558100b9-f3ac-47c7-9260-b897b0cae55f", "tag": "4f568bd5-7271-434e-a30e-beb13759e1f1"}]} {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:30:08 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-78b60368-e3c9-489e-b5ee-3d940344127d req-ad101cbe-a08d-46c9-a166-6bb3df117c2e service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:30:08 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-78b60368-e3c9-489e-b5ee-3d940344127d req-ad101cbe-a08d-46c9-a166-6bb3df117c2e service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:30:08 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-78b60368-e3c9-489e-b5ee-3d940344127d req-ad101cbe-a08d-46c9-a166-6bb3df117c2e service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:30:08 user devstack@n-api.service[72088]: INFO nova.api.openstack.compute.server_external_events [req-78b60368-e3c9-489e-b5ee-3d940344127d req-ad101cbe-a08d-46c9-a166-6bb3df117c2e service nova] Creating event network-changed:4f568bd5-7271-434e-a30e-beb13759e1f1 for instance 558100b9-f3ac-47c7-9260-b897b0cae55f on user Apr 11 19:30:08 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [req-78b60368-e3c9-489e-b5ee-3d940344127d req-ad101cbe-a08d-46c9-a166-6bb3df117c2e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.173407 Apr 11 19:30:08 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 161/487] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:30:08 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:30:08 user devstack@n-api.service[72089]: DEBUG dbcounter [-] [72089] Writing DB stats nova_cell0:SELECT=8 {{(pid=72089) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:30:08 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [None req-4947aa1d-45d0-4953-b45a-9429ed2e1af3 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Calling method '>' {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:30:08 user devstack@n-api.service[72089]: DEBUG nova.compute.api [None req-4947aa1d-45d0-4953-b45a-9429ed2e1af3 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] [instance: 558100b9-f3ac-47c7-9260-b897b0cae55f] Fetching instance by UUID {{(pid=72089) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:30:08 user devstack@n-api.service[72089]: DEBUG dbcounter [-] [72089] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=3 {{(pid=72089) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:30:08 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-4947aa1d-45d0-4953-b45a-9429ed2e1af3 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:30:08 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-4947aa1d-45d0-4953-b45a-9429ed2e1af3 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:30:08 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-4947aa1d-45d0-4953-b45a-9429ed2e1af3 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:30:08 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-4947aa1d-45d0-4953-b45a-9429ed2e1af3 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:30:08 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-4947aa1d-45d0-4953-b45a-9429ed2e1af3 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:30:08 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-4947aa1d-45d0-4953-b45a-9429ed2e1af3 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:30:08 user devstack@n-api.service[72089]: DEBUG dbcounter [-] [72089] Writing DB stats nova_cell1:SELECT=23 {{(pid=72089) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:30:08 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [None req-4947aa1d-45d0-4953-b45a-9429ed2e1af3 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] 10.0.0.210 "GET /compute/v2.1/servers/558100b9-f3ac-47c7-9260-b897b0cae55f/ips" status: 200 len: 107 microversion: 2.1 time: 0.049992 Apr 11 19:30:08 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 167/488] 10.0.0.210 () {62 vars in 1325 bytes} [Tue Apr 11 19:30:08 2023] GET /compute/v2.1/servers/558100b9-f3ac-47c7-9260-b897b0cae55f/ips => generated 107 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 11 19:30:10 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [None req-5f8c97af-4bcb-4f0e-8f48-c6b945df7d1b tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ac30dce5-e2c0-4981-af4a-10be9d923877"}} {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:30:10 user devstack@n-api.service[72090]: DEBUG nova.compute.api [None req-5f8c97af-4bcb-4f0e-8f48-c6b945df7d1b tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] [instance: 558100b9-f3ac-47c7-9260-b897b0cae55f] Fetching instance by UUID {{(pid=72090) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:30:10 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-5f8c97af-4bcb-4f0e-8f48-c6b945df7d1b tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:30:10 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-5f8c97af-4bcb-4f0e-8f48-c6b945df7d1b tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:30:10 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-5f8c97af-4bcb-4f0e-8f48-c6b945df7d1b tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:30:10 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-5f8c97af-4bcb-4f0e-8f48-c6b945df7d1b tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:30:10 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-5f8c97af-4bcb-4f0e-8f48-c6b945df7d1b tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:30:10 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-5f8c97af-4bcb-4f0e-8f48-c6b945df7d1b tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:30:10 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [None req-5f8c97af-4bcb-4f0e-8f48-c6b945df7d1b tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] 10.0.0.210 "POST /compute/v2.1/servers/558100b9-f3ac-47c7-9260-b897b0cae55f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.307667 Apr 11 19:30:10 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 161/489] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Apr 11 19:30:10 2023] POST /compute/v2.1/servers/558100b9-f3ac-47c7-9260-b897b0cae55f/os-volume_attachments => generated 194 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:30:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [None req-a8c1c43a-9e5a-4135-9846-240b229b23fe tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ac30dce5-e2c0-4981-af4a-10be9d923877"}} {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:30:17 user devstack@n-api.service[72088]: DEBUG nova.compute.api [None req-a8c1c43a-9e5a-4135-9846-240b229b23fe tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] [instance: 558100b9-f3ac-47c7-9260-b897b0cae55f] Fetching instance by UUID {{(pid=72088) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:30:17 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-a8c1c43a-9e5a-4135-9846-240b229b23fe tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:30:17 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-a8c1c43a-9e5a-4135-9846-240b229b23fe tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:30:17 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-a8c1c43a-9e5a-4135-9846-240b229b23fe tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:30:17 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-a8c1c43a-9e5a-4135-9846-240b229b23fe tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:30:17 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-a8c1c43a-9e5a-4135-9846-240b229b23fe tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:30:17 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-a8c1c43a-9e5a-4135-9846-240b229b23fe tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:30:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [None req-6ca36354-831a-4a53-b4f4-bbb4a9eacdfd tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] Calling method '>' {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:30:17 user devstack@n-api.service[72089]: DEBUG nova.compute.api [None req-6ca36354-831a-4a53-b4f4-bbb4a9eacdfd tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] [instance: e84ad0e4-a65b-404c-adbf-c49d5f0b3cca] Fetching instance by UUID {{(pid=72089) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:30:17 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-6ca36354-831a-4a53-b4f4-bbb4a9eacdfd tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:30:17 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-6ca36354-831a-4a53-b4f4-bbb4a9eacdfd tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:30:17 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-6ca36354-831a-4a53-b4f4-bbb4a9eacdfd tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:30:17 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-6ca36354-831a-4a53-b4f4-bbb4a9eacdfd tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:30:17 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-6ca36354-831a-4a53-b4f4-bbb4a9eacdfd tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:30:17 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-6ca36354-831a-4a53-b4f4-bbb4a9eacdfd tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:30:17 user devstack@n-api.service[72089]: INFO nova.api.openstack.wsgi [None req-6ca36354-831a-4a53-b4f4-bbb4a9eacdfd tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] HTTP exception thrown: Instance e84ad0e4-a65b-404c-adbf-c49d5f0b3cca could not be found. Apr 11 19:30:17 user devstack@n-api.service[72088]: INFO nova.api.openstack.wsgi [None req-a8c1c43a-9e5a-4135-9846-240b229b23fe tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] HTTP exception thrown: Invalid volume: volume ac30dce5-e2c0-4981-af4a-10be9d923877 is already attached to instances: 558100b9-f3ac-47c7-9260-b897b0cae55f Apr 11 19:30:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [None req-6ca36354-831a-4a53-b4f4-bbb4a9eacdfd tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] Request method failure captured: Apr 11 19:30:17 user devstack@n-api.service[72089]: request: DELETE /compute/v2.1/servers/e84ad0e4-a65b-404c-adbf-c49d5f0b3cca HTTP/1.1 Apr 11 19:30:17 user devstack@n-api.service[72089]: Accept: application/json Apr 11 19:30:17 user devstack@n-api.service[72089]: Accept-Encoding: identity Apr 11 19:30:17 user devstack@n-api.service[72089]: Connection: close Apr 11 19:30:17 user devstack@n-api.service[72089]: Content-Length: 0 Apr 11 19:30:17 user devstack@n-api.service[72089]: Content-Type: application/json Apr 11 19:30:17 user devstack@n-api.service[72089]: Host: 10.0.0.210 Apr 11 19:30:17 user devstack@n-api.service[72089]: Openstack-System-Scope: None Apr 11 19:30:17 user devstack@n-api.service[72089]: User-Agent: python-urllib3/1.26.15 Apr 11 19:30:17 user devstack@n-api.service[72089]: X-Auth-Token: gAAAAABkNbM9ghjK_EzyGnW10Ps6cv4IuUgiOsH3-4CZQwwhssOT7z-coBiD1Tdn5TLuazoYlNl2MKZxDC8EHQ-1kxF1ymJhDXjVHNMOdUuaIOx6Zld44aVLhO1ciOh-QMlmbYyfhSKlVncwSZpaRu_co_jrVH31BrJgKqwLygUbeq6C-c51jnQ Apr 11 19:30:17 user devstack@n-api.service[72089]: X-Domain-Id: None Apr 11 19:30:17 user devstack@n-api.service[72089]: X-Domain-Name: None Apr 11 19:30:17 user devstack@n-api.service[72089]: X-Identity-Status: Confirmed Apr 11 19:30:17 user devstack@n-api.service[72089]: X-Is-Admin-Project: True Apr 11 19:30:17 user devstack@n-api.service[72089]: X-Project-Domain-Id: default Apr 11 19:30:17 user devstack@n-api.service[72089]: X-Project-Domain-Name: Default Apr 11 19:30:17 user devstack@n-api.service[72089]: X-Project-Id: 0d5d7769df1e4974b295cb30407151dd Apr 11 19:30:17 user devstack@n-api.service[72089]: X-Project-Name: tempest-ServersNegativeTestJSON-1311045721 Apr 11 19:30:17 user devstack@n-api.service[72089]: X-Role: reader,member Apr 11 19:30:17 user devstack@n-api.service[72089]: X-Roles: reader,member Apr 11 19:30:17 user devstack@n-api.service[72089]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0d5d7769df1e4974b295cb30407151dd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/0d5d7769df1e4974b295cb30407151dd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0d5d7769df1e4974b295cb30407151dd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 11 19:30:17 user devstack@n-api.service[72089]: X-Tenant: tempest-ServersNegativeTestJSON-1311045721 Apr 11 19:30:17 user devstack@n-api.service[72089]: X-Tenant-Id: 0d5d7769df1e4974b295cb30407151dd Apr 11 19:30:17 user devstack@n-api.service[72089]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1311045721 Apr 11 19:30:17 user devstack@n-api.service[72089]: X-User: tempest-ServersNegativeTestJSON-1311045721-project-member Apr 11 19:30:17 user devstack@n-api.service[72089]: X-User-Domain-Id: default Apr 11 19:30:17 user devstack@n-api.service[72089]: X-User-Domain-Name: Default Apr 11 19:30:17 user devstack@n-api.service[72089]: X-User-Id: 2f44dfa2528b4540a81f4eb7c3f3f2f5 Apr 11 19:30:17 user devstack@n-api.service[72089]: X-User-Name: tempest-ServersNegativeTestJSON-1311045721-project-member Apr 11 19:30:17 user devstack@n-api.service[72089]: method: > Apr 11 19:30:17 user devstack@n-api.service[72089]: exception: Instance e84ad0e4-a65b-404c-adbf-c49d5f0b3cca could not be found. Apr 11 19:30:17 user devstack@n-api.service[72089]: action_args: {'id': 'e84ad0e4-a65b-404c-adbf-c49d5f0b3cca'} Apr 11 19:30:17 user devstack@n-api.service[72089]: {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 19:30:17 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:30:17 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 19:30:17 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 19:30:17 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 19:30:17 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 19:30:17 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 19:30:17 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 19:30:17 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 19:30:17 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 19:30:17 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e84ad0e4-a65b-404c-adbf-c49d5f0b3cca could not be found. Apr 11 19:30:17 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi Apr 11 19:30:17 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 19:30:17 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi Apr 11 19:30:17 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:30:17 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 19:30:17 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 19:30:17 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 19:30:17 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 19:30:17 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 19:30:17 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 19:30:17 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 11 19:30:17 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 11 19:30:17 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 11 19:30:17 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 11 19:30:17 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 19:30:17 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 19:30:17 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 19:30:17 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 19:30:17 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e84ad0e4-a65b-404c-adbf-c49d5f0b3cca could not be found. Apr 11 19:30:17 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi Apr 11 19:30:17 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 19:30:17 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi Apr 11 19:30:17 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:30:17 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 19:30:17 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 19:30:17 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 19:30:17 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 19:30:17 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e84ad0e4-a65b-404c-adbf-c49d5f0b3cca could not be found. Apr 11 19:30:17 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi Apr 11 19:30:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [None req-a8c1c43a-9e5a-4135-9846-240b229b23fe tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Request method failure captured: Apr 11 19:30:17 user devstack@n-api.service[72088]: request: POST /compute/v2.1/servers/558100b9-f3ac-47c7-9260-b897b0cae55f/os-volume_attachments HTTP/1.1 Apr 11 19:30:17 user devstack@n-api.service[72088]: Accept: application/json Apr 11 19:30:17 user devstack@n-api.service[72088]: Accept-Encoding: identity Apr 11 19:30:17 user devstack@n-api.service[72088]: Connection: close Apr 11 19:30:17 user devstack@n-api.service[72088]: Content-Length: 74 Apr 11 19:30:17 user devstack@n-api.service[72088]: Content-Type: application/json Apr 11 19:30:17 user devstack@n-api.service[72088]: Host: 10.0.0.210 Apr 11 19:30:17 user devstack@n-api.service[72088]: Openstack-System-Scope: None Apr 11 19:30:17 user devstack@n-api.service[72088]: User-Agent: python-urllib3/1.26.15 Apr 11 19:30:17 user devstack@n-api.service[72088]: X-Auth-Token: gAAAAABkNbM9PPhjuxFro365bgGlzXmEeNXBFjH7B9DXRG846ZOMZNO8rjcHBUXZkmUpO9G06QygHvaEJVpRlrFcJIyDYtH16p4qIRFo8lVfjRkqkJh8soUAdF5jsPsH_hjCF2czbYEFIUpkQBo9PM7kG8byL_cnEa6VpD9RmxIaxcGcdobg_-U Apr 11 19:30:17 user devstack@n-api.service[72088]: X-Domain-Id: None Apr 11 19:30:17 user devstack@n-api.service[72088]: X-Domain-Name: None Apr 11 19:30:17 user devstack@n-api.service[72088]: X-Identity-Status: Confirmed Apr 11 19:30:17 user devstack@n-api.service[72088]: X-Is-Admin-Project: True Apr 11 19:30:17 user devstack@n-api.service[72088]: X-Project-Domain-Id: default Apr 11 19:30:17 user devstack@n-api.service[72088]: X-Project-Domain-Name: Default Apr 11 19:30:17 user devstack@n-api.service[72088]: X-Project-Id: 06966e2f4d3a4dec92282c7ad348635d Apr 11 19:30:17 user devstack@n-api.service[72088]: X-Project-Name: tempest-AttachVolumeNegativeTest-303418642 Apr 11 19:30:17 user devstack@n-api.service[72088]: X-Role: reader,member Apr 11 19:30:17 user devstack@n-api.service[72088]: X-Roles: reader,member Apr 11 19:30:17 user devstack@n-api.service[72088]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/06966e2f4d3a4dec92282c7ad348635d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/06966e2f4d3a4dec92282c7ad348635d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/06966e2f4d3a4dec92282c7ad348635d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 11 19:30:17 user devstack@n-api.service[72088]: X-Tenant: tempest-AttachVolumeNegativeTest-303418642 Apr 11 19:30:17 user devstack@n-api.service[72088]: X-Tenant-Id: 06966e2f4d3a4dec92282c7ad348635d Apr 11 19:30:17 user devstack@n-api.service[72088]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-303418642 Apr 11 19:30:17 user devstack@n-api.service[72088]: X-User: tempest-AttachVolumeNegativeTest-303418642-project-member Apr 11 19:30:17 user devstack@n-api.service[72088]: X-User-Domain-Id: default Apr 11 19:30:17 user devstack@n-api.service[72088]: X-User-Domain-Name: Default Apr 11 19:30:17 user devstack@n-api.service[72088]: X-User-Id: d5d405421ceb4d99967ef2e7f55e7809 Apr 11 19:30:17 user devstack@n-api.service[72088]: X-User-Name: tempest-AttachVolumeNegativeTest-303418642-project-member Apr 11 19:30:17 user devstack@n-api.service[72088]: Apr 11 19:30:17 user devstack@n-api.service[72088]: {"volumeAttachment": {"volumeId": "ac30dce5-e2c0-4981-af4a-10be9d923877"}} Apr 11 19:30:17 user devstack@n-api.service[72088]: method: > Apr 11 19:30:17 user devstack@n-api.service[72088]: exception: Invalid volume: volume ac30dce5-e2c0-4981-af4a-10be9d923877 is already attached to instances: 558100b9-f3ac-47c7-9260-b897b0cae55f Apr 11 19:30:17 user devstack@n-api.service[72088]: action_args: {'server_id': '558100b9-f3ac-47c7-9260-b897b0cae55f', 'body': {'volumeAttachment': {'volumeId': 'ac30dce5-e2c0-4981-af4a-10be9d923877'}}} Apr 11 19:30:17 user devstack@n-api.service[72088]: {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 19:30:17 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:30:17 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Apr 11 19:30:17 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Apr 11 19:30:17 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Apr 11 19:30:17 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Apr 11 19:30:17 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Apr 11 19:30:17 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Apr 11 19:30:17 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5139, in attach_volume Apr 11 19:30:17 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Apr 11 19:30:17 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4979, in _check_volume_already_attached Apr 11 19:30:17 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Apr 11 19:30:17 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume ac30dce5-e2c0-4981-af4a-10be9d923877 is already attached to instances: 558100b9-f3ac-47c7-9260-b897b0cae55f Apr 11 19:30:17 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi Apr 11 19:30:17 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 19:30:17 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi Apr 11 19:30:17 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:30:17 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 19:30:17 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 19:30:17 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 19:30:17 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 19:30:17 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 19:30:17 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 19:30:17 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 11 19:30:17 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 11 19:30:17 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 11 19:30:17 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 11 19:30:17 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 11 19:30:17 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 11 19:30:17 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Apr 11 19:30:17 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Apr 11 19:30:17 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume ac30dce5-e2c0-4981-af4a-10be9d923877 is already attached to instances: 558100b9-f3ac-47c7-9260-b897b0cae55f Apr 11 19:30:17 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi Apr 11 19:30:17 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 19:30:17 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi Apr 11 19:30:17 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:30:17 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 19:30:17 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 19:30:17 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 19:30:17 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 19:30:17 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume ac30dce5-e2c0-4981-af4a-10be9d923877 is already attached to instances: 558100b9-f3ac-47c7-9260-b897b0cae55f Apr 11 19:30:17 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi Apr 11 19:30:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [None req-a8c1c43a-9e5a-4135-9846-240b229b23fe tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Returning 400 to user: Invalid volume: volume ac30dce5-e2c0-4981-af4a-10be9d923877 is already attached to instances: 558100b9-f3ac-47c7-9260-b897b0cae55f {{(pid=72088) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 19:30:17 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [None req-a8c1c43a-9e5a-4135-9846-240b229b23fe tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] 10.0.0.210 "POST /compute/v2.1/servers/558100b9-f3ac-47c7-9260-b897b0cae55f/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.122416 Apr 11 19:30:17 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 162/490] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Apr 11 19:30:17 2023] POST /compute/v2.1/servers/558100b9-f3ac-47c7-9260-b897b0cae55f/os-volume_attachments => generated 174 bytes in 125 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 11 19:30:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [None req-6ca36354-831a-4a53-b4f4-bbb4a9eacdfd tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] Returning 404 to user: Instance e84ad0e4-a65b-404c-adbf-c49d5f0b3cca could not be found. {{(pid=72089) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 19:30:17 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [None req-6ca36354-831a-4a53-b4f4-bbb4a9eacdfd tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/e84ad0e4-a65b-404c-adbf-c49d5f0b3cca" status: 404 len: 111 microversion: 2.1 time: 0.044555 Apr 11 19:30:17 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 168/491] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 19:30:17 2023] DELETE /compute/v2.1/servers/e84ad0e4-a65b-404c-adbf-c49d5f0b3cca => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 19:30:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [None req-4d8ce855-29cb-4024-8dea-c4ee482ca520 tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] Calling method '>' {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:30:17 user devstack@n-api.service[72090]: DEBUG nova.compute.api [None req-4d8ce855-29cb-4024-8dea-c4ee482ca520 tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] [instance: e84ad0e4-a65b-404c-adbf-c49d5f0b3cca] Fetching instance by UUID {{(pid=72090) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:30:17 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-4d8ce855-29cb-4024-8dea-c4ee482ca520 tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:30:17 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-4d8ce855-29cb-4024-8dea-c4ee482ca520 tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:30:17 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-4d8ce855-29cb-4024-8dea-c4ee482ca520 tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:30:17 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-4d8ce855-29cb-4024-8dea-c4ee482ca520 tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:30:17 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-4d8ce855-29cb-4024-8dea-c4ee482ca520 tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:30:17 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-4d8ce855-29cb-4024-8dea-c4ee482ca520 tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:30:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [None req-ff328c4b-f2db-4c88-a0c2-44a71d7a8a2c tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Action: 'action', calling method: >, body: {"rescue": {"rescue_image_ref": "fd4277e1-9257-4e4e-8dd2-0ed12c759968"}} {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:30:17 user devstack@n-api.service[72088]: DEBUG nova.compute.api [None req-ff328c4b-f2db-4c88-a0c2-44a71d7a8a2c tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] [instance: 864fcd9b-8e5b-4de8-a2e6-292a8907a834] Fetching instance by UUID {{(pid=72088) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:30:17 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-ff328c4b-f2db-4c88-a0c2-44a71d7a8a2c tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:30:17 user devstack@n-api.service[72090]: INFO nova.api.openstack.wsgi [None req-4d8ce855-29cb-4024-8dea-c4ee482ca520 tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] HTTP exception thrown: Instance e84ad0e4-a65b-404c-adbf-c49d5f0b3cca could not be found. Apr 11 19:30:17 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-ff328c4b-f2db-4c88-a0c2-44a71d7a8a2c tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:30:17 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-ff328c4b-f2db-4c88-a0c2-44a71d7a8a2c tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:30:17 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-ff328c4b-f2db-4c88-a0c2-44a71d7a8a2c tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:30:17 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-ff328c4b-f2db-4c88-a0c2-44a71d7a8a2c tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:30:17 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-ff328c4b-f2db-4c88-a0c2-44a71d7a8a2c tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:30:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [None req-4d8ce855-29cb-4024-8dea-c4ee482ca520 tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] Request method failure captured: Apr 11 19:30:17 user devstack@n-api.service[72090]: request: GET /compute/v2.1/servers/e84ad0e4-a65b-404c-adbf-c49d5f0b3cca HTTP/1.1 Apr 11 19:30:17 user devstack@n-api.service[72090]: Accept: application/json Apr 11 19:30:17 user devstack@n-api.service[72090]: Accept-Encoding: identity Apr 11 19:30:17 user devstack@n-api.service[72090]: Connection: close Apr 11 19:30:17 user devstack@n-api.service[72090]: Content-Length: 0 Apr 11 19:30:17 user devstack@n-api.service[72090]: Content-Type: application/json Apr 11 19:30:17 user devstack@n-api.service[72090]: Host: 10.0.0.210 Apr 11 19:30:17 user devstack@n-api.service[72090]: Openstack-System-Scope: None Apr 11 19:30:17 user devstack@n-api.service[72090]: User-Agent: python-urllib3/1.26.15 Apr 11 19:30:17 user devstack@n-api.service[72090]: X-Auth-Token: gAAAAABkNbM9ghjK_EzyGnW10Ps6cv4IuUgiOsH3-4CZQwwhssOT7z-coBiD1Tdn5TLuazoYlNl2MKZxDC8EHQ-1kxF1ymJhDXjVHNMOdUuaIOx6Zld44aVLhO1ciOh-QMlmbYyfhSKlVncwSZpaRu_co_jrVH31BrJgKqwLygUbeq6C-c51jnQ Apr 11 19:30:17 user devstack@n-api.service[72090]: X-Domain-Id: None Apr 11 19:30:17 user devstack@n-api.service[72090]: X-Domain-Name: None Apr 11 19:30:17 user devstack@n-api.service[72090]: X-Identity-Status: Confirmed Apr 11 19:30:17 user devstack@n-api.service[72090]: X-Is-Admin-Project: True Apr 11 19:30:17 user devstack@n-api.service[72090]: X-Project-Domain-Id: default Apr 11 19:30:17 user devstack@n-api.service[72090]: X-Project-Domain-Name: Default Apr 11 19:30:17 user devstack@n-api.service[72090]: X-Project-Id: 0d5d7769df1e4974b295cb30407151dd Apr 11 19:30:17 user devstack@n-api.service[72090]: X-Project-Name: tempest-ServersNegativeTestJSON-1311045721 Apr 11 19:30:17 user devstack@n-api.service[72090]: X-Role: reader,member Apr 11 19:30:17 user devstack@n-api.service[72090]: X-Roles: reader,member Apr 11 19:30:17 user devstack@n-api.service[72090]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0d5d7769df1e4974b295cb30407151dd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/0d5d7769df1e4974b295cb30407151dd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0d5d7769df1e4974b295cb30407151dd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 11 19:30:17 user devstack@n-api.service[72090]: X-Tenant: tempest-ServersNegativeTestJSON-1311045721 Apr 11 19:30:17 user devstack@n-api.service[72090]: X-Tenant-Id: 0d5d7769df1e4974b295cb30407151dd Apr 11 19:30:17 user devstack@n-api.service[72090]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1311045721 Apr 11 19:30:17 user devstack@n-api.service[72090]: X-User: tempest-ServersNegativeTestJSON-1311045721-project-member Apr 11 19:30:17 user devstack@n-api.service[72090]: X-User-Domain-Id: default Apr 11 19:30:17 user devstack@n-api.service[72090]: X-User-Domain-Name: Default Apr 11 19:30:17 user devstack@n-api.service[72090]: X-User-Id: 2f44dfa2528b4540a81f4eb7c3f3f2f5 Apr 11 19:30:17 user devstack@n-api.service[72090]: X-User-Name: tempest-ServersNegativeTestJSON-1311045721-project-member Apr 11 19:30:17 user devstack@n-api.service[72090]: method: > Apr 11 19:30:17 user devstack@n-api.service[72090]: exception: Instance e84ad0e4-a65b-404c-adbf-c49d5f0b3cca could not be found. Apr 11 19:30:17 user devstack@n-api.service[72090]: action_args: {'id': 'e84ad0e4-a65b-404c-adbf-c49d5f0b3cca'} Apr 11 19:30:17 user devstack@n-api.service[72090]: {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 19:30:17 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:30:17 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 19:30:17 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 19:30:17 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 19:30:17 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 19:30:17 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 19:30:17 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 19:30:17 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 19:30:17 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 19:30:17 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e84ad0e4-a65b-404c-adbf-c49d5f0b3cca could not be found. Apr 11 19:30:17 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi Apr 11 19:30:17 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 19:30:17 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi Apr 11 19:30:17 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:30:17 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 19:30:17 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 19:30:17 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 19:30:17 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 19:30:17 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 19:30:17 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 19:30:17 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 19:30:17 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 19:30:17 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 19:30:17 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 19:30:17 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 19:30:17 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 19:30:17 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e84ad0e4-a65b-404c-adbf-c49d5f0b3cca could not be found. Apr 11 19:30:17 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi Apr 11 19:30:17 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 19:30:17 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi Apr 11 19:30:17 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:30:17 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 19:30:17 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 19:30:17 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 19:30:17 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 19:30:17 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e84ad0e4-a65b-404c-adbf-c49d5f0b3cca could not be found. Apr 11 19:30:17 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi Apr 11 19:30:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [None req-4d8ce855-29cb-4024-8dea-c4ee482ca520 tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] Returning 404 to user: Instance e84ad0e4-a65b-404c-adbf-c49d5f0b3cca could not be found. {{(pid=72090) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 19:30:17 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [None req-4d8ce855-29cb-4024-8dea-c4ee482ca520 tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e84ad0e4-a65b-404c-adbf-c49d5f0b3cca" status: 404 len: 111 microversion: 2.1 time: 0.053999 Apr 11 19:30:17 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 162/492] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 19:30:17 2023] GET /compute/v2.1/servers/e84ad0e4-a65b-404c-adbf-c49d5f0b3cca => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 19:30:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [None req-1a402cae-7949-44ce-8b1e-8f7bae49abaa tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] Calling method '>' {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:30:17 user devstack@n-api.service[72089]: DEBUG nova.compute.api [None req-1a402cae-7949-44ce-8b1e-8f7bae49abaa tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] [instance: fc48e37f-8c00-4e48-bea3-f1c2e54d78b8] Fetching instance by UUID {{(pid=72089) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:30:17 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-1a402cae-7949-44ce-8b1e-8f7bae49abaa tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:30:17 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-1a402cae-7949-44ce-8b1e-8f7bae49abaa tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:30:17 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-1a402cae-7949-44ce-8b1e-8f7bae49abaa tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:30:17 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-1a402cae-7949-44ce-8b1e-8f7bae49abaa tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:30:17 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-1a402cae-7949-44ce-8b1e-8f7bae49abaa tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:30:17 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-1a402cae-7949-44ce-8b1e-8f7bae49abaa tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:30:17 user devstack@n-api.service[72088]: DEBUG nova.objects.instance [None req-ff328c4b-f2db-4c88-a0c2-44a71d7a8a2c tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Lazy-loading 'flavor' on Instance uuid 864fcd9b-8e5b-4de8-a2e6-292a8907a834 {{(pid=72088) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 11 19:30:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [None req-d46c76b2-a655-410c-85e1-13d66098a91f tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Calling method '>' {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:30:17 user devstack@n-api.service[72090]: DEBUG nova.compute.api [None req-d46c76b2-a655-410c-85e1-13d66098a91f tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] [instance: 558100b9-f3ac-47c7-9260-b897b0cae55f] Fetching instance by UUID {{(pid=72090) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:30:17 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-d46c76b2-a655-410c-85e1-13d66098a91f tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:30:17 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-d46c76b2-a655-410c-85e1-13d66098a91f tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:30:17 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-d46c76b2-a655-410c-85e1-13d66098a91f tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:30:17 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-d46c76b2-a655-410c-85e1-13d66098a91f tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:30:17 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-d46c76b2-a655-410c-85e1-13d66098a91f tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:30:17 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-d46c76b2-a655-410c-85e1-13d66098a91f tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:30:17 user devstack@n-api.service[72089]: DEBUG nova.compute.api [None req-1a402cae-7949-44ce-8b1e-8f7bae49abaa tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] [instance: fc48e37f-8c00-4e48-bea3-f1c2e54d78b8] Going to try to terminate instance {{(pid=72089) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 11 19:30:17 user devstack@n-api.service[72090]: DEBUG nova.objects.instance [None req-d46c76b2-a655-410c-85e1-13d66098a91f tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Lazy-loading 'services' on Instance uuid 558100b9-f3ac-47c7-9260-b897b0cae55f {{(pid=72090) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 11 19:30:17 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [None req-1a402cae-7949-44ce-8b1e-8f7bae49abaa tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/fc48e37f-8c00-4e48-bea3-f1c2e54d78b8" status: 204 len: 0 microversion: 2.1 time: 0.127987 Apr 11 19:30:17 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 169/493] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 19:30:17 2023] DELETE /compute/v2.1/servers/fc48e37f-8c00-4e48-bea3-f1c2e54d78b8 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 11 19:30:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [None req-b72cbcf2-dd39-483c-b483-b3df2e845a8a tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] Calling method '>' {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:30:17 user devstack@n-api.service[72089]: DEBUG nova.compute.api [None req-b72cbcf2-dd39-483c-b483-b3df2e845a8a tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] [instance: fc48e37f-8c00-4e48-bea3-f1c2e54d78b8] Fetching instance by UUID {{(pid=72089) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:30:17 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-b72cbcf2-dd39-483c-b483-b3df2e845a8a tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:30:17 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-b72cbcf2-dd39-483c-b483-b3df2e845a8a tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:30:17 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-b72cbcf2-dd39-483c-b483-b3df2e845a8a tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:30:17 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-b72cbcf2-dd39-483c-b483-b3df2e845a8a tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:30:17 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-b72cbcf2-dd39-483c-b483-b3df2e845a8a tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:30:17 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-b72cbcf2-dd39-483c-b483-b3df2e845a8a tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:30:17 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [None req-d46c76b2-a655-410c-85e1-13d66098a91f tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/558100b9-f3ac-47c7-9260-b897b0cae55f/os-volume_attachments/ac30dce5-e2c0-4981-af4a-10be9d923877" status: 202 len: 0 microversion: 2.1 time: 0.187252 Apr 11 19:30:17 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 163/494] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Apr 11 19:30:17 2023] DELETE /compute/v2.1/servers/558100b9-f3ac-47c7-9260-b897b0cae55f/os-volume_attachments/ac30dce5-e2c0-4981-af4a-10be9d923877 => generated 0 bytes in 189 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 19:30:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [None req-3526e82c-e258-4bd5-9eac-6270adb7145d tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Calling method '>' {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:30:17 user devstack@n-api.service[72090]: DEBUG nova.compute.api [None req-3526e82c-e258-4bd5-9eac-6270adb7145d tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] [instance: 558100b9-f3ac-47c7-9260-b897b0cae55f] Fetching instance by UUID {{(pid=72090) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:30:17 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-3526e82c-e258-4bd5-9eac-6270adb7145d tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:30:17 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-3526e82c-e258-4bd5-9eac-6270adb7145d tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:30:17 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-3526e82c-e258-4bd5-9eac-6270adb7145d tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:30:17 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-3526e82c-e258-4bd5-9eac-6270adb7145d tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:30:17 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-3526e82c-e258-4bd5-9eac-6270adb7145d tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:30:17 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-3526e82c-e258-4bd5-9eac-6270adb7145d tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:30:17 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [None req-3526e82c-e258-4bd5-9eac-6270adb7145d tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] 10.0.0.210 "GET /compute/v2.1/servers/558100b9-f3ac-47c7-9260-b897b0cae55f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.084572 Apr 11 19:30:17 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 164/495] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Apr 11 19:30:17 2023] GET /compute/v2.1/servers/558100b9-f3ac-47c7-9260-b897b0cae55f/os-volume_attachments => generated 197 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:30:17 user devstack@n-api.service[72089]: DEBUG nova.policy [None req-b72cbcf2-dd39-483c-b483-b3df2e845a8a tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f44dfa2528b4540a81f4eb7c3f3f2f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5d7769df1e4974b295cb30407151dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72089) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:30:17 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [None req-b72cbcf2-dd39-483c-b483-b3df2e845a8a tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fc48e37f-8c00-4e48-bea3-f1c2e54d78b8" status: 200 len: 1500 microversion: 2.1 time: 0.212362 Apr 11 19:30:17 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 170/496] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 19:30:17 2023] GET /compute/v2.1/servers/fc48e37f-8c00-4e48-bea3-f1c2e54d78b8 => generated 1500 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:30:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [req-84e556c4-a097-4dd7-8d6f-e6c69d5a17f9 req-fa06b8e6-cba3-40ad-a193-5f042703b0a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fc48e37f-8c00-4e48-bea3-f1c2e54d78b8", "name": "network-vif-unplugged", "status": "completed", "tag": "b4beb6cf-d11a-487e-b95d-6adec8a8ee4d"}]} {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:30:17 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-84e556c4-a097-4dd7-8d6f-e6c69d5a17f9 req-fa06b8e6-cba3-40ad-a193-5f042703b0a5 service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:30:17 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-84e556c4-a097-4dd7-8d6f-e6c69d5a17f9 req-fa06b8e6-cba3-40ad-a193-5f042703b0a5 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:30:17 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-84e556c4-a097-4dd7-8d6f-e6c69d5a17f9 req-fa06b8e6-cba3-40ad-a193-5f042703b0a5 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:30:17 user devstack@n-api.service[72090]: INFO nova.api.openstack.compute.server_external_events [req-84e556c4-a097-4dd7-8d6f-e6c69d5a17f9 req-fa06b8e6-cba3-40ad-a193-5f042703b0a5 service nova] Creating event network-vif-unplugged:b4beb6cf-d11a-487e-b95d-6adec8a8ee4d for instance fc48e37f-8c00-4e48-bea3-f1c2e54d78b8 on user Apr 11 19:30:17 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [req-84e556c4-a097-4dd7-8d6f-e6c69d5a17f9 req-fa06b8e6-cba3-40ad-a193-5f042703b0a5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.038249 Apr 11 19:30:17 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 165/497] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:30:17 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:30:18 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [None req-ff328c4b-f2db-4c88-a0c2-44a71d7a8a2c tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] 10.0.0.210 "POST /compute/v2.1/servers/864fcd9b-8e5b-4de8-a2e6-292a8907a834/action" status: 200 len: 29 microversion: 2.87 time: 0.674510 Apr 11 19:30:18 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 163/498] 10.0.0.210 () {66 vars in 1396 bytes} [Tue Apr 11 19:30:17 2023] POST /compute/v2.1/servers/864fcd9b-8e5b-4de8-a2e6-292a8907a834/action => generated 29 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:30:18 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [None req-0e4b8232-69a3-48f4-85d8-167ac9164af4 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Calling method '>' {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:30:18 user devstack@n-api.service[72089]: DEBUG nova.compute.api [None req-0e4b8232-69a3-48f4-85d8-167ac9164af4 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] [instance: 864fcd9b-8e5b-4de8-a2e6-292a8907a834] Fetching instance by UUID {{(pid=72089) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:30:18 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-0e4b8232-69a3-48f4-85d8-167ac9164af4 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:30:18 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-0e4b8232-69a3-48f4-85d8-167ac9164af4 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:30:18 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-0e4b8232-69a3-48f4-85d8-167ac9164af4 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:30:18 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-0e4b8232-69a3-48f4-85d8-167ac9164af4 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:30:18 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-0e4b8232-69a3-48f4-85d8-167ac9164af4 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:30:18 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-0e4b8232-69a3-48f4-85d8-167ac9164af4 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:30:18 user devstack@n-api.service[72089]: DEBUG nova.policy [None req-0e4b8232-69a3-48f4-85d8-167ac9164af4 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b3adca432b04d70818a51d1366f5c6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb91586feb3f4a4c84fa8c2183baaf8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72089) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:30:18 user devstack@n-api.service[72089]: DEBUG nova.policy [None req-0e4b8232-69a3-48f4-85d8-167ac9164af4 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b3adca432b04d70818a51d1366f5c6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb91586feb3f4a4c84fa8c2183baaf8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72089) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:30:18 user devstack@n-api.service[72089]: DEBUG nova.policy [None req-0e4b8232-69a3-48f4-85d8-167ac9164af4 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b3adca432b04d70818a51d1366f5c6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb91586feb3f4a4c84fa8c2183baaf8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72089) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:30:18 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [None req-0e4b8232-69a3-48f4-85d8-167ac9164af4 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] 10.0.0.210 "GET /compute/v2.1/servers/864fcd9b-8e5b-4de8-a2e6-292a8907a834" status: 200 len: 1775 microversion: 2.87 time: 0.181910 Apr 11 19:30:18 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 171/499] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 19:30:18 2023] GET /compute/v2.1/servers/864fcd9b-8e5b-4de8-a2e6-292a8907a834 => generated 1775 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 19:30:19 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [req-d78bbec2-5470-436a-b2d0-f62731ed3822 req-ea0f8e9a-0586-4959-a93b-03fe64400cf6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fc48e37f-8c00-4e48-bea3-f1c2e54d78b8", "name": "network-vif-deleted", "tag": "b4beb6cf-d11a-487e-b95d-6adec8a8ee4d"}]} {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:30:19 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-d78bbec2-5470-436a-b2d0-f62731ed3822 req-ea0f8e9a-0586-4959-a93b-03fe64400cf6 service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:30:19 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-d78bbec2-5470-436a-b2d0-f62731ed3822 req-ea0f8e9a-0586-4959-a93b-03fe64400cf6 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:30:19 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-d78bbec2-5470-436a-b2d0-f62731ed3822 req-ea0f8e9a-0586-4959-a93b-03fe64400cf6 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:30:19 user devstack@n-api.service[72090]: INFO nova.api.openstack.compute.server_external_events [req-d78bbec2-5470-436a-b2d0-f62731ed3822 req-ea0f8e9a-0586-4959-a93b-03fe64400cf6 service nova] Creating event network-vif-deleted:b4beb6cf-d11a-487e-b95d-6adec8a8ee4d for instance fc48e37f-8c00-4e48-bea3-f1c2e54d78b8 on user Apr 11 19:30:19 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [req-d78bbec2-5470-436a-b2d0-f62731ed3822 req-ea0f8e9a-0586-4959-a93b-03fe64400cf6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036874 Apr 11 19:30:19 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 166/500] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:30:19 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:30:19 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [None req-88722b03-7703-451c-9f5d-02d644a32680 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b5f0471b-94d7-446d-9313-3c94d2e9355d"}} {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:30:19 user devstack@n-api.service[72088]: DEBUG nova.compute.api [None req-88722b03-7703-451c-9f5d-02d644a32680 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] [instance: 720c683f-c03a-444c-92a8-daf97c9f524b] Fetching instance by UUID {{(pid=72088) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:30:19 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-88722b03-7703-451c-9f5d-02d644a32680 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:30:19 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-88722b03-7703-451c-9f5d-02d644a32680 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:30:19 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-88722b03-7703-451c-9f5d-02d644a32680 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:30:19 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-88722b03-7703-451c-9f5d-02d644a32680 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:30:19 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-88722b03-7703-451c-9f5d-02d644a32680 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:30:19 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-88722b03-7703-451c-9f5d-02d644a32680 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:30:19 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [req-d2842b6f-f4c5-4f6a-a1df-dba04de3288f req-013bb8d8-3501-45e1-ac20-624d86c99373 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fc48e37f-8c00-4e48-bea3-f1c2e54d78b8", "name": "network-vif-plugged", "status": "completed", "tag": "b4beb6cf-d11a-487e-b95d-6adec8a8ee4d"}, {"server_uuid": "864fcd9b-8e5b-4de8-a2e6-292a8907a834", "name": "network-vif-unplugged", "status": "completed", "tag": "60f272b0-f7d2-408b-b99b-9bcfcd3f23ff"}, {"server_uuid": "864fcd9b-8e5b-4de8-a2e6-292a8907a834", "name": "network-vif-plugged", "status": "completed", "tag": "60f272b0-f7d2-408b-b99b-9bcfcd3f23ff"}]} {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:30:19 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-d2842b6f-f4c5-4f6a-a1df-dba04de3288f req-013bb8d8-3501-45e1-ac20-624d86c99373 service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:30:19 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-d2842b6f-f4c5-4f6a-a1df-dba04de3288f req-013bb8d8-3501-45e1-ac20-624d86c99373 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:30:19 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-d2842b6f-f4c5-4f6a-a1df-dba04de3288f req-013bb8d8-3501-45e1-ac20-624d86c99373 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:30:19 user devstack@n-api.service[72089]: INFO nova.api.openstack.compute.server_external_events [req-d2842b6f-f4c5-4f6a-a1df-dba04de3288f req-013bb8d8-3501-45e1-ac20-624d86c99373 service nova] Creating event network-vif-plugged:b4beb6cf-d11a-487e-b95d-6adec8a8ee4d for instance fc48e37f-8c00-4e48-bea3-f1c2e54d78b8 on user Apr 11 19:30:19 user devstack@n-api.service[72089]: INFO nova.api.openstack.compute.server_external_events [req-d2842b6f-f4c5-4f6a-a1df-dba04de3288f req-013bb8d8-3501-45e1-ac20-624d86c99373 service nova] Creating event network-vif-unplugged:60f272b0-f7d2-408b-b99b-9bcfcd3f23ff for instance 864fcd9b-8e5b-4de8-a2e6-292a8907a834 on user Apr 11 19:30:19 user devstack@n-api.service[72089]: INFO nova.api.openstack.compute.server_external_events [req-d2842b6f-f4c5-4f6a-a1df-dba04de3288f req-013bb8d8-3501-45e1-ac20-624d86c99373 service nova] Creating event network-vif-plugged:60f272b0-f7d2-408b-b99b-9bcfcd3f23ff for instance 864fcd9b-8e5b-4de8-a2e6-292a8907a834 on user Apr 11 19:30:19 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [req-d2842b6f-f4c5-4f6a-a1df-dba04de3288f req-013bb8d8-3501-45e1-ac20-624d86c99373 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 527 microversion: 2.1 time: 0.085950 Apr 11 19:30:19 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 172/501] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:30:19 2023] POST /compute/v2.1/os-server-external-events => generated 527 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:30:20 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [None req-88722b03-7703-451c-9f5d-02d644a32680 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] 10.0.0.210 "POST /compute/v2.1/servers/720c683f-c03a-444c-92a8-daf97c9f524b/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.381887 Apr 11 19:30:20 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 164/502] 10.0.0.210 () {66 vars in 1441 bytes} [Tue Apr 11 19:30:19 2023] POST /compute/v2.1/servers/720c683f-c03a-444c-92a8-daf97c9f524b/os-volume_attachments => generated 188 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:30:20 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [None req-3b39ed8f-0877-41c4-b75c-0de820971132 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:30:20 user devstack@n-api.service[72090]: DEBUG nova.compute.api [None req-3b39ed8f-0877-41c4-b75c-0de820971132 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] [instance: 720c683f-c03a-444c-92a8-daf97c9f524b] Fetching instance by UUID {{(pid=72090) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:30:20 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-3b39ed8f-0877-41c4-b75c-0de820971132 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:30:20 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-3b39ed8f-0877-41c4-b75c-0de820971132 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:30:20 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-3b39ed8f-0877-41c4-b75c-0de820971132 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:30:20 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-3b39ed8f-0877-41c4-b75c-0de820971132 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:30:20 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-3b39ed8f-0877-41c4-b75c-0de820971132 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:30:20 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-3b39ed8f-0877-41c4-b75c-0de820971132 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:30:20 user devstack@n-api.service[72090]: DEBUG nova.compute.api [None req-3b39ed8f-0877-41c4-b75c-0de820971132 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] [instance: 720c683f-c03a-444c-92a8-daf97c9f524b] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=72090) unshelve /opt/stack/nova/nova/compute/api.py:4596}} Apr 11 19:30:20 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [None req-3b39ed8f-0877-41c4-b75c-0de820971132 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] 10.0.0.210 "POST /compute/v2.1/servers/720c683f-c03a-444c-92a8-daf97c9f524b/action" status: 202 len: 0 microversion: 2.20 time: 0.326370 Apr 11 19:30:20 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 167/503] 10.0.0.210 () {66 vars in 1396 bytes} [Tue Apr 11 19:30:20 2023] POST /compute/v2.1/servers/720c683f-c03a-444c-92a8-daf97c9f524b/action => generated 0 bytes in 328 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 11 19:30:20 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [None req-f7148113-6537-4115-9fdc-6cd0d5af6066 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Calling method '>' {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:30:20 user devstack@n-api.service[72089]: DEBUG nova.compute.api [None req-f7148113-6537-4115-9fdc-6cd0d5af6066 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] [instance: 720c683f-c03a-444c-92a8-daf97c9f524b] Fetching instance by UUID {{(pid=72089) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:30:20 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-f7148113-6537-4115-9fdc-6cd0d5af6066 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:30:20 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-f7148113-6537-4115-9fdc-6cd0d5af6066 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:30:20 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-f7148113-6537-4115-9fdc-6cd0d5af6066 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:30:20 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-f7148113-6537-4115-9fdc-6cd0d5af6066 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:30:20 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-f7148113-6537-4115-9fdc-6cd0d5af6066 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:30:20 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-f7148113-6537-4115-9fdc-6cd0d5af6066 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:30:21 user devstack@n-api.service[72089]: DEBUG nova.policy [None req-f7148113-6537-4115-9fdc-6cd0d5af6066 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0558ba5a2b04d36ba2f2411090cc4e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d8b189667e34931aa36149620a036e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72089) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:30:21 user devstack@n-api.service[72089]: DEBUG nova.policy [None req-f7148113-6537-4115-9fdc-6cd0d5af6066 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0558ba5a2b04d36ba2f2411090cc4e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d8b189667e34931aa36149620a036e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72089) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:30:21 user devstack@n-api.service[72089]: DEBUG nova.policy [None req-f7148113-6537-4115-9fdc-6cd0d5af6066 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0558ba5a2b04d36ba2f2411090cc4e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d8b189667e34931aa36149620a036e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72089) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:30:21 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [None req-f7148113-6537-4115-9fdc-6cd0d5af6066 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] 10.0.0.210 "GET /compute/v2.1/servers/720c683f-c03a-444c-92a8-daf97c9f524b" status: 200 len: 1736 microversion: 2.20 time: 0.486582 Apr 11 19:30:21 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 173/504] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 19:30:20 2023] GET /compute/v2.1/servers/720c683f-c03a-444c-92a8-daf97c9f524b => generated 1736 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 19:30:23 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [req-85bb6b9d-cd2c-4807-bdcb-73c24b9e6d9f req-332de453-4ddc-48dc-a2ac-653f417a25f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "864fcd9b-8e5b-4de8-a2e6-292a8907a834", "name": "network-vif-plugged", "status": "completed", "tag": "60f272b0-f7d2-408b-b99b-9bcfcd3f23ff"}]} {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:30:23 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-85bb6b9d-cd2c-4807-bdcb-73c24b9e6d9f req-332de453-4ddc-48dc-a2ac-653f417a25f4 service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:30:23 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-85bb6b9d-cd2c-4807-bdcb-73c24b9e6d9f req-332de453-4ddc-48dc-a2ac-653f417a25f4 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:30:23 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-85bb6b9d-cd2c-4807-bdcb-73c24b9e6d9f req-332de453-4ddc-48dc-a2ac-653f417a25f4 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:30:24 user devstack@n-api.service[72088]: INFO nova.api.openstack.compute.server_external_events [req-85bb6b9d-cd2c-4807-bdcb-73c24b9e6d9f req-332de453-4ddc-48dc-a2ac-653f417a25f4 service nova] Creating event network-vif-plugged:60f272b0-f7d2-408b-b99b-9bcfcd3f23ff for instance 864fcd9b-8e5b-4de8-a2e6-292a8907a834 on user Apr 11 19:30:24 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [req-85bb6b9d-cd2c-4807-bdcb-73c24b9e6d9f req-332de453-4ddc-48dc-a2ac-653f417a25f4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055494 Apr 11 19:30:24 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 165/505] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:30:23 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:30:26 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [req-0d075bd5-169f-4f14-a661-e8905b23d492 req-5c8cb7c7-b7c9-4afc-960b-fe42b18a5ad7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "864fcd9b-8e5b-4de8-a2e6-292a8907a834", "name": "network-vif-plugged", "status": "completed", "tag": "60f272b0-f7d2-408b-b99b-9bcfcd3f23ff"}]} {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:30:26 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-0d075bd5-169f-4f14-a661-e8905b23d492 req-5c8cb7c7-b7c9-4afc-960b-fe42b18a5ad7 service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:30:26 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-0d075bd5-169f-4f14-a661-e8905b23d492 req-5c8cb7c7-b7c9-4afc-960b-fe42b18a5ad7 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:30:26 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-0d075bd5-169f-4f14-a661-e8905b23d492 req-5c8cb7c7-b7c9-4afc-960b-fe42b18a5ad7 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:30:26 user devstack@n-api.service[72090]: INFO nova.api.openstack.compute.server_external_events [req-0d075bd5-169f-4f14-a661-e8905b23d492 req-5c8cb7c7-b7c9-4afc-960b-fe42b18a5ad7 service nova] Creating event network-vif-plugged:60f272b0-f7d2-408b-b99b-9bcfcd3f23ff for instance 864fcd9b-8e5b-4de8-a2e6-292a8907a834 on user Apr 11 19:30:26 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [req-0d075bd5-169f-4f14-a661-e8905b23d492 req-5c8cb7c7-b7c9-4afc-960b-fe42b18a5ad7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029679 Apr 11 19:30:26 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 168/506] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:30:26 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:30:28 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [req-5b2d081e-4d88-4f02-adbd-763a6e72c383 req-09a2ec56-89cb-4b67-ac0f-f5c7615cb0fb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "720c683f-c03a-444c-92a8-daf97c9f524b", "tag": "9e6087aa-464a-450d-bd04-2653d9420094"}]} {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:30:28 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-5b2d081e-4d88-4f02-adbd-763a6e72c383 req-09a2ec56-89cb-4b67-ac0f-f5c7615cb0fb service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:30:28 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-5b2d081e-4d88-4f02-adbd-763a6e72c383 req-09a2ec56-89cb-4b67-ac0f-f5c7615cb0fb service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:30:28 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-5b2d081e-4d88-4f02-adbd-763a6e72c383 req-09a2ec56-89cb-4b67-ac0f-f5c7615cb0fb service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:30:28 user devstack@n-api.service[72089]: INFO nova.api.openstack.compute.server_external_events [req-5b2d081e-4d88-4f02-adbd-763a6e72c383 req-09a2ec56-89cb-4b67-ac0f-f5c7615cb0fb service nova] Creating event network-changed:9e6087aa-464a-450d-bd04-2653d9420094 for instance 720c683f-c03a-444c-92a8-daf97c9f524b on user Apr 11 19:30:28 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [req-5b2d081e-4d88-4f02-adbd-763a6e72c383 req-09a2ec56-89cb-4b67-ac0f-f5c7615cb0fb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032627 Apr 11 19:30:28 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 174/507] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:30:28 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:30:29 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [None req-6c3a550e-38a8-4b29-b100-8c3b36812226 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Calling method '>' {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:30:29 user devstack@n-api.service[72088]: DEBUG nova.compute.api [None req-6c3a550e-38a8-4b29-b100-8c3b36812226 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] [instance: 6802f099-9236-4c79-a892-2963f1b15b0e] Fetching instance by UUID {{(pid=72088) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:30:29 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-6c3a550e-38a8-4b29-b100-8c3b36812226 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:30:29 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-6c3a550e-38a8-4b29-b100-8c3b36812226 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:30:29 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-6c3a550e-38a8-4b29-b100-8c3b36812226 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:30:29 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-6c3a550e-38a8-4b29-b100-8c3b36812226 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:30:29 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-6c3a550e-38a8-4b29-b100-8c3b36812226 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:30:29 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-6c3a550e-38a8-4b29-b100-8c3b36812226 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:30:29 user devstack@n-api.service[72088]: DEBUG nova.objects.instance [None req-6c3a550e-38a8-4b29-b100-8c3b36812226 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Lazy-loading 'services' on Instance uuid 6802f099-9236-4c79-a892-2963f1b15b0e {{(pid=72088) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 11 19:30:29 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [None req-6c3a550e-38a8-4b29-b100-8c3b36812226 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/6802f099-9236-4c79-a892-2963f1b15b0e/os-volume_attachments/ae9e623b-e20a-47f6-8a7b-d48a85701e3e" status: 202 len: 0 microversion: 2.1 time: 0.467192 Apr 11 19:30:29 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 166/508] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Apr 11 19:30:29 2023] DELETE /compute/v2.1/servers/6802f099-9236-4c79-a892-2963f1b15b0e/os-volume_attachments/ae9e623b-e20a-47f6-8a7b-d48a85701e3e => generated 0 bytes in 469 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 19:30:31 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [None req-3f539538-f55d-4427-a220-e1ab502cd4f1 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Calling method '>' {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:30:31 user devstack@n-api.service[72090]: DEBUG nova.compute.api [None req-3f539538-f55d-4427-a220-e1ab502cd4f1 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] [instance: d424f88d-5f82-4cac-aa0f-4f99624bd3e7] Fetching instance by UUID {{(pid=72090) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:30:31 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-3f539538-f55d-4427-a220-e1ab502cd4f1 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:30:31 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-3f539538-f55d-4427-a220-e1ab502cd4f1 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:30:31 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-3f539538-f55d-4427-a220-e1ab502cd4f1 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:30:31 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-3f539538-f55d-4427-a220-e1ab502cd4f1 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:30:31 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-3f539538-f55d-4427-a220-e1ab502cd4f1 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:30:31 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-3f539538-f55d-4427-a220-e1ab502cd4f1 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:30:31 user devstack@n-api.service[72090]: INFO nova.api.openstack.wsgi [None req-3f539538-f55d-4427-a220-e1ab502cd4f1 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] HTTP exception thrown: Instance d424f88d-5f82-4cac-aa0f-4f99624bd3e7 could not be found. Apr 11 19:30:31 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [None req-3f539538-f55d-4427-a220-e1ab502cd4f1 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Request method failure captured: Apr 11 19:30:31 user devstack@n-api.service[72090]: request: GET /compute/v2.1/servers/d424f88d-5f82-4cac-aa0f-4f99624bd3e7 HTTP/1.1 Apr 11 19:30:31 user devstack@n-api.service[72090]: Accept: application/json Apr 11 19:30:31 user devstack@n-api.service[72090]: Accept-Encoding: identity Apr 11 19:30:31 user devstack@n-api.service[72090]: Connection: close Apr 11 19:30:31 user devstack@n-api.service[72090]: Content-Length: 0 Apr 11 19:30:31 user devstack@n-api.service[72090]: Content-Type: application/json Apr 11 19:30:31 user devstack@n-api.service[72090]: Host: 10.0.0.210 Apr 11 19:30:31 user devstack@n-api.service[72090]: Openstack-System-Scope: None Apr 11 19:30:31 user devstack@n-api.service[72090]: User-Agent: python-urllib3/1.26.15 Apr 11 19:30:31 user devstack@n-api.service[72090]: X-Auth-Token: gAAAAABkNbN4-SiDHVXgGAq1Livx4Ms1sGx-fp2WG3x_Y0m9pBMANUHYyXMsJQp9hD4u3xpw-neOtr5XlKMUkx8fei57P418d_RqgO--MD5ohJi_XiONiYrdn7gKPJL36-NgiQN546w40ULZ0D1v3ZDDmhVchguBy0oqaJnEY21gDX2_BouIjIo Apr 11 19:30:31 user devstack@n-api.service[72090]: X-Domain-Id: None Apr 11 19:30:31 user devstack@n-api.service[72090]: X-Domain-Name: None Apr 11 19:30:31 user devstack@n-api.service[72090]: X-Identity-Status: Confirmed Apr 11 19:30:31 user devstack@n-api.service[72090]: X-Is-Admin-Project: True Apr 11 19:30:31 user devstack@n-api.service[72090]: X-Project-Domain-Id: default Apr 11 19:30:31 user devstack@n-api.service[72090]: X-Project-Domain-Name: Default Apr 11 19:30:31 user devstack@n-api.service[72090]: X-Project-Id: bceca6e3506e43f68f9cf8d0b56d141b Apr 11 19:30:31 user devstack@n-api.service[72090]: X-Project-Name: tempest-TestStampPattern-497408287 Apr 11 19:30:31 user devstack@n-api.service[72090]: X-Role: reader,member Apr 11 19:30:31 user devstack@n-api.service[72090]: X-Roles: reader,member Apr 11 19:30:31 user devstack@n-api.service[72090]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/bceca6e3506e43f68f9cf8d0b56d141b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/bceca6e3506e43f68f9cf8d0b56d141b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/bceca6e3506e43f68f9cf8d0b56d141b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 11 19:30:31 user devstack@n-api.service[72090]: X-Tenant: tempest-TestStampPattern-497408287 Apr 11 19:30:31 user devstack@n-api.service[72090]: X-Tenant-Id: bceca6e3506e43f68f9cf8d0b56d141b Apr 11 19:30:31 user devstack@n-api.service[72090]: X-Tenant-Name: tempest-TestStampPattern-497408287 Apr 11 19:30:31 user devstack@n-api.service[72090]: X-User: tempest-TestStampPattern-497408287-project-member Apr 11 19:30:31 user devstack@n-api.service[72090]: X-User-Domain-Id: default Apr 11 19:30:31 user devstack@n-api.service[72090]: X-User-Domain-Name: Default Apr 11 19:30:31 user devstack@n-api.service[72090]: X-User-Id: 3a32a5d0547141a180f655e98567ed9a Apr 11 19:30:31 user devstack@n-api.service[72090]: X-User-Name: tempest-TestStampPattern-497408287-project-member Apr 11 19:30:31 user devstack@n-api.service[72090]: method: > Apr 11 19:30:31 user devstack@n-api.service[72090]: exception: Instance d424f88d-5f82-4cac-aa0f-4f99624bd3e7 could not be found. Apr 11 19:30:31 user devstack@n-api.service[72090]: action_args: {'id': 'd424f88d-5f82-4cac-aa0f-4f99624bd3e7'} Apr 11 19:30:31 user devstack@n-api.service[72090]: {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 19:30:31 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:30:31 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 19:30:31 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 19:30:31 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 19:30:31 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 19:30:31 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 19:30:31 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 19:30:31 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 19:30:31 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 19:30:31 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d424f88d-5f82-4cac-aa0f-4f99624bd3e7 could not be found. Apr 11 19:30:31 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi Apr 11 19:30:31 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 19:30:31 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi Apr 11 19:30:31 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:30:31 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 19:30:31 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 19:30:31 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 19:30:31 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 19:30:31 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 19:30:31 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 19:30:31 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 19:30:31 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 19:30:31 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 19:30:31 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 19:30:31 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 19:30:31 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 19:30:31 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d424f88d-5f82-4cac-aa0f-4f99624bd3e7 could not be found. Apr 11 19:30:31 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi Apr 11 19:30:31 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 19:30:31 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi Apr 11 19:30:31 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:30:31 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 19:30:31 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 19:30:31 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 19:30:31 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 19:30:31 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d424f88d-5f82-4cac-aa0f-4f99624bd3e7 could not be found. Apr 11 19:30:31 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi Apr 11 19:30:31 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [None req-3f539538-f55d-4427-a220-e1ab502cd4f1 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Returning 404 to user: Instance d424f88d-5f82-4cac-aa0f-4f99624bd3e7 could not be found. {{(pid=72090) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 19:30:31 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [None req-3f539538-f55d-4427-a220-e1ab502cd4f1 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d424f88d-5f82-4cac-aa0f-4f99624bd3e7" status: 404 len: 111 microversion: 2.1 time: 0.029892 Apr 11 19:30:31 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 169/509] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 19:30:31 2023] GET /compute/v2.1/servers/d424f88d-5f82-4cac-aa0f-4f99624bd3e7 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 19:30:32 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [None req-54fa7c47-f436-4738-a2b6-47ad61e6d9da tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:30:32 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-54fa7c47-f436-4738-a2b6-47ad61e6d9da tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:30:32 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-54fa7c47-f436-4738-a2b6-47ad61e6d9da tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:30:32 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-54fa7c47-f436-4738-a2b6-47ad61e6d9da tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:30:32 user devstack@n-api.service[72089]: DEBUG nova.compute.api [None req-54fa7c47-f436-4738-a2b6-47ad61e6d9da tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] [instance: 6802f099-9236-4c79-a892-2963f1b15b0e] Going to try to stop instance {{(pid=72089) force_stop /opt/stack/nova/nova/compute/api.py:2764}} Apr 11 19:30:33 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [None req-54fa7c47-f436-4738-a2b6-47ad61e6d9da tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] 10.0.0.210 "POST /compute/v2.1/servers/6802f099-9236-4c79-a892-2963f1b15b0e/action" status: 202 len: 0 microversion: 2.1 time: 0.091860 Apr 11 19:30:33 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 175/510] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Apr 11 19:30:32 2023] POST /compute/v2.1/servers/6802f099-9236-4c79-a892-2963f1b15b0e/action => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 19:30:33 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [None req-a662aca6-8b8c-4267-966a-9dd77c30d7ef tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Calling method '>' {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:30:33 user devstack@n-api.service[72088]: DEBUG nova.compute.api [None req-a662aca6-8b8c-4267-966a-9dd77c30d7ef tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] [instance: 6802f099-9236-4c79-a892-2963f1b15b0e] Fetching instance by UUID {{(pid=72088) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:30:33 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-a662aca6-8b8c-4267-966a-9dd77c30d7ef tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:30:33 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-a662aca6-8b8c-4267-966a-9dd77c30d7ef tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:30:33 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-a662aca6-8b8c-4267-966a-9dd77c30d7ef tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:30:33 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-a662aca6-8b8c-4267-966a-9dd77c30d7ef tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:30:33 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-a662aca6-8b8c-4267-966a-9dd77c30d7ef tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:30:33 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-a662aca6-8b8c-4267-966a-9dd77c30d7ef tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:30:33 user devstack@n-api.service[72088]: DEBUG nova.policy [None req-a662aca6-8b8c-4267-966a-9dd77c30d7ef tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31c237e142784bd6aa460d6f1bf33400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd886d2ec5fc946b49af3c8ca7c8556c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72088) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:30:33 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [None req-a662aca6-8b8c-4267-966a-9dd77c30d7ef tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6802f099-9236-4c79-a892-2963f1b15b0e" status: 200 len: 1667 microversion: 2.1 time: 0.197328 Apr 11 19:30:33 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 167/511] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 19:30:33 2023] GET /compute/v2.1/servers/6802f099-9236-4c79-a892-2963f1b15b0e => generated 1667 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:30:33 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [req-bf5716dc-76ba-4bf2-a251-b7eb26456c9c req-5f0aba15-3bbc-4233-b186-4a0cea498579 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6802f099-9236-4c79-a892-2963f1b15b0e", "name": "network-vif-unplugged", "status": "completed", "tag": "6193819b-0c1b-476b-b89e-dbbfc7938fc5"}]} {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:30:33 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-bf5716dc-76ba-4bf2-a251-b7eb26456c9c req-5f0aba15-3bbc-4233-b186-4a0cea498579 service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:30:33 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-bf5716dc-76ba-4bf2-a251-b7eb26456c9c req-5f0aba15-3bbc-4233-b186-4a0cea498579 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:30:33 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-bf5716dc-76ba-4bf2-a251-b7eb26456c9c req-5f0aba15-3bbc-4233-b186-4a0cea498579 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:30:33 user devstack@n-api.service[72090]: INFO nova.api.openstack.compute.server_external_events [req-bf5716dc-76ba-4bf2-a251-b7eb26456c9c req-5f0aba15-3bbc-4233-b186-4a0cea498579 service nova] Creating event network-vif-unplugged:6193819b-0c1b-476b-b89e-dbbfc7938fc5 for instance 6802f099-9236-4c79-a892-2963f1b15b0e on user Apr 11 19:30:33 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [req-bf5716dc-76ba-4bf2-a251-b7eb26456c9c req-5f0aba15-3bbc-4233-b186-4a0cea498579 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030328 Apr 11 19:30:33 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 170/512] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:30:33 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:30:34 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [None req-8867ae47-a381-47a7-9c04-47714158527e tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Calling method '.version_select at 0x7f119dbea680>' {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:30:34 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [None req-8867ae47-a381-47a7-9c04-47714158527e tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestStampPattern-1385471309" status: 202 len: 0 microversion: 2.1 time: 0.026918 Apr 11 19:30:34 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 176/513] 10.0.0.210 () {62 vars in 1325 bytes} [Tue Apr 11 19:30:34 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestStampPattern-1385471309 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 19:30:34 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [None req-9c2853c0-233b-46d5-aa1e-328308842429 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Calling method '>' {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:30:34 user devstack@n-api.service[72088]: DEBUG nova.compute.api [None req-9c2853c0-233b-46d5-aa1e-328308842429 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] [instance: 647674d8-af53-405a-8116-4b7a01549bdf] Fetching instance by UUID {{(pid=72088) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:30:34 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-9c2853c0-233b-46d5-aa1e-328308842429 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:30:34 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-9c2853c0-233b-46d5-aa1e-328308842429 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:30:34 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-9c2853c0-233b-46d5-aa1e-328308842429 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:30:34 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-9c2853c0-233b-46d5-aa1e-328308842429 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:30:34 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-9c2853c0-233b-46d5-aa1e-328308842429 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:30:34 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-9c2853c0-233b-46d5-aa1e-328308842429 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:30:34 user devstack@n-api.service[72088]: DEBUG nova.policy [None req-9c2853c0-233b-46d5-aa1e-328308842429 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05fb551c320a48f98a4ec00a7f7492d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60a7381a31b84e97a068528f90813773', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72088) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:30:34 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [None req-9c2853c0-233b-46d5-aa1e-328308842429 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] 10.0.0.210 "GET /compute/v2.1/servers/647674d8-af53-405a-8116-4b7a01549bdf" status: 200 len: 1657 microversion: 2.1 time: 0.160599 Apr 11 19:30:34 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 168/514] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 19:30:34 2023] GET /compute/v2.1/servers/647674d8-af53-405a-8116-4b7a01549bdf => generated 1657 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:30:35 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [None req-e0446086-6cfc-4d34-9aaa-a9999bd5543b tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "443c1e0d-cc51-400f-8525-c5352514ce7f"}} {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:30:35 user devstack@n-api.service[72090]: DEBUG nova.compute.api [None req-e0446086-6cfc-4d34-9aaa-a9999bd5543b tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] [instance: 647674d8-af53-405a-8116-4b7a01549bdf] Fetching instance by UUID {{(pid=72090) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:30:35 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-e0446086-6cfc-4d34-9aaa-a9999bd5543b tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:30:35 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-e0446086-6cfc-4d34-9aaa-a9999bd5543b tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:30:35 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-e0446086-6cfc-4d34-9aaa-a9999bd5543b tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:30:35 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-e0446086-6cfc-4d34-9aaa-a9999bd5543b tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:30:35 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-e0446086-6cfc-4d34-9aaa-a9999bd5543b tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:30:35 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-e0446086-6cfc-4d34-9aaa-a9999bd5543b tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:30:35 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [None req-e0446086-6cfc-4d34-9aaa-a9999bd5543b tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] 10.0.0.210 "POST /compute/v2.1/servers/647674d8-af53-405a-8116-4b7a01549bdf/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.280883 Apr 11 19:30:35 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 171/515] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Apr 11 19:30:35 2023] POST /compute/v2.1/servers/647674d8-af53-405a-8116-4b7a01549bdf/os-volume_attachments => generated 194 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:30:35 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [req-b7468000-cc86-4fdb-9ece-18e8e3dcb445 req-3e29f68c-b792-40af-9383-87e90ca9d3ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6802f099-9236-4c79-a892-2963f1b15b0e", "name": "network-vif-plugged", "status": "completed", "tag": "6193819b-0c1b-476b-b89e-dbbfc7938fc5"}]} {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:30:35 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-b7468000-cc86-4fdb-9ece-18e8e3dcb445 req-3e29f68c-b792-40af-9383-87e90ca9d3ba service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:30:35 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-b7468000-cc86-4fdb-9ece-18e8e3dcb445 req-3e29f68c-b792-40af-9383-87e90ca9d3ba service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:30:35 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-b7468000-cc86-4fdb-9ece-18e8e3dcb445 req-3e29f68c-b792-40af-9383-87e90ca9d3ba service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:30:35 user devstack@n-api.service[72089]: INFO nova.api.openstack.compute.server_external_events [req-b7468000-cc86-4fdb-9ece-18e8e3dcb445 req-3e29f68c-b792-40af-9383-87e90ca9d3ba service nova] Creating event network-vif-plugged:6193819b-0c1b-476b-b89e-dbbfc7938fc5 for instance 6802f099-9236-4c79-a892-2963f1b15b0e on user Apr 11 19:30:35 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [req-b7468000-cc86-4fdb-9ece-18e8e3dcb445 req-3e29f68c-b792-40af-9383-87e90ca9d3ba service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037349 Apr 11 19:30:35 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 177/516] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:30:35 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:30:36 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [req-b0b0f5e2-1f0f-48ed-934c-393ac42f9fb4 req-169b54f2-d14c-40eb-ba46-8a5ef51fae9c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "720c683f-c03a-444c-92a8-daf97c9f524b", "name": "network-vif-plugged", "status": "completed", "tag": "9e6087aa-464a-450d-bd04-2653d9420094"}]} {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:30:36 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-b0b0f5e2-1f0f-48ed-934c-393ac42f9fb4 req-169b54f2-d14c-40eb-ba46-8a5ef51fae9c service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:30:36 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-b0b0f5e2-1f0f-48ed-934c-393ac42f9fb4 req-169b54f2-d14c-40eb-ba46-8a5ef51fae9c service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:30:36 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-b0b0f5e2-1f0f-48ed-934c-393ac42f9fb4 req-169b54f2-d14c-40eb-ba46-8a5ef51fae9c service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:30:36 user devstack@n-api.service[72088]: INFO nova.api.openstack.compute.server_external_events [req-b0b0f5e2-1f0f-48ed-934c-393ac42f9fb4 req-169b54f2-d14c-40eb-ba46-8a5ef51fae9c service nova] Creating event network-vif-plugged:9e6087aa-464a-450d-bd04-2653d9420094 for instance 720c683f-c03a-444c-92a8-daf97c9f524b on user Apr 11 19:30:36 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [req-b0b0f5e2-1f0f-48ed-934c-393ac42f9fb4 req-169b54f2-d14c-40eb-ba46-8a5ef51fae9c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043915 Apr 11 19:30:36 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 169/517] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:30:36 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:30:38 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [req-fa2b2227-aa2d-49d7-86bf-e56bbd36964c req-8fbbc62c-00b4-468c-8dd3-e9e669eab41a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "720c683f-c03a-444c-92a8-daf97c9f524b", "name": "network-vif-plugged", "status": "completed", "tag": "9e6087aa-464a-450d-bd04-2653d9420094"}]} {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:30:38 user devstack@n-api.service[72090]: DEBUG dbcounter [-] [72090] Writing DB stats nova_api:SELECT=29,nova_api:UPDATE=1 {{(pid=72090) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:30:38 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-fa2b2227-aa2d-49d7-86bf-e56bbd36964c req-8fbbc62c-00b4-468c-8dd3-e9e669eab41a service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:30:38 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-fa2b2227-aa2d-49d7-86bf-e56bbd36964c req-8fbbc62c-00b4-468c-8dd3-e9e669eab41a service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:30:38 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-fa2b2227-aa2d-49d7-86bf-e56bbd36964c req-8fbbc62c-00b4-468c-8dd3-e9e669eab41a service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:30:38 user devstack@n-api.service[72090]: DEBUG dbcounter [-] [72090] Writing DB stats nova_cell1:SELECT=64,nova_cell1:UPDATE=5,nova_cell1:INSERT=4 {{(pid=72090) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:30:39 user devstack@n-api.service[72090]: INFO nova.api.openstack.compute.server_external_events [req-fa2b2227-aa2d-49d7-86bf-e56bbd36964c req-8fbbc62c-00b4-468c-8dd3-e9e669eab41a service nova] Creating event network-vif-plugged:9e6087aa-464a-450d-bd04-2653d9420094 for instance 720c683f-c03a-444c-92a8-daf97c9f524b on user Apr 11 19:30:39 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [req-fa2b2227-aa2d-49d7-86bf-e56bbd36964c req-8fbbc62c-00b4-468c-8dd3-e9e669eab41a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048467 Apr 11 19:30:39 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 172/518] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:30:38 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:30:40 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [None req-10273a0c-0575-401e-8221-02af40b3451a tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Calling method '>' {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:30:40 user devstack@n-api.service[72089]: DEBUG nova.compute.api [None req-10273a0c-0575-401e-8221-02af40b3451a tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] [instance: 6f2616ce-4924-4b82-996a-2596ae8856a4] Fetching instance by UUID {{(pid=72089) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:30:40 user devstack@n-api.service[72089]: DEBUG dbcounter [-] [72089] Writing DB stats nova_api:SELECT=30,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=72089) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:30:40 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-10273a0c-0575-401e-8221-02af40b3451a tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:30:40 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-10273a0c-0575-401e-8221-02af40b3451a tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:30:40 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-10273a0c-0575-401e-8221-02af40b3451a tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:30:40 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-10273a0c-0575-401e-8221-02af40b3451a tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:30:40 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-10273a0c-0575-401e-8221-02af40b3451a tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:30:40 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-10273a0c-0575-401e-8221-02af40b3451a tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:30:40 user devstack@n-api.service[72089]: DEBUG dbcounter [-] [72089] Writing DB stats nova_cell1:SELECT=55,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=72089) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:30:40 user devstack@n-api.service[72089]: DEBUG nova.policy [None req-10273a0c-0575-401e-8221-02af40b3451a tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba7f82b529e74d99838b6264b94d823b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e3a291c54b49db8e12a88ba41865e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72089) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:30:40 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [None req-10273a0c-0575-401e-8221-02af40b3451a tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6f2616ce-4924-4b82-996a-2596ae8856a4" status: 200 len: 1505 microversion: 2.1 time: 0.166469 Apr 11 19:30:40 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 178/519] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 19:30:40 2023] GET /compute/v2.1/servers/6f2616ce-4924-4b82-996a-2596ae8856a4 => generated 1505 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:30:42 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [None req-e56fc86b-136b-411a-b5d3-04e7efff45ff tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Calling method '>' {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:30:42 user devstack@n-api.service[72088]: DEBUG nova.compute.api [None req-e56fc86b-136b-411a-b5d3-04e7efff45ff tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] [instance: 647674d8-af53-405a-8116-4b7a01549bdf] Fetching instance by UUID {{(pid=72088) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:30:42 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-e56fc86b-136b-411a-b5d3-04e7efff45ff tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:30:42 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-e56fc86b-136b-411a-b5d3-04e7efff45ff tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:30:42 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-e56fc86b-136b-411a-b5d3-04e7efff45ff tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:30:42 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-e56fc86b-136b-411a-b5d3-04e7efff45ff tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:30:42 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-e56fc86b-136b-411a-b5d3-04e7efff45ff tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:30:42 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-e56fc86b-136b-411a-b5d3-04e7efff45ff tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:30:43 user devstack@n-api.service[72088]: DEBUG nova.policy [None req-e56fc86b-136b-411a-b5d3-04e7efff45ff tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05fb551c320a48f98a4ec00a7f7492d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60a7381a31b84e97a068528f90813773', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72088) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:30:43 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [None req-e56fc86b-136b-411a-b5d3-04e7efff45ff tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] 10.0.0.210 "GET /compute/v2.1/servers/647674d8-af53-405a-8116-4b7a01549bdf" status: 200 len: 1703 microversion: 2.1 time: 0.162080 Apr 11 19:30:43 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 170/520] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 19:30:42 2023] GET /compute/v2.1/servers/647674d8-af53-405a-8116-4b7a01549bdf => generated 1703 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:30:43 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [None req-59a61abf-bf69-4808-8186-9401c1657f72 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Action: 'action', calling method: >, body: {"rebuild": {"name": "tempest-ServerActionsTestJSON-server-1599172202", "metadata": {"rebuild": "server"}, "adminPass": "***", "imageRef": "}} {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:30:43 user devstack@n-api.service[72090]: DEBUG nova.compute.api [None req-59a61abf-bf69-4808-8186-9401c1657f72 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] [instance: 647674d8-af53-405a-8116-4b7a01549bdf] Fetching instance by UUID {{(pid=72090) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:30:43 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-59a61abf-bf69-4808-8186-9401c1657f72 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:30:43 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-59a61abf-bf69-4808-8186-9401c1657f72 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:30:43 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-59a61abf-bf69-4808-8186-9401c1657f72 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:30:43 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-59a61abf-bf69-4808-8186-9401c1657f72 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:30:43 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-59a61abf-bf69-4808-8186-9401c1657f72 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:30:43 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-59a61abf-bf69-4808-8186-9401c1657f72 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:30:43 user devstack@n-api.service[72090]: DEBUG nova.quota [None req-59a61abf-bf69-4808-8186-9401c1657f72 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Getting quotas for project 60a7381a31b84e97a068528f90813773. Resources: dict_keys(['metadata_items']) {{(pid=72090) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 19:30:43 user devstack@n-api.service[72090]: DEBUG nova.quota [None req-59a61abf-bf69-4808-8186-9401c1657f72 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Getting quotas for user 05fb551c320a48f98a4ec00a7f7492d7 and project 60a7381a31b84e97a068528f90813773. Resources: dict_keys(['metadata_items']) {{(pid=72090) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 19:30:43 user devstack@n-api.service[72090]: DEBUG nova.virt.hardware [None req-59a61abf-bf69-4808-8186-9401c1657f72 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Flavor limits 0:0:0 {{(pid=72090) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 19:30:43 user devstack@n-api.service[72090]: DEBUG nova.virt.hardware [None req-59a61abf-bf69-4808-8186-9401c1657f72 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Image limits 0:0:0 {{(pid=72090) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 19:30:43 user devstack@n-api.service[72090]: DEBUG nova.virt.hardware [None req-59a61abf-bf69-4808-8186-9401c1657f72 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Flavor pref 0:0:0 {{(pid=72090) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 19:30:43 user devstack@n-api.service[72090]: DEBUG nova.virt.hardware [None req-59a61abf-bf69-4808-8186-9401c1657f72 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Image pref 0:0:0 {{(pid=72090) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 19:30:43 user devstack@n-api.service[72090]: DEBUG nova.virt.hardware [None req-59a61abf-bf69-4808-8186-9401c1657f72 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72090) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 19:30:43 user devstack@n-api.service[72090]: DEBUG nova.compute.api [None req-59a61abf-bf69-4808-8186-9401c1657f72 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] [instance: 647674d8-af53-405a-8116-4b7a01549bdf] Fetching instance by UUID {{(pid=72090) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:30:43 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-59a61abf-bf69-4808-8186-9401c1657f72 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:30:43 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-59a61abf-bf69-4808-8186-9401c1657f72 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:30:43 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-59a61abf-bf69-4808-8186-9401c1657f72 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:30:43 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-59a61abf-bf69-4808-8186-9401c1657f72 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:30:43 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-59a61abf-bf69-4808-8186-9401c1657f72 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:30:43 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-59a61abf-bf69-4808-8186-9401c1657f72 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:30:43 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [None req-59a61abf-bf69-4808-8186-9401c1657f72 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] 10.0.0.210 "POST /compute/v2.1/servers/647674d8-af53-405a-8116-4b7a01549bdf/action" status: 202 len: 1161 microversion: 2.1 time: 0.372236 Apr 11 19:30:43 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 173/521] 10.0.0.210 () {64 vars in 1356 bytes} [Tue Apr 11 19:30:43 2023] POST /compute/v2.1/servers/647674d8-af53-405a-8116-4b7a01549bdf/action => generated 1161 bytes in 374 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 11 19:30:43 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [None req-8e360ab0-2fe8-426d-b3c8-691d31754195 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Calling method '>' {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:30:43 user devstack@n-api.service[72089]: DEBUG nova.compute.api [None req-8e360ab0-2fe8-426d-b3c8-691d31754195 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] [instance: 647674d8-af53-405a-8116-4b7a01549bdf] Fetching instance by UUID {{(pid=72089) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:30:43 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-8e360ab0-2fe8-426d-b3c8-691d31754195 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:30:43 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-8e360ab0-2fe8-426d-b3c8-691d31754195 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:30:43 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-8e360ab0-2fe8-426d-b3c8-691d31754195 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:30:43 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-8e360ab0-2fe8-426d-b3c8-691d31754195 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:30:43 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-8e360ab0-2fe8-426d-b3c8-691d31754195 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:30:43 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-8e360ab0-2fe8-426d-b3c8-691d31754195 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:30:43 user devstack@n-api.service[72089]: DEBUG nova.policy [None req-8e360ab0-2fe8-426d-b3c8-691d31754195 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05fb551c320a48f98a4ec00a7f7492d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60a7381a31b84e97a068528f90813773', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72089) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:30:43 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [None req-8e360ab0-2fe8-426d-b3c8-691d31754195 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] 10.0.0.210 "GET /compute/v2.1/servers/647674d8-af53-405a-8116-4b7a01549bdf" status: 200 len: 1732 microversion: 2.1 time: 0.157537 Apr 11 19:30:43 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 179/522] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 19:30:43 2023] GET /compute/v2.1/servers/647674d8-af53-405a-8116-4b7a01549bdf => generated 1732 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:30:44 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [req-313bf2d0-a789-40d0-9301-933b75838f41 req-4d5fb904-1fbb-48bb-8258-15dcc5e08da6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "647674d8-af53-405a-8116-4b7a01549bdf", "name": "network-vif-unplugged", "status": "completed", "tag": "e4e4888a-168a-4fe8-a43e-ee683b50a39a"}]} {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:30:44 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-313bf2d0-a789-40d0-9301-933b75838f41 req-4d5fb904-1fbb-48bb-8258-15dcc5e08da6 service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:30:44 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-313bf2d0-a789-40d0-9301-933b75838f41 req-4d5fb904-1fbb-48bb-8258-15dcc5e08da6 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:30:44 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-313bf2d0-a789-40d0-9301-933b75838f41 req-4d5fb904-1fbb-48bb-8258-15dcc5e08da6 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:30:44 user devstack@n-api.service[72088]: INFO nova.api.openstack.compute.server_external_events [req-313bf2d0-a789-40d0-9301-933b75838f41 req-4d5fb904-1fbb-48bb-8258-15dcc5e08da6 service nova] Creating event network-vif-unplugged:e4e4888a-168a-4fe8-a43e-ee683b50a39a for instance 647674d8-af53-405a-8116-4b7a01549bdf on user Apr 11 19:30:44 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [req-313bf2d0-a789-40d0-9301-933b75838f41 req-4d5fb904-1fbb-48bb-8258-15dcc5e08da6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.029460 Apr 11 19:30:44 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 171/523] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:30:44 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:30:46 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [req-9791cb49-4d75-4818-ad9f-071eb986dfe6 req-c601a6a8-d0f4-4a24-bfeb-ba10ba3ee210 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "647674d8-af53-405a-8116-4b7a01549bdf", "name": "network-vif-plugged", "status": "completed", "tag": "e4e4888a-168a-4fe8-a43e-ee683b50a39a"}]} {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:30:46 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-9791cb49-4d75-4818-ad9f-071eb986dfe6 req-c601a6a8-d0f4-4a24-bfeb-ba10ba3ee210 service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:30:46 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-9791cb49-4d75-4818-ad9f-071eb986dfe6 req-c601a6a8-d0f4-4a24-bfeb-ba10ba3ee210 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:30:46 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-9791cb49-4d75-4818-ad9f-071eb986dfe6 req-c601a6a8-d0f4-4a24-bfeb-ba10ba3ee210 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:30:46 user devstack@n-api.service[72090]: INFO nova.api.openstack.compute.server_external_events [req-9791cb49-4d75-4818-ad9f-071eb986dfe6 req-c601a6a8-d0f4-4a24-bfeb-ba10ba3ee210 service nova] Creating event network-vif-plugged:e4e4888a-168a-4fe8-a43e-ee683b50a39a for instance 647674d8-af53-405a-8116-4b7a01549bdf on user Apr 11 19:30:46 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [req-9791cb49-4d75-4818-ad9f-071eb986dfe6 req-c601a6a8-d0f4-4a24-bfeb-ba10ba3ee210 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032779 Apr 11 19:30:46 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 174/524] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:30:46 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:30:54 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [req-8428a32d-63ef-4127-a7d1-0c92de1ff203 req-2de4f26c-a0fe-4ab0-8753-ceb8c4a7d129 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "647674d8-af53-405a-8116-4b7a01549bdf", "name": "network-vif-plugged", "status": "completed", "tag": "e4e4888a-168a-4fe8-a43e-ee683b50a39a"}]} {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:30:54 user devstack@n-api.service[72089]: DEBUG dbcounter [-] [72089] Writing DB stats nova_api:SELECT=3 {{(pid=72089) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:30:54 user devstack@n-api.service[72089]: DEBUG dbcounter [-] [72089] Writing DB stats nova_cell1:SELECT=11 {{(pid=72089) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:30:54 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-8428a32d-63ef-4127-a7d1-0c92de1ff203 req-2de4f26c-a0fe-4ab0-8753-ceb8c4a7d129 service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:30:54 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-8428a32d-63ef-4127-a7d1-0c92de1ff203 req-2de4f26c-a0fe-4ab0-8753-ceb8c4a7d129 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:30:54 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-8428a32d-63ef-4127-a7d1-0c92de1ff203 req-2de4f26c-a0fe-4ab0-8753-ceb8c4a7d129 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:30:54 user devstack@n-api.service[72089]: INFO nova.api.openstack.compute.server_external_events [req-8428a32d-63ef-4127-a7d1-0c92de1ff203 req-2de4f26c-a0fe-4ab0-8753-ceb8c4a7d129 service nova] Creating event network-vif-plugged:e4e4888a-168a-4fe8-a43e-ee683b50a39a for instance 647674d8-af53-405a-8116-4b7a01549bdf on user Apr 11 19:30:54 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [req-8428a32d-63ef-4127-a7d1-0c92de1ff203 req-2de4f26c-a0fe-4ab0-8753-ceb8c4a7d129 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032659 Apr 11 19:30:54 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 180/525] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:30:54 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:30:56 user devstack@n-api.service[72088]: DEBUG dbcounter [-] [72088] Writing DB stats nova_api:SELECT=22 {{(pid=72088) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:30:56 user devstack@n-api.service[72088]: DEBUG dbcounter [-] [72088] Writing DB stats nova_cell1:SELECT=73,nova_cell1:UPDATE=6,nova_cell1:INSERT=5 {{(pid=72088) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:30:56 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [req-268cdab6-4452-4e26-a29b-b48c6882ca95 req-4bee8c6c-3681-45e9-bfd4-5f0231417476 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "647674d8-af53-405a-8116-4b7a01549bdf", "name": "network-vif-plugged", "status": "completed", "tag": "e4e4888a-168a-4fe8-a43e-ee683b50a39a"}]} {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:30:56 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-268cdab6-4452-4e26-a29b-b48c6882ca95 req-4bee8c6c-3681-45e9-bfd4-5f0231417476 service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:30:56 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-268cdab6-4452-4e26-a29b-b48c6882ca95 req-4bee8c6c-3681-45e9-bfd4-5f0231417476 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:30:56 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-268cdab6-4452-4e26-a29b-b48c6882ca95 req-4bee8c6c-3681-45e9-bfd4-5f0231417476 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:30:56 user devstack@n-api.service[72088]: INFO nova.api.openstack.compute.server_external_events [req-268cdab6-4452-4e26-a29b-b48c6882ca95 req-4bee8c6c-3681-45e9-bfd4-5f0231417476 service nova] Creating event network-vif-plugged:e4e4888a-168a-4fe8-a43e-ee683b50a39a for instance 647674d8-af53-405a-8116-4b7a01549bdf on user Apr 11 19:30:56 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [req-268cdab6-4452-4e26-a29b-b48c6882ca95 req-4bee8c6c-3681-45e9-bfd4-5f0231417476 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054089 Apr 11 19:30:56 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 172/526] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:30:56 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:30:59 user devstack@n-api.service[72090]: DEBUG dbcounter [-] [72090] Writing DB stats nova_api:SELECT=17 {{(pid=72090) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:30:59 user devstack@n-api.service[72090]: DEBUG dbcounter [-] [72090] Writing DB stats nova_cell1:SELECT=31,nova_cell1:UPDATE=4,nova_cell1:INSERT=2,nova_cell1:DELETE=1 {{(pid=72090) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:30:59 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [None req-9aa0c57b-ac80-4e2c-9642-de39bf0c7627 tempest-VolumesNegativeTest-1402597116 tempest-VolumesNegativeTest-1402597116-project-member] Calling method '>' {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:30:59 user devstack@n-api.service[72090]: DEBUG nova.compute.api [None req-9aa0c57b-ac80-4e2c-9642-de39bf0c7627 tempest-VolumesNegativeTest-1402597116 tempest-VolumesNegativeTest-1402597116-project-member] [instance: 9466c3da-2c99-41ea-9fb4-41ffbaa9910a] Fetching instance by UUID {{(pid=72090) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:30:59 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-9aa0c57b-ac80-4e2c-9642-de39bf0c7627 tempest-VolumesNegativeTest-1402597116 tempest-VolumesNegativeTest-1402597116-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:30:59 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-9aa0c57b-ac80-4e2c-9642-de39bf0c7627 tempest-VolumesNegativeTest-1402597116 tempest-VolumesNegativeTest-1402597116-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:30:59 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-9aa0c57b-ac80-4e2c-9642-de39bf0c7627 tempest-VolumesNegativeTest-1402597116 tempest-VolumesNegativeTest-1402597116-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:30:59 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-9aa0c57b-ac80-4e2c-9642-de39bf0c7627 tempest-VolumesNegativeTest-1402597116 tempest-VolumesNegativeTest-1402597116-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:30:59 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-9aa0c57b-ac80-4e2c-9642-de39bf0c7627 tempest-VolumesNegativeTest-1402597116 tempest-VolumesNegativeTest-1402597116-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:30:59 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-9aa0c57b-ac80-4e2c-9642-de39bf0c7627 tempest-VolumesNegativeTest-1402597116 tempest-VolumesNegativeTest-1402597116-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:30:59 user devstack@n-api.service[72090]: DEBUG nova.compute.api [None req-9aa0c57b-ac80-4e2c-9642-de39bf0c7627 tempest-VolumesNegativeTest-1402597116 tempest-VolumesNegativeTest-1402597116-project-member] [instance: 9466c3da-2c99-41ea-9fb4-41ffbaa9910a] Going to try to terminate instance {{(pid=72090) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 11 19:30:59 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [None req-9aa0c57b-ac80-4e2c-9642-de39bf0c7627 tempest-VolumesNegativeTest-1402597116 tempest-VolumesNegativeTest-1402597116-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/9466c3da-2c99-41ea-9fb4-41ffbaa9910a" status: 204 len: 0 microversion: 2.1 time: 0.143410 Apr 11 19:31:00 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 175/527] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 19:30:59 2023] DELETE /compute/v2.1/servers/9466c3da-2c99-41ea-9fb4-41ffbaa9910a => generated 0 bytes in 147 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 11 19:31:00 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [None req-4bf7e943-a821-4719-a8f4-831037f75521 tempest-VolumesNegativeTest-1402597116 tempest-VolumesNegativeTest-1402597116-project-member] Calling method '>' {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:31:00 user devstack@n-api.service[72089]: DEBUG nova.compute.api [None req-4bf7e943-a821-4719-a8f4-831037f75521 tempest-VolumesNegativeTest-1402597116 tempest-VolumesNegativeTest-1402597116-project-member] [instance: 9466c3da-2c99-41ea-9fb4-41ffbaa9910a] Fetching instance by UUID {{(pid=72089) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:31:00 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-4bf7e943-a821-4719-a8f4-831037f75521 tempest-VolumesNegativeTest-1402597116 tempest-VolumesNegativeTest-1402597116-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:31:00 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-4bf7e943-a821-4719-a8f4-831037f75521 tempest-VolumesNegativeTest-1402597116 tempest-VolumesNegativeTest-1402597116-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:31:00 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-4bf7e943-a821-4719-a8f4-831037f75521 tempest-VolumesNegativeTest-1402597116 tempest-VolumesNegativeTest-1402597116-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:31:00 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-4bf7e943-a821-4719-a8f4-831037f75521 tempest-VolumesNegativeTest-1402597116 tempest-VolumesNegativeTest-1402597116-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:31:00 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-4bf7e943-a821-4719-a8f4-831037f75521 tempest-VolumesNegativeTest-1402597116 tempest-VolumesNegativeTest-1402597116-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:31:00 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-4bf7e943-a821-4719-a8f4-831037f75521 tempest-VolumesNegativeTest-1402597116 tempest-VolumesNegativeTest-1402597116-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:31:00 user devstack@n-api.service[72089]: DEBUG nova.policy [None req-4bf7e943-a821-4719-a8f4-831037f75521 tempest-VolumesNegativeTest-1402597116 tempest-VolumesNegativeTest-1402597116-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '996881d74ec246f0ac53411a8ca0e7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e983656394754cf68837587d74f9fbb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72089) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:31:00 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [None req-4bf7e943-a821-4719-a8f4-831037f75521 tempest-VolumesNegativeTest-1402597116 tempest-VolumesNegativeTest-1402597116-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9466c3da-2c99-41ea-9fb4-41ffbaa9910a" status: 200 len: 1461 microversion: 2.1 time: 0.237190 Apr 11 19:31:00 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 181/528] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 19:31:00 2023] GET /compute/v2.1/servers/9466c3da-2c99-41ea-9fb4-41ffbaa9910a => generated 1461 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:31:00 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [req-f86ee8cc-1600-44db-a700-1147c0d9f98f req-58451203-604b-4905-872e-ada370124eae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9466c3da-2c99-41ea-9fb4-41ffbaa9910a", "name": "network-vif-unplugged", "status": "completed", "tag": "32cb9325-7443-4bd8-ad26-e54700ba6bf4"}]} {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:31:00 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-f86ee8cc-1600-44db-a700-1147c0d9f98f req-58451203-604b-4905-872e-ada370124eae service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:31:00 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-f86ee8cc-1600-44db-a700-1147c0d9f98f req-58451203-604b-4905-872e-ada370124eae service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:31:00 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-f86ee8cc-1600-44db-a700-1147c0d9f98f req-58451203-604b-4905-872e-ada370124eae service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:31:00 user devstack@n-api.service[72088]: INFO nova.api.openstack.compute.server_external_events [req-f86ee8cc-1600-44db-a700-1147c0d9f98f req-58451203-604b-4905-872e-ada370124eae service nova] Creating event network-vif-unplugged:32cb9325-7443-4bd8-ad26-e54700ba6bf4 for instance 9466c3da-2c99-41ea-9fb4-41ffbaa9910a on user Apr 11 19:31:00 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [req-f86ee8cc-1600-44db-a700-1147c0d9f98f req-58451203-604b-4905-872e-ada370124eae service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034432 Apr 11 19:31:00 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 173/529] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:31:00 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:31:01 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [req-f9d34e2d-9e89-43d1-85b4-b050aa6d8718 req-f040215f-75f7-41b0-83ab-38c36e929482 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9466c3da-2c99-41ea-9fb4-41ffbaa9910a", "name": "network-vif-deleted", "tag": "32cb9325-7443-4bd8-ad26-e54700ba6bf4"}]} {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:31:01 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-f9d34e2d-9e89-43d1-85b4-b050aa6d8718 req-f040215f-75f7-41b0-83ab-38c36e929482 service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:31:01 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-f9d34e2d-9e89-43d1-85b4-b050aa6d8718 req-f040215f-75f7-41b0-83ab-38c36e929482 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:31:01 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-f9d34e2d-9e89-43d1-85b4-b050aa6d8718 req-f040215f-75f7-41b0-83ab-38c36e929482 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:31:01 user devstack@n-api.service[72090]: INFO nova.api.openstack.compute.server_external_events [req-f9d34e2d-9e89-43d1-85b4-b050aa6d8718 req-f040215f-75f7-41b0-83ab-38c36e929482 service nova] Creating event network-vif-deleted:32cb9325-7443-4bd8-ad26-e54700ba6bf4 for instance 9466c3da-2c99-41ea-9fb4-41ffbaa9910a on user Apr 11 19:31:01 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [req-f9d34e2d-9e89-43d1-85b4-b050aa6d8718 req-f040215f-75f7-41b0-83ab-38c36e929482 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032452 Apr 11 19:31:01 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 176/530] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:31:01 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:31:02 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [req-062b0297-f68e-438c-bd35-90d31cbb9152 req-2751e096-3517-4717-aee9-c460cdb8b143 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9466c3da-2c99-41ea-9fb4-41ffbaa9910a", "name": "network-vif-plugged", "status": "completed", "tag": "32cb9325-7443-4bd8-ad26-e54700ba6bf4"}]} {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:31:02 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-062b0297-f68e-438c-bd35-90d31cbb9152 req-2751e096-3517-4717-aee9-c460cdb8b143 service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:31:02 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-062b0297-f68e-438c-bd35-90d31cbb9152 req-2751e096-3517-4717-aee9-c460cdb8b143 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:31:02 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-062b0297-f68e-438c-bd35-90d31cbb9152 req-2751e096-3517-4717-aee9-c460cdb8b143 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:31:02 user devstack@n-api.service[72089]: INFO nova.api.openstack.compute.server_external_events [req-062b0297-f68e-438c-bd35-90d31cbb9152 req-2751e096-3517-4717-aee9-c460cdb8b143 service nova] Creating event network-vif-plugged:32cb9325-7443-4bd8-ad26-e54700ba6bf4 for instance 9466c3da-2c99-41ea-9fb4-41ffbaa9910a on user Apr 11 19:31:02 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [req-062b0297-f68e-438c-bd35-90d31cbb9152 req-2751e096-3517-4717-aee9-c460cdb8b143 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.027663 Apr 11 19:31:02 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 182/531] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:31:02 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:31:07 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [None req-4567fdfd-961f-4684-81ee-8468983ce7e5 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Calling method '>' {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:31:07 user devstack@n-api.service[72088]: DEBUG nova.compute.api [None req-4567fdfd-961f-4684-81ee-8468983ce7e5 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] [instance: 558100b9-f3ac-47c7-9260-b897b0cae55f] Fetching instance by UUID {{(pid=72088) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:31:07 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-4567fdfd-961f-4684-81ee-8468983ce7e5 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:31:07 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-4567fdfd-961f-4684-81ee-8468983ce7e5 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:31:07 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-4567fdfd-961f-4684-81ee-8468983ce7e5 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:31:07 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-4567fdfd-961f-4684-81ee-8468983ce7e5 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:31:07 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-4567fdfd-961f-4684-81ee-8468983ce7e5 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:31:07 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-4567fdfd-961f-4684-81ee-8468983ce7e5 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:31:07 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [None req-4567fdfd-961f-4684-81ee-8468983ce7e5 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] 10.0.0.210 "GET /compute/v2.1/servers/558100b9-f3ac-47c7-9260-b897b0cae55f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042298 Apr 11 19:31:07 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 174/532] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Apr 11 19:31:07 2023] GET /compute/v2.1/servers/558100b9-f3ac-47c7-9260-b897b0cae55f/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 11 19:31:07 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [None req-1987de4e-31ed-4bdb-93f6-118f7dc14c71 tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] Calling method '>' {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:31:07 user devstack@n-api.service[72090]: DEBUG nova.compute.api [None req-1987de4e-31ed-4bdb-93f6-118f7dc14c71 tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] [instance: fc48e37f-8c00-4e48-bea3-f1c2e54d78b8] Fetching instance by UUID {{(pid=72090) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:31:07 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-1987de4e-31ed-4bdb-93f6-118f7dc14c71 tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:31:07 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-1987de4e-31ed-4bdb-93f6-118f7dc14c71 tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:31:07 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-1987de4e-31ed-4bdb-93f6-118f7dc14c71 tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:31:07 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-1987de4e-31ed-4bdb-93f6-118f7dc14c71 tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:31:07 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-1987de4e-31ed-4bdb-93f6-118f7dc14c71 tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:31:07 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-1987de4e-31ed-4bdb-93f6-118f7dc14c71 tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:31:07 user devstack@n-api.service[72090]: INFO nova.api.openstack.wsgi [None req-1987de4e-31ed-4bdb-93f6-118f7dc14c71 tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] HTTP exception thrown: Instance fc48e37f-8c00-4e48-bea3-f1c2e54d78b8 could not be found. Apr 11 19:31:07 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [None req-1987de4e-31ed-4bdb-93f6-118f7dc14c71 tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] Request method failure captured: Apr 11 19:31:07 user devstack@n-api.service[72090]: request: GET /compute/v2.1/servers/fc48e37f-8c00-4e48-bea3-f1c2e54d78b8 HTTP/1.1 Apr 11 19:31:07 user devstack@n-api.service[72090]: Accept: application/json Apr 11 19:31:07 user devstack@n-api.service[72090]: Accept-Encoding: identity Apr 11 19:31:07 user devstack@n-api.service[72090]: Connection: close Apr 11 19:31:07 user devstack@n-api.service[72090]: Content-Length: 0 Apr 11 19:31:07 user devstack@n-api.service[72090]: Content-Type: application/json Apr 11 19:31:07 user devstack@n-api.service[72090]: Host: 10.0.0.210 Apr 11 19:31:07 user devstack@n-api.service[72090]: Openstack-System-Scope: None Apr 11 19:31:07 user devstack@n-api.service[72090]: User-Agent: python-urllib3/1.26.15 Apr 11 19:31:07 user devstack@n-api.service[72090]: X-Auth-Token: gAAAAABkNbM9ghjK_EzyGnW10Ps6cv4IuUgiOsH3-4CZQwwhssOT7z-coBiD1Tdn5TLuazoYlNl2MKZxDC8EHQ-1kxF1ymJhDXjVHNMOdUuaIOx6Zld44aVLhO1ciOh-QMlmbYyfhSKlVncwSZpaRu_co_jrVH31BrJgKqwLygUbeq6C-c51jnQ Apr 11 19:31:07 user devstack@n-api.service[72090]: X-Domain-Id: None Apr 11 19:31:07 user devstack@n-api.service[72090]: X-Domain-Name: None Apr 11 19:31:07 user devstack@n-api.service[72090]: X-Identity-Status: Confirmed Apr 11 19:31:07 user devstack@n-api.service[72090]: X-Is-Admin-Project: True Apr 11 19:31:07 user devstack@n-api.service[72090]: X-Project-Domain-Id: default Apr 11 19:31:07 user devstack@n-api.service[72090]: X-Project-Domain-Name: Default Apr 11 19:31:07 user devstack@n-api.service[72090]: X-Project-Id: 0d5d7769df1e4974b295cb30407151dd Apr 11 19:31:07 user devstack@n-api.service[72090]: X-Project-Name: tempest-ServersNegativeTestJSON-1311045721 Apr 11 19:31:07 user devstack@n-api.service[72090]: X-Role: reader,member Apr 11 19:31:07 user devstack@n-api.service[72090]: X-Roles: reader,member Apr 11 19:31:07 user devstack@n-api.service[72090]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0d5d7769df1e4974b295cb30407151dd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/0d5d7769df1e4974b295cb30407151dd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0d5d7769df1e4974b295cb30407151dd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 11 19:31:07 user devstack@n-api.service[72090]: X-Tenant: tempest-ServersNegativeTestJSON-1311045721 Apr 11 19:31:07 user devstack@n-api.service[72090]: X-Tenant-Id: 0d5d7769df1e4974b295cb30407151dd Apr 11 19:31:07 user devstack@n-api.service[72090]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1311045721 Apr 11 19:31:07 user devstack@n-api.service[72090]: X-User: tempest-ServersNegativeTestJSON-1311045721-project-member Apr 11 19:31:07 user devstack@n-api.service[72090]: X-User-Domain-Id: default Apr 11 19:31:07 user devstack@n-api.service[72090]: X-User-Domain-Name: Default Apr 11 19:31:07 user devstack@n-api.service[72090]: X-User-Id: 2f44dfa2528b4540a81f4eb7c3f3f2f5 Apr 11 19:31:07 user devstack@n-api.service[72090]: X-User-Name: tempest-ServersNegativeTestJSON-1311045721-project-member Apr 11 19:31:07 user devstack@n-api.service[72090]: method: > Apr 11 19:31:07 user devstack@n-api.service[72090]: exception: Instance fc48e37f-8c00-4e48-bea3-f1c2e54d78b8 could not be found. Apr 11 19:31:07 user devstack@n-api.service[72090]: action_args: {'id': 'fc48e37f-8c00-4e48-bea3-f1c2e54d78b8'} Apr 11 19:31:07 user devstack@n-api.service[72090]: {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 19:31:07 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:31:07 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 19:31:07 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 19:31:07 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 19:31:07 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 19:31:07 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 19:31:07 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 19:31:07 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 19:31:07 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 19:31:07 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fc48e37f-8c00-4e48-bea3-f1c2e54d78b8 could not be found. Apr 11 19:31:07 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi Apr 11 19:31:07 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 19:31:07 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi Apr 11 19:31:07 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:31:07 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 19:31:07 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 19:31:07 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 19:31:07 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 19:31:07 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 19:31:07 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 19:31:07 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 19:31:07 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 19:31:07 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 19:31:07 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 19:31:07 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 19:31:07 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 19:31:07 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fc48e37f-8c00-4e48-bea3-f1c2e54d78b8 could not be found. Apr 11 19:31:07 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi Apr 11 19:31:07 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 19:31:07 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi Apr 11 19:31:07 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:31:07 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 19:31:07 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 19:31:07 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 19:31:07 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 19:31:07 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fc48e37f-8c00-4e48-bea3-f1c2e54d78b8 could not be found. Apr 11 19:31:07 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi Apr 11 19:31:07 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [None req-1987de4e-31ed-4bdb-93f6-118f7dc14c71 tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] Returning 404 to user: Instance fc48e37f-8c00-4e48-bea3-f1c2e54d78b8 could not be found. {{(pid=72090) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 19:31:07 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [None req-1987de4e-31ed-4bdb-93f6-118f7dc14c71 tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fc48e37f-8c00-4e48-bea3-f1c2e54d78b8" status: 404 len: 111 microversion: 2.1 time: 0.034868 Apr 11 19:31:07 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 177/533] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 19:31:07 2023] GET /compute/v2.1/servers/fc48e37f-8c00-4e48-bea3-f1c2e54d78b8 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 19:31:07 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [None req-e96ee497-4b7f-4a6c-9555-0846b4f172f8 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Calling method '>' {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:31:07 user devstack@n-api.service[72089]: DEBUG nova.compute.api [None req-e96ee497-4b7f-4a6c-9555-0846b4f172f8 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] [instance: 558100b9-f3ac-47c7-9260-b897b0cae55f] Fetching instance by UUID {{(pid=72089) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:31:07 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-e96ee497-4b7f-4a6c-9555-0846b4f172f8 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:31:07 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-e96ee497-4b7f-4a6c-9555-0846b4f172f8 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:31:07 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-e96ee497-4b7f-4a6c-9555-0846b4f172f8 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:31:07 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-e96ee497-4b7f-4a6c-9555-0846b4f172f8 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:31:07 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-e96ee497-4b7f-4a6c-9555-0846b4f172f8 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:31:07 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-e96ee497-4b7f-4a6c-9555-0846b4f172f8 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:31:07 user devstack@n-api.service[72089]: DEBUG nova.compute.api [None req-e96ee497-4b7f-4a6c-9555-0846b4f172f8 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] [instance: 558100b9-f3ac-47c7-9260-b897b0cae55f] Going to try to terminate instance {{(pid=72089) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 11 19:31:07 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [None req-e96ee497-4b7f-4a6c-9555-0846b4f172f8 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/558100b9-f3ac-47c7-9260-b897b0cae55f" status: 204 len: 0 microversion: 2.1 time: 0.114239 Apr 11 19:31:07 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 183/534] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 19:31:07 2023] DELETE /compute/v2.1/servers/558100b9-f3ac-47c7-9260-b897b0cae55f => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 11 19:31:08 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [None req-b76fc29f-3cc9-4dff-a824-e68c2feb7165 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Calling method '>' {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:31:08 user devstack@n-api.service[72088]: DEBUG nova.compute.api [None req-b76fc29f-3cc9-4dff-a824-e68c2feb7165 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] [instance: 558100b9-f3ac-47c7-9260-b897b0cae55f] Fetching instance by UUID {{(pid=72088) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:31:08 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-b76fc29f-3cc9-4dff-a824-e68c2feb7165 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:31:08 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-b76fc29f-3cc9-4dff-a824-e68c2feb7165 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:31:08 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-b76fc29f-3cc9-4dff-a824-e68c2feb7165 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:31:08 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-b76fc29f-3cc9-4dff-a824-e68c2feb7165 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:31:08 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-b76fc29f-3cc9-4dff-a824-e68c2feb7165 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:31:08 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-b76fc29f-3cc9-4dff-a824-e68c2feb7165 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:31:08 user devstack@n-api.service[72088]: DEBUG nova.policy [None req-b76fc29f-3cc9-4dff-a824-e68c2feb7165 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5d405421ceb4d99967ef2e7f55e7809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06966e2f4d3a4dec92282c7ad348635d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72088) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:31:08 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [None req-b76fc29f-3cc9-4dff-a824-e68c2feb7165 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] 10.0.0.210 "GET /compute/v2.1/servers/558100b9-f3ac-47c7-9260-b897b0cae55f" status: 200 len: 1668 microversion: 2.1 time: 0.171987 Apr 11 19:31:08 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 175/535] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 19:31:07 2023] GET /compute/v2.1/servers/558100b9-f3ac-47c7-9260-b897b0cae55f => generated 1668 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:31:08 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [req-b0cc0682-6bea-4b99-b1c5-584e793e7c9f req-476d9f91-b035-4c20-85af-3a4be27d2710 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "558100b9-f3ac-47c7-9260-b897b0cae55f", "name": "network-vif-unplugged", "status": "completed", "tag": "4f568bd5-7271-434e-a30e-beb13759e1f1"}]} {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:31:08 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-b0cc0682-6bea-4b99-b1c5-584e793e7c9f req-476d9f91-b035-4c20-85af-3a4be27d2710 service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:31:08 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-b0cc0682-6bea-4b99-b1c5-584e793e7c9f req-476d9f91-b035-4c20-85af-3a4be27d2710 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:31:08 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-b0cc0682-6bea-4b99-b1c5-584e793e7c9f req-476d9f91-b035-4c20-85af-3a4be27d2710 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:31:08 user devstack@n-api.service[72089]: INFO nova.api.openstack.compute.server_external_events [req-b0cc0682-6bea-4b99-b1c5-584e793e7c9f req-476d9f91-b035-4c20-85af-3a4be27d2710 service nova] Creating event network-vif-unplugged:4f568bd5-7271-434e-a30e-beb13759e1f1 for instance 558100b9-f3ac-47c7-9260-b897b0cae55f on user Apr 11 19:31:08 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [req-b0cc0682-6bea-4b99-b1c5-584e793e7c9f req-476d9f91-b035-4c20-85af-3a4be27d2710 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.048789 Apr 11 19:31:08 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 184/536] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:31:08 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 11 19:31:08 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [None req-e194ee13-72aa-41c8-a4c9-fcdec2b42074 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Calling method '>' {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:31:08 user devstack@n-api.service[72090]: DEBUG nova.compute.api [None req-e194ee13-72aa-41c8-a4c9-fcdec2b42074 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] [instance: 864fcd9b-8e5b-4de8-a2e6-292a8907a834] Fetching instance by UUID {{(pid=72090) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:31:08 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-e194ee13-72aa-41c8-a4c9-fcdec2b42074 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:31:08 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-e194ee13-72aa-41c8-a4c9-fcdec2b42074 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:31:08 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-e194ee13-72aa-41c8-a4c9-fcdec2b42074 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:31:08 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-e194ee13-72aa-41c8-a4c9-fcdec2b42074 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:31:08 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-e194ee13-72aa-41c8-a4c9-fcdec2b42074 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:31:08 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-e194ee13-72aa-41c8-a4c9-fcdec2b42074 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:31:08 user devstack@n-api.service[72090]: DEBUG nova.policy [None req-e194ee13-72aa-41c8-a4c9-fcdec2b42074 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b3adca432b04d70818a51d1366f5c6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb91586feb3f4a4c84fa8c2183baaf8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72090) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:31:08 user devstack@n-api.service[72090]: DEBUG nova.policy [None req-e194ee13-72aa-41c8-a4c9-fcdec2b42074 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b3adca432b04d70818a51d1366f5c6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb91586feb3f4a4c84fa8c2183baaf8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72090) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:31:08 user devstack@n-api.service[72090]: DEBUG nova.policy [None req-e194ee13-72aa-41c8-a4c9-fcdec2b42074 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b3adca432b04d70818a51d1366f5c6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb91586feb3f4a4c84fa8c2183baaf8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72090) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:31:08 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [None req-e194ee13-72aa-41c8-a4c9-fcdec2b42074 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] 10.0.0.210 "GET /compute/v2.1/servers/864fcd9b-8e5b-4de8-a2e6-292a8907a834" status: 200 len: 1755 microversion: 2.87 time: 0.483856 Apr 11 19:31:08 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 178/537] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 19:31:08 2023] GET /compute/v2.1/servers/864fcd9b-8e5b-4de8-a2e6-292a8907a834 => generated 1755 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 19:31:09 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [req-313d80ab-9abd-4c6c-9a84-813b56f5ea9f req-1af1bf09-8710-4248-9763-155def26785b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "558100b9-f3ac-47c7-9260-b897b0cae55f", "name": "network-vif-deleted", "tag": "4f568bd5-7271-434e-a30e-beb13759e1f1"}]} {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:31:09 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-313d80ab-9abd-4c6c-9a84-813b56f5ea9f req-1af1bf09-8710-4248-9763-155def26785b service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:31:09 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-313d80ab-9abd-4c6c-9a84-813b56f5ea9f req-1af1bf09-8710-4248-9763-155def26785b service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:31:09 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-313d80ab-9abd-4c6c-9a84-813b56f5ea9f req-1af1bf09-8710-4248-9763-155def26785b service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:31:09 user devstack@n-api.service[72088]: INFO nova.api.openstack.compute.server_external_events [req-313d80ab-9abd-4c6c-9a84-813b56f5ea9f req-1af1bf09-8710-4248-9763-155def26785b service nova] Creating event network-vif-deleted:4f568bd5-7271-434e-a30e-beb13759e1f1 for instance 558100b9-f3ac-47c7-9260-b897b0cae55f on user Apr 11 19:31:09 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [req-313d80ab-9abd-4c6c-9a84-813b56f5ea9f req-1af1bf09-8710-4248-9763-155def26785b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032230 Apr 11 19:31:09 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 176/538] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:31:09 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:31:10 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [req-a990ed6b-f8aa-4470-b6d1-0c0cc232627a req-be4bfb50-40bf-4898-bb81-dec8bb56371a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "558100b9-f3ac-47c7-9260-b897b0cae55f", "name": "network-vif-plugged", "status": "completed", "tag": "4f568bd5-7271-434e-a30e-beb13759e1f1"}, {"server_uuid": "558100b9-f3ac-47c7-9260-b897b0cae55f", "name": "network-vif-plugged", "status": "completed", "tag": "4f568bd5-7271-434e-a30e-beb13759e1f1"}]} {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:31:10 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-a990ed6b-f8aa-4470-b6d1-0c0cc232627a req-be4bfb50-40bf-4898-bb81-dec8bb56371a service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:31:10 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-a990ed6b-f8aa-4470-b6d1-0c0cc232627a req-be4bfb50-40bf-4898-bb81-dec8bb56371a service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:31:10 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-a990ed6b-f8aa-4470-b6d1-0c0cc232627a req-be4bfb50-40bf-4898-bb81-dec8bb56371a service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:31:10 user devstack@n-api.service[72089]: INFO nova.api.openstack.compute.server_external_events [req-a990ed6b-f8aa-4470-b6d1-0c0cc232627a req-be4bfb50-40bf-4898-bb81-dec8bb56371a service nova] Creating event network-vif-plugged:4f568bd5-7271-434e-a30e-beb13759e1f1 for instance 558100b9-f3ac-47c7-9260-b897b0cae55f on user Apr 11 19:31:10 user devstack@n-api.service[72089]: INFO nova.api.openstack.compute.server_external_events [req-a990ed6b-f8aa-4470-b6d1-0c0cc232627a req-be4bfb50-40bf-4898-bb81-dec8bb56371a service nova] Creating event network-vif-plugged:4f568bd5-7271-434e-a30e-beb13759e1f1 for instance 558100b9-f3ac-47c7-9260-b897b0cae55f on user Apr 11 19:31:10 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [req-a990ed6b-f8aa-4470-b6d1-0c0cc232627a req-be4bfb50-40bf-4898-bb81-dec8bb56371a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.031333 Apr 11 19:31:10 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 185/539] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:31:10 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:31:11 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [None req-95791e2e-35b1-4b96-b0c0-2ede9dc47b85 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Calling method '>' {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:31:11 user devstack@n-api.service[72090]: DEBUG nova.compute.api [None req-95791e2e-35b1-4b96-b0c0-2ede9dc47b85 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] [instance: 720c683f-c03a-444c-92a8-daf97c9f524b] Fetching instance by UUID {{(pid=72090) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:31:11 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-95791e2e-35b1-4b96-b0c0-2ede9dc47b85 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:31:11 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-95791e2e-35b1-4b96-b0c0-2ede9dc47b85 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:31:11 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-95791e2e-35b1-4b96-b0c0-2ede9dc47b85 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:31:11 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-95791e2e-35b1-4b96-b0c0-2ede9dc47b85 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:31:11 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-95791e2e-35b1-4b96-b0c0-2ede9dc47b85 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:31:11 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-95791e2e-35b1-4b96-b0c0-2ede9dc47b85 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:31:11 user devstack@n-api.service[72090]: DEBUG nova.policy [None req-95791e2e-35b1-4b96-b0c0-2ede9dc47b85 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0558ba5a2b04d36ba2f2411090cc4e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d8b189667e34931aa36149620a036e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72090) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:31:11 user devstack@n-api.service[72090]: DEBUG nova.policy [None req-95791e2e-35b1-4b96-b0c0-2ede9dc47b85 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0558ba5a2b04d36ba2f2411090cc4e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d8b189667e34931aa36149620a036e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72090) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:31:11 user devstack@n-api.service[72090]: DEBUG nova.policy [None req-95791e2e-35b1-4b96-b0c0-2ede9dc47b85 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0558ba5a2b04d36ba2f2411090cc4e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d8b189667e34931aa36149620a036e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72090) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:31:11 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [None req-95791e2e-35b1-4b96-b0c0-2ede9dc47b85 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] 10.0.0.210 "GET /compute/v2.1/servers/720c683f-c03a-444c-92a8-daf97c9f524b" status: 200 len: 1781 microversion: 2.20 time: 0.169759 Apr 11 19:31:11 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 179/540] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 19:31:11 2023] GET /compute/v2.1/servers/720c683f-c03a-444c-92a8-daf97c9f524b => generated 1781 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 19:31:23 user devstack@n-api.service[72088]: DEBUG dbcounter [-] [72088] Writing DB stats nova_api:SELECT=10 {{(pid=72088) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:31:23 user devstack@n-api.service[72088]: DEBUG dbcounter [-] [72088] Writing DB stats nova_cell1:SELECT=18 {{(pid=72088) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:31:23 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [None req-adcba3c1-52a8-42e9-b7a1-9cc22e224822 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Calling method '>' {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:31:23 user devstack@n-api.service[72088]: DEBUG nova.compute.api [None req-adcba3c1-52a8-42e9-b7a1-9cc22e224822 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] [instance: 6802f099-9236-4c79-a892-2963f1b15b0e] Fetching instance by UUID {{(pid=72088) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:31:23 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-adcba3c1-52a8-42e9-b7a1-9cc22e224822 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:31:23 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-adcba3c1-52a8-42e9-b7a1-9cc22e224822 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:31:23 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-adcba3c1-52a8-42e9-b7a1-9cc22e224822 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:31:23 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-adcba3c1-52a8-42e9-b7a1-9cc22e224822 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:31:23 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-adcba3c1-52a8-42e9-b7a1-9cc22e224822 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:31:23 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-adcba3c1-52a8-42e9-b7a1-9cc22e224822 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:31:23 user devstack@n-api.service[72088]: DEBUG nova.policy [None req-adcba3c1-52a8-42e9-b7a1-9cc22e224822 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31c237e142784bd6aa460d6f1bf33400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd886d2ec5fc946b49af3c8ca7c8556c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72088) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:31:23 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [None req-adcba3c1-52a8-42e9-b7a1-9cc22e224822 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6802f099-9236-4c79-a892-2963f1b15b0e" status: 200 len: 1644 microversion: 2.1 time: 0.204821 Apr 11 19:31:23 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 177/541] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 19:31:23 2023] GET /compute/v2.1/servers/6802f099-9236-4c79-a892-2963f1b15b0e => generated 1644 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:31:33 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [None req-73eb6ae0-6693-4d9a-a19c-ad2b9b1e3dae tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Calling method '>' {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:31:33 user devstack@n-api.service[72089]: DEBUG nova.compute.api [None req-73eb6ae0-6693-4d9a-a19c-ad2b9b1e3dae tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] [instance: 647674d8-af53-405a-8116-4b7a01549bdf] Fetching instance by UUID {{(pid=72089) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:31:33 user devstack@n-api.service[72089]: DEBUG dbcounter [-] [72089] Writing DB stats nova_api:SELECT=17,nova_api:UPDATE=1 {{(pid=72089) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:31:33 user devstack@n-api.service[72089]: DEBUG dbcounter [-] [72089] Writing DB stats nova_cell1:SELECT=29,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=72089) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:31:33 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-73eb6ae0-6693-4d9a-a19c-ad2b9b1e3dae tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:31:33 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-73eb6ae0-6693-4d9a-a19c-ad2b9b1e3dae tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:31:33 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-73eb6ae0-6693-4d9a-a19c-ad2b9b1e3dae tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:31:33 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-73eb6ae0-6693-4d9a-a19c-ad2b9b1e3dae tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:31:33 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-73eb6ae0-6693-4d9a-a19c-ad2b9b1e3dae tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:31:33 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-73eb6ae0-6693-4d9a-a19c-ad2b9b1e3dae tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:31:34 user devstack@n-api.service[72089]: DEBUG nova.policy [None req-73eb6ae0-6693-4d9a-a19c-ad2b9b1e3dae tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05fb551c320a48f98a4ec00a7f7492d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60a7381a31b84e97a068528f90813773', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72089) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:31:34 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [None req-73eb6ae0-6693-4d9a-a19c-ad2b9b1e3dae tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] 10.0.0.210 "GET /compute/v2.1/servers/647674d8-af53-405a-8116-4b7a01549bdf" status: 200 len: 1723 microversion: 2.1 time: 0.476043 Apr 11 19:31:34 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 186/542] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 19:31:33 2023] GET /compute/v2.1/servers/647674d8-af53-405a-8116-4b7a01549bdf => generated 1723 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:31:41 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [None req-ffcd951d-f883-45c7-9958-265fe40e5f35 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:31:41 user devstack@n-api.service[72090]: DEBUG nova.compute.api [None req-ffcd951d-f883-45c7-9958-265fe40e5f35 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] [instance: 6f2616ce-4924-4b82-996a-2596ae8856a4] Fetching instance by UUID {{(pid=72090) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:31:41 user devstack@n-api.service[72090]: DEBUG dbcounter [-] [72090] Writing DB stats nova_api:SELECT=17,nova_api:UPDATE=1 {{(pid=72090) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:31:41 user devstack@n-api.service[72090]: DEBUG dbcounter [-] [72090] Writing DB stats nova_cell1:SELECT=31,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=72090) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:31:41 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-ffcd951d-f883-45c7-9958-265fe40e5f35 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:31:41 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-ffcd951d-f883-45c7-9958-265fe40e5f35 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:31:41 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-ffcd951d-f883-45c7-9958-265fe40e5f35 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:31:41 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-ffcd951d-f883-45c7-9958-265fe40e5f35 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:31:41 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-ffcd951d-f883-45c7-9958-265fe40e5f35 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:31:41 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-ffcd951d-f883-45c7-9958-265fe40e5f35 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:31:41 user devstack@n-api.service[72090]: DEBUG nova.objects.instance [None req-ffcd951d-f883-45c7-9958-265fe40e5f35 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Lazy-loading 'flavor' on Instance uuid 6f2616ce-4924-4b82-996a-2596ae8856a4 {{(pid=72090) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 11 19:31:41 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [None req-ffcd951d-f883-45c7-9958-265fe40e5f35 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] 10.0.0.210 "POST /compute/v2.1/servers/6f2616ce-4924-4b82-996a-2596ae8856a4/action" status: 200 len: 32 microversion: 2.1 time: 0.108218 Apr 11 19:31:41 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 180/543] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Apr 11 19:31:41 2023] POST /compute/v2.1/servers/6f2616ce-4924-4b82-996a-2596ae8856a4/action => generated 32 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 11 19:31:41 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [None req-ed775fcf-b683-4a77-91b6-5cdac806acbb tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Calling method '>' {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:31:41 user devstack@n-api.service[72088]: DEBUG nova.compute.api [None req-ed775fcf-b683-4a77-91b6-5cdac806acbb tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] [instance: 6f2616ce-4924-4b82-996a-2596ae8856a4] Fetching instance by UUID {{(pid=72088) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:31:41 user devstack@n-api.service[72088]: DEBUG dbcounter [-] [72088] Writing DB stats nova_api:SELECT=2 {{(pid=72088) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:31:41 user devstack@n-api.service[72088]: DEBUG dbcounter [-] [72088] Writing DB stats nova_cell1:SELECT=6 {{(pid=72088) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:31:41 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-ed775fcf-b683-4a77-91b6-5cdac806acbb tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:31:41 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-ed775fcf-b683-4a77-91b6-5cdac806acbb tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:31:41 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-ed775fcf-b683-4a77-91b6-5cdac806acbb tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:31:41 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-ed775fcf-b683-4a77-91b6-5cdac806acbb tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:31:41 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-ed775fcf-b683-4a77-91b6-5cdac806acbb tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:31:41 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-ed775fcf-b683-4a77-91b6-5cdac806acbb tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:31:41 user devstack@n-api.service[72088]: DEBUG nova.policy [None req-ed775fcf-b683-4a77-91b6-5cdac806acbb tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba7f82b529e74d99838b6264b94d823b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e3a291c54b49db8e12a88ba41865e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72088) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:31:41 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [None req-ed775fcf-b683-4a77-91b6-5cdac806acbb tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6f2616ce-4924-4b82-996a-2596ae8856a4" status: 200 len: 1511 microversion: 2.1 time: 0.541311 Apr 11 19:31:41 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 178/544] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 19:31:41 2023] GET /compute/v2.1/servers/6f2616ce-4924-4b82-996a-2596ae8856a4 => generated 1511 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:31:42 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [req-5daf941c-7924-4266-8fb0-2cf48bd09dd2 req-c55e5552-a574-4c96-a6e2-ae2fe362d361 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f2616ce-4924-4b82-996a-2596ae8856a4", "name": "network-vif-unplugged", "status": "completed", "tag": "1c929bc1-2708-4e38-80b3-354812ccb529"}]} {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:31:42 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-5daf941c-7924-4266-8fb0-2cf48bd09dd2 req-c55e5552-a574-4c96-a6e2-ae2fe362d361 service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:31:42 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-5daf941c-7924-4266-8fb0-2cf48bd09dd2 req-c55e5552-a574-4c96-a6e2-ae2fe362d361 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:31:42 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-5daf941c-7924-4266-8fb0-2cf48bd09dd2 req-c55e5552-a574-4c96-a6e2-ae2fe362d361 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:31:42 user devstack@n-api.service[72089]: INFO nova.api.openstack.compute.server_external_events [req-5daf941c-7924-4266-8fb0-2cf48bd09dd2 req-c55e5552-a574-4c96-a6e2-ae2fe362d361 service nova] Creating event network-vif-unplugged:1c929bc1-2708-4e38-80b3-354812ccb529 for instance 6f2616ce-4924-4b82-996a-2596ae8856a4 on user Apr 11 19:31:42 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [req-5daf941c-7924-4266-8fb0-2cf48bd09dd2 req-c55e5552-a574-4c96-a6e2-ae2fe362d361 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.028979 Apr 11 19:31:42 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 187/545] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:31:42 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:31:44 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [req-0747b5e6-e7e9-4408-9384-1b10a33e1b73 req-aef93a17-e796-488f-9973-1e5f141de7d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f2616ce-4924-4b82-996a-2596ae8856a4", "name": "network-vif-plugged", "status": "completed", "tag": "1c929bc1-2708-4e38-80b3-354812ccb529"}, {"server_uuid": "6f2616ce-4924-4b82-996a-2596ae8856a4", "name": "network-vif-plugged", "status": "completed", "tag": "1c929bc1-2708-4e38-80b3-354812ccb529"}, {"server_uuid": "6f2616ce-4924-4b82-996a-2596ae8856a4", "name": "network-vif-plugged", "status": "completed", "tag": "1c929bc1-2708-4e38-80b3-354812ccb529"}, {"server_uuid": "6f2616ce-4924-4b82-996a-2596ae8856a4", "name": "network-vif-unplugged", "status": "completed", "tag": "1c929bc1-2708-4e38-80b3-354812ccb529"}, {"server_uuid": "6f2616ce-4924-4b82-996a-2596ae8856a4", "name": "network-vif-plugged", "status": "completed", "tag": "1c929bc1-2708-4e38-80b3-354812ccb529"}]} {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:31:44 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-0747b5e6-e7e9-4408-9384-1b10a33e1b73 req-aef93a17-e796-488f-9973-1e5f141de7d6 service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:31:44 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-0747b5e6-e7e9-4408-9384-1b10a33e1b73 req-aef93a17-e796-488f-9973-1e5f141de7d6 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:31:44 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-0747b5e6-e7e9-4408-9384-1b10a33e1b73 req-aef93a17-e796-488f-9973-1e5f141de7d6 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:31:44 user devstack@n-api.service[72090]: INFO nova.api.openstack.compute.server_external_events [req-0747b5e6-e7e9-4408-9384-1b10a33e1b73 req-aef93a17-e796-488f-9973-1e5f141de7d6 service nova] Creating event network-vif-plugged:1c929bc1-2708-4e38-80b3-354812ccb529 for instance 6f2616ce-4924-4b82-996a-2596ae8856a4 on user Apr 11 19:31:44 user devstack@n-api.service[72090]: INFO nova.api.openstack.compute.server_external_events [req-0747b5e6-e7e9-4408-9384-1b10a33e1b73 req-aef93a17-e796-488f-9973-1e5f141de7d6 service nova] Creating event network-vif-plugged:1c929bc1-2708-4e38-80b3-354812ccb529 for instance 6f2616ce-4924-4b82-996a-2596ae8856a4 on user Apr 11 19:31:44 user devstack@n-api.service[72090]: INFO nova.api.openstack.compute.server_external_events [req-0747b5e6-e7e9-4408-9384-1b10a33e1b73 req-aef93a17-e796-488f-9973-1e5f141de7d6 service nova] Creating event network-vif-plugged:1c929bc1-2708-4e38-80b3-354812ccb529 for instance 6f2616ce-4924-4b82-996a-2596ae8856a4 on user Apr 11 19:31:44 user devstack@n-api.service[72090]: INFO nova.api.openstack.compute.server_external_events [req-0747b5e6-e7e9-4408-9384-1b10a33e1b73 req-aef93a17-e796-488f-9973-1e5f141de7d6 service nova] Creating event network-vif-unplugged:1c929bc1-2708-4e38-80b3-354812ccb529 for instance 6f2616ce-4924-4b82-996a-2596ae8856a4 on user Apr 11 19:31:44 user devstack@n-api.service[72090]: INFO nova.api.openstack.compute.server_external_events [req-0747b5e6-e7e9-4408-9384-1b10a33e1b73 req-aef93a17-e796-488f-9973-1e5f141de7d6 service nova] Creating event network-vif-plugged:1c929bc1-2708-4e38-80b3-354812ccb529 for instance 6f2616ce-4924-4b82-996a-2596ae8856a4 on user Apr 11 19:31:44 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [req-0747b5e6-e7e9-4408-9384-1b10a33e1b73 req-aef93a17-e796-488f-9973-1e5f141de7d6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 869 microversion: 2.1 time: 0.035110 Apr 11 19:31:44 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 181/546] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:31:44 2023] POST /compute/v2.1/os-server-external-events => generated 869 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:31:46 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [req-cb46bab4-3c82-4303-a49a-409bc9580495 req-91660644-2b44-4ee0-a064-2e1db6918d32 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f2616ce-4924-4b82-996a-2596ae8856a4", "name": "network-vif-plugged", "status": "completed", "tag": "1c929bc1-2708-4e38-80b3-354812ccb529"}, {"server_uuid": "6f2616ce-4924-4b82-996a-2596ae8856a4", "name": "network-vif-plugged", "status": "completed", "tag": "1c929bc1-2708-4e38-80b3-354812ccb529"}]} {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:31:46 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-cb46bab4-3c82-4303-a49a-409bc9580495 req-91660644-2b44-4ee0-a064-2e1db6918d32 service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:31:46 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-cb46bab4-3c82-4303-a49a-409bc9580495 req-91660644-2b44-4ee0-a064-2e1db6918d32 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:31:46 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-cb46bab4-3c82-4303-a49a-409bc9580495 req-91660644-2b44-4ee0-a064-2e1db6918d32 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:31:46 user devstack@n-api.service[72088]: INFO nova.api.openstack.compute.server_external_events [req-cb46bab4-3c82-4303-a49a-409bc9580495 req-91660644-2b44-4ee0-a064-2e1db6918d32 service nova] Creating event network-vif-plugged:1c929bc1-2708-4e38-80b3-354812ccb529 for instance 6f2616ce-4924-4b82-996a-2596ae8856a4 on user Apr 11 19:31:46 user devstack@n-api.service[72088]: INFO nova.api.openstack.compute.server_external_events [req-cb46bab4-3c82-4303-a49a-409bc9580495 req-91660644-2b44-4ee0-a064-2e1db6918d32 service nova] Creating event network-vif-plugged:1c929bc1-2708-4e38-80b3-354812ccb529 for instance 6f2616ce-4924-4b82-996a-2596ae8856a4 on user Apr 11 19:31:46 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [req-cb46bab4-3c82-4303-a49a-409bc9580495 req-91660644-2b44-4ee0-a064-2e1db6918d32 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.029024 Apr 11 19:31:46 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 179/547] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:31:46 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:31:50 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [None req-10fd7bb7-32a8-4e86-9df8-ab90ff5b0216 tempest-VolumesNegativeTest-1402597116 tempest-VolumesNegativeTest-1402597116-project-member] Calling method '>' {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:31:50 user devstack@n-api.service[72089]: DEBUG nova.compute.api [None req-10fd7bb7-32a8-4e86-9df8-ab90ff5b0216 tempest-VolumesNegativeTest-1402597116 tempest-VolumesNegativeTest-1402597116-project-member] [instance: 9466c3da-2c99-41ea-9fb4-41ffbaa9910a] Fetching instance by UUID {{(pid=72089) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:31:50 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-10fd7bb7-32a8-4e86-9df8-ab90ff5b0216 tempest-VolumesNegativeTest-1402597116 tempest-VolumesNegativeTest-1402597116-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:31:50 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-10fd7bb7-32a8-4e86-9df8-ab90ff5b0216 tempest-VolumesNegativeTest-1402597116 tempest-VolumesNegativeTest-1402597116-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:31:50 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-10fd7bb7-32a8-4e86-9df8-ab90ff5b0216 tempest-VolumesNegativeTest-1402597116 tempest-VolumesNegativeTest-1402597116-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:31:50 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-10fd7bb7-32a8-4e86-9df8-ab90ff5b0216 tempest-VolumesNegativeTest-1402597116 tempest-VolumesNegativeTest-1402597116-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:31:50 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-10fd7bb7-32a8-4e86-9df8-ab90ff5b0216 tempest-VolumesNegativeTest-1402597116 tempest-VolumesNegativeTest-1402597116-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:31:50 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-10fd7bb7-32a8-4e86-9df8-ab90ff5b0216 tempest-VolumesNegativeTest-1402597116 tempest-VolumesNegativeTest-1402597116-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:31:50 user devstack@n-api.service[72089]: INFO nova.api.openstack.wsgi [None req-10fd7bb7-32a8-4e86-9df8-ab90ff5b0216 tempest-VolumesNegativeTest-1402597116 tempest-VolumesNegativeTest-1402597116-project-member] HTTP exception thrown: Instance 9466c3da-2c99-41ea-9fb4-41ffbaa9910a could not be found. Apr 11 19:31:50 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [None req-10fd7bb7-32a8-4e86-9df8-ab90ff5b0216 tempest-VolumesNegativeTest-1402597116 tempest-VolumesNegativeTest-1402597116-project-member] Request method failure captured: Apr 11 19:31:50 user devstack@n-api.service[72089]: request: GET /compute/v2.1/servers/9466c3da-2c99-41ea-9fb4-41ffbaa9910a HTTP/1.1 Apr 11 19:31:50 user devstack@n-api.service[72089]: Accept: application/json Apr 11 19:31:50 user devstack@n-api.service[72089]: Accept-Encoding: identity Apr 11 19:31:50 user devstack@n-api.service[72089]: Connection: close Apr 11 19:31:50 user devstack@n-api.service[72089]: Content-Length: 0 Apr 11 19:31:50 user devstack@n-api.service[72089]: Content-Type: application/json Apr 11 19:31:50 user devstack@n-api.service[72089]: Host: 10.0.0.210 Apr 11 19:31:50 user devstack@n-api.service[72089]: Openstack-System-Scope: None Apr 11 19:31:50 user devstack@n-api.service[72089]: User-Agent: python-urllib3/1.26.15 Apr 11 19:31:50 user devstack@n-api.service[72089]: X-Auth-Token: gAAAAABkNbUDk-t4Kzd4OsXvAfND6OIk26ZiPNU4qkDzpSV4BYyFITmE2PQN9EsF6jF5qU8Dmjjukfb4nnpl_vcaAvN_SB1S-uDTIcNDH9qyzlgRLbt2wMD9b5WcNZdt8MNsplb1ZYItDn9iGj3C_dTWnaAigYUwTtIhxzr4OnIMgIfZRZNI1YY Apr 11 19:31:50 user devstack@n-api.service[72089]: X-Domain-Id: None Apr 11 19:31:50 user devstack@n-api.service[72089]: X-Domain-Name: None Apr 11 19:31:50 user devstack@n-api.service[72089]: X-Identity-Status: Confirmed Apr 11 19:31:50 user devstack@n-api.service[72089]: X-Is-Admin-Project: True Apr 11 19:31:50 user devstack@n-api.service[72089]: X-Project-Domain-Id: default Apr 11 19:31:50 user devstack@n-api.service[72089]: X-Project-Domain-Name: Default Apr 11 19:31:50 user devstack@n-api.service[72089]: X-Project-Id: e983656394754cf68837587d74f9fbb3 Apr 11 19:31:50 user devstack@n-api.service[72089]: X-Project-Name: tempest-VolumesNegativeTest-1402597116 Apr 11 19:31:50 user devstack@n-api.service[72089]: X-Role: reader,member Apr 11 19:31:50 user devstack@n-api.service[72089]: X-Roles: reader,member Apr 11 19:31:50 user devstack@n-api.service[72089]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e983656394754cf68837587d74f9fbb3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/e983656394754cf68837587d74f9fbb3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e983656394754cf68837587d74f9fbb3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 11 19:31:50 user devstack@n-api.service[72089]: X-Tenant: tempest-VolumesNegativeTest-1402597116 Apr 11 19:31:50 user devstack@n-api.service[72089]: X-Tenant-Id: e983656394754cf68837587d74f9fbb3 Apr 11 19:31:50 user devstack@n-api.service[72089]: X-Tenant-Name: tempest-VolumesNegativeTest-1402597116 Apr 11 19:31:50 user devstack@n-api.service[72089]: X-User: tempest-VolumesNegativeTest-1402597116-project-member Apr 11 19:31:50 user devstack@n-api.service[72089]: X-User-Domain-Id: default Apr 11 19:31:50 user devstack@n-api.service[72089]: X-User-Domain-Name: Default Apr 11 19:31:50 user devstack@n-api.service[72089]: X-User-Id: 996881d74ec246f0ac53411a8ca0e7c4 Apr 11 19:31:50 user devstack@n-api.service[72089]: X-User-Name: tempest-VolumesNegativeTest-1402597116-project-member Apr 11 19:31:50 user devstack@n-api.service[72089]: method: > Apr 11 19:31:50 user devstack@n-api.service[72089]: exception: Instance 9466c3da-2c99-41ea-9fb4-41ffbaa9910a could not be found. Apr 11 19:31:50 user devstack@n-api.service[72089]: action_args: {'id': '9466c3da-2c99-41ea-9fb4-41ffbaa9910a'} Apr 11 19:31:50 user devstack@n-api.service[72089]: {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 19:31:50 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:31:50 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 19:31:50 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 19:31:50 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 19:31:50 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 19:31:50 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 19:31:50 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 19:31:50 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 19:31:50 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 19:31:50 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9466c3da-2c99-41ea-9fb4-41ffbaa9910a could not be found. Apr 11 19:31:50 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi Apr 11 19:31:50 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 19:31:50 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi Apr 11 19:31:50 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:31:50 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 19:31:50 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 19:31:50 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 19:31:50 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 19:31:50 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 19:31:50 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 19:31:50 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 19:31:50 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 19:31:50 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 19:31:50 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 19:31:50 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 19:31:50 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 19:31:50 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9466c3da-2c99-41ea-9fb4-41ffbaa9910a could not be found. Apr 11 19:31:50 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi Apr 11 19:31:50 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 19:31:50 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi Apr 11 19:31:50 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:31:50 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 19:31:50 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 19:31:50 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 19:31:50 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 19:31:50 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9466c3da-2c99-41ea-9fb4-41ffbaa9910a could not be found. Apr 11 19:31:50 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi Apr 11 19:31:50 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [None req-10fd7bb7-32a8-4e86-9df8-ab90ff5b0216 tempest-VolumesNegativeTest-1402597116 tempest-VolumesNegativeTest-1402597116-project-member] Returning 404 to user: Instance 9466c3da-2c99-41ea-9fb4-41ffbaa9910a could not be found. {{(pid=72089) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 19:31:50 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [None req-10fd7bb7-32a8-4e86-9df8-ab90ff5b0216 tempest-VolumesNegativeTest-1402597116 tempest-VolumesNegativeTest-1402597116-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9466c3da-2c99-41ea-9fb4-41ffbaa9910a" status: 404 len: 111 microversion: 2.1 time: 0.044802 Apr 11 19:31:50 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 188/548] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 19:31:50 2023] GET /compute/v2.1/servers/9466c3da-2c99-41ea-9fb4-41ffbaa9910a => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 19:31:58 user devstack@n-api.service[72090]: DEBUG dbcounter [-] [72090] Writing DB stats nova_api:SELECT=4 {{(pid=72090) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:31:58 user devstack@n-api.service[72090]: DEBUG dbcounter [-] [72090] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=72090) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:31:58 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [None req-5f96aa3d-eb32-46ed-927f-40280025cbff tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Calling method '>' {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:31:58 user devstack@n-api.service[72090]: DEBUG nova.compute.api [None req-5f96aa3d-eb32-46ed-927f-40280025cbff tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] [instance: 558100b9-f3ac-47c7-9260-b897b0cae55f] Fetching instance by UUID {{(pid=72090) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:31:58 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-5f96aa3d-eb32-46ed-927f-40280025cbff tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:31:58 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-5f96aa3d-eb32-46ed-927f-40280025cbff tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:31:58 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-5f96aa3d-eb32-46ed-927f-40280025cbff tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:31:58 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-5f96aa3d-eb32-46ed-927f-40280025cbff tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:31:58 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-5f96aa3d-eb32-46ed-927f-40280025cbff tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:31:58 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-5f96aa3d-eb32-46ed-927f-40280025cbff tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:31:58 user devstack@n-api.service[72090]: INFO nova.api.openstack.wsgi [None req-5f96aa3d-eb32-46ed-927f-40280025cbff tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] HTTP exception thrown: Instance 558100b9-f3ac-47c7-9260-b897b0cae55f could not be found. Apr 11 19:31:58 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [None req-5f96aa3d-eb32-46ed-927f-40280025cbff tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Request method failure captured: Apr 11 19:31:58 user devstack@n-api.service[72090]: request: GET /compute/v2.1/servers/558100b9-f3ac-47c7-9260-b897b0cae55f HTTP/1.1 Apr 11 19:31:58 user devstack@n-api.service[72090]: Accept: application/json Apr 11 19:31:58 user devstack@n-api.service[72090]: Accept-Encoding: identity Apr 11 19:31:58 user devstack@n-api.service[72090]: Connection: close Apr 11 19:31:58 user devstack@n-api.service[72090]: Content-Length: 0 Apr 11 19:31:58 user devstack@n-api.service[72090]: Content-Type: application/json Apr 11 19:31:58 user devstack@n-api.service[72090]: Host: 10.0.0.210 Apr 11 19:31:58 user devstack@n-api.service[72090]: Openstack-System-Scope: None Apr 11 19:31:58 user devstack@n-api.service[72090]: User-Agent: python-urllib3/1.26.15 Apr 11 19:31:58 user devstack@n-api.service[72090]: X-Auth-Token: gAAAAABkNbM9PPhjuxFro365bgGlzXmEeNXBFjH7B9DXRG846ZOMZNO8rjcHBUXZkmUpO9G06QygHvaEJVpRlrFcJIyDYtH16p4qIRFo8lVfjRkqkJh8soUAdF5jsPsH_hjCF2czbYEFIUpkQBo9PM7kG8byL_cnEa6VpD9RmxIaxcGcdobg_-U Apr 11 19:31:58 user devstack@n-api.service[72090]: X-Domain-Id: None Apr 11 19:31:58 user devstack@n-api.service[72090]: X-Domain-Name: None Apr 11 19:31:58 user devstack@n-api.service[72090]: X-Identity-Status: Confirmed Apr 11 19:31:58 user devstack@n-api.service[72090]: X-Is-Admin-Project: True Apr 11 19:31:58 user devstack@n-api.service[72090]: X-Project-Domain-Id: default Apr 11 19:31:58 user devstack@n-api.service[72090]: X-Project-Domain-Name: Default Apr 11 19:31:58 user devstack@n-api.service[72090]: X-Project-Id: 06966e2f4d3a4dec92282c7ad348635d Apr 11 19:31:58 user devstack@n-api.service[72090]: X-Project-Name: tempest-AttachVolumeNegativeTest-303418642 Apr 11 19:31:58 user devstack@n-api.service[72090]: X-Role: reader,member Apr 11 19:31:58 user devstack@n-api.service[72090]: X-Roles: reader,member Apr 11 19:31:58 user devstack@n-api.service[72090]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/06966e2f4d3a4dec92282c7ad348635d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/06966e2f4d3a4dec92282c7ad348635d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/06966e2f4d3a4dec92282c7ad348635d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 11 19:31:58 user devstack@n-api.service[72090]: X-Tenant: tempest-AttachVolumeNegativeTest-303418642 Apr 11 19:31:58 user devstack@n-api.service[72090]: X-Tenant-Id: 06966e2f4d3a4dec92282c7ad348635d Apr 11 19:31:58 user devstack@n-api.service[72090]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-303418642 Apr 11 19:31:58 user devstack@n-api.service[72090]: X-User: tempest-AttachVolumeNegativeTest-303418642-project-member Apr 11 19:31:58 user devstack@n-api.service[72090]: X-User-Domain-Id: default Apr 11 19:31:58 user devstack@n-api.service[72090]: X-User-Domain-Name: Default Apr 11 19:31:58 user devstack@n-api.service[72090]: X-User-Id: d5d405421ceb4d99967ef2e7f55e7809 Apr 11 19:31:58 user devstack@n-api.service[72090]: X-User-Name: tempest-AttachVolumeNegativeTest-303418642-project-member Apr 11 19:31:58 user devstack@n-api.service[72090]: method: > Apr 11 19:31:58 user devstack@n-api.service[72090]: exception: Instance 558100b9-f3ac-47c7-9260-b897b0cae55f could not be found. Apr 11 19:31:58 user devstack@n-api.service[72090]: action_args: {'id': '558100b9-f3ac-47c7-9260-b897b0cae55f'} Apr 11 19:31:58 user devstack@n-api.service[72090]: {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 19:31:58 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:31:58 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 19:31:58 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 19:31:58 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 19:31:58 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 19:31:58 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 19:31:58 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 19:31:58 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 19:31:58 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 19:31:58 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 558100b9-f3ac-47c7-9260-b897b0cae55f could not be found. Apr 11 19:31:58 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi Apr 11 19:31:58 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 19:31:58 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi Apr 11 19:31:58 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:31:58 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 19:31:58 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 19:31:58 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 19:31:58 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 19:31:58 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 19:31:58 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 19:31:58 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 19:31:58 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 19:31:58 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 19:31:58 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 19:31:58 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 19:31:58 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 19:31:58 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 558100b9-f3ac-47c7-9260-b897b0cae55f could not be found. Apr 11 19:31:58 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi Apr 11 19:31:58 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 19:31:58 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi Apr 11 19:31:58 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:31:58 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 19:31:58 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 19:31:58 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 19:31:58 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 19:31:58 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 558100b9-f3ac-47c7-9260-b897b0cae55f could not be found. Apr 11 19:31:58 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi Apr 11 19:31:58 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [None req-5f96aa3d-eb32-46ed-927f-40280025cbff tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Returning 404 to user: Instance 558100b9-f3ac-47c7-9260-b897b0cae55f could not be found. {{(pid=72090) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 19:31:58 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [None req-5f96aa3d-eb32-46ed-927f-40280025cbff tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] 10.0.0.210 "GET /compute/v2.1/servers/558100b9-f3ac-47c7-9260-b897b0cae55f" status: 404 len: 111 microversion: 2.1 time: 0.039290 Apr 11 19:31:58 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 182/549] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 19:31:58 2023] GET /compute/v2.1/servers/558100b9-f3ac-47c7-9260-b897b0cae55f => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 19:31:58 user devstack@n-api.service[72088]: DEBUG dbcounter [-] [72088] Writing DB stats nova_api:SELECT=4 {{(pid=72088) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:31:58 user devstack@n-api.service[72088]: DEBUG dbcounter [-] [72088] Writing DB stats nova_cell1:SELECT=8 {{(pid=72088) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:31:58 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [None req-51b71c0d-aafe-41d4-8a9a-64f1fb8d0b79 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Calling method '.version_select at 0x7f119da36b00>' {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:31:58 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [None req-51b71c0d-aafe-41d4-8a9a-64f1fb8d0b79 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1056959304" status: 202 len: 0 microversion: 2.1 time: 0.042899 Apr 11 19:31:58 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 180/550] 10.0.0.210 () {62 vars in 1298 bytes} [Tue Apr 11 19:31:58 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1056959304 => generated 0 bytes in 45 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 19:31:59 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [None req-7ad07970-ee2b-4140-9501-a120faf2c539 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Action: 'create', calling method: .version_select at 0x7f119da87250>, body: {"keypair": {"name": "tempest-keypair-2085079067", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKHn6VY0TWifqU3p1evbu+EX6BdhcRbf171BBoRu2Zek2ZxhXI3fsfWd4X4kA8GA+fpWd9lKaJGwEU1M4JEXSRotTTW+C0bM2tFJUQlcVplgUGzjC/IH04gthMYmR1rcXA=="}} {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:31:59 user devstack@n-api.service[72089]: DEBUG nova.quota [None req-7ad07970-ee2b-4140-9501-a120faf2c539 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Getting quotas for project 06966e2f4d3a4dec92282c7ad348635d. Resources: {'key_pairs'} {{(pid=72089) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 19:31:59 user devstack@n-api.service[72089]: DEBUG nova.quota [None req-7ad07970-ee2b-4140-9501-a120faf2c539 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Getting quotas for user d5d405421ceb4d99967ef2e7f55e7809 and project 06966e2f4d3a4dec92282c7ad348635d. Resources: {'key_pairs'} {{(pid=72089) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 19:31:59 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [None req-7ad07970-ee2b-4140-9501-a120faf2c539 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.074536 Apr 11 19:31:59 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 189/551] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Apr 11 19:31:59 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 11 19:32:00 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [None req-e1699e73-3d26-43b0-be90-603ea9245ff0 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2097763810", "imageRef": "4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "fb39619b-a298-4b28-9280-3fc309c5a229"}], "security_groups": [{"name": "tempest-securitygroup--593868568"}], "key_name": "tempest-keypair-2085079067", "user_data": "}} {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:32:01 user devstack@n-api.service[72090]: DEBUG nova.network.neutron [None req-e1699e73-3d26-43b0-be90-603ea9245ff0 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] validate_networks() for [('fb39619b-a298-4b28-9280-3fc309c5a229', None, None, None, None, None)] {{(pid=72090) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 11 19:32:01 user devstack@n-api.service[72090]: DEBUG nova.virt.hardware [None req-e1699e73-3d26-43b0-be90-603ea9245ff0 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Flavor limits 0:0:0 {{(pid=72090) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 19:32:01 user devstack@n-api.service[72090]: DEBUG nova.virt.hardware [None req-e1699e73-3d26-43b0-be90-603ea9245ff0 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Image limits 0:0:0 {{(pid=72090) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 19:32:01 user devstack@n-api.service[72090]: DEBUG nova.virt.hardware [None req-e1699e73-3d26-43b0-be90-603ea9245ff0 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Flavor pref 0:0:0 {{(pid=72090) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 19:32:01 user devstack@n-api.service[72090]: DEBUG nova.virt.hardware [None req-e1699e73-3d26-43b0-be90-603ea9245ff0 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Image pref 0:0:0 {{(pid=72090) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 19:32:01 user devstack@n-api.service[72090]: DEBUG nova.virt.hardware [None req-e1699e73-3d26-43b0-be90-603ea9245ff0 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72090) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 19:32:01 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-e1699e73-3d26-43b0-be90-603ea9245ff0 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:32:01 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-e1699e73-3d26-43b0-be90-603ea9245ff0 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:32:01 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-e1699e73-3d26-43b0-be90-603ea9245ff0 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:32:01 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-e1699e73-3d26-43b0-be90-603ea9245ff0 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:32:01 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-e1699e73-3d26-43b0-be90-603ea9245ff0 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:32:01 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-e1699e73-3d26-43b0-be90-603ea9245ff0 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:32:01 user devstack@n-api.service[72090]: DEBUG nova.quota [None req-e1699e73-3d26-43b0-be90-603ea9245ff0 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Getting quotas for project 06966e2f4d3a4dec92282c7ad348635d. Resources: {'ram', 'instances', 'cores'} {{(pid=72090) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 19:32:01 user devstack@n-api.service[72090]: DEBUG nova.quota [None req-e1699e73-3d26-43b0-be90-603ea9245ff0 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Getting quotas for user d5d405421ceb4d99967ef2e7f55e7809 and project 06966e2f4d3a4dec92282c7ad348635d. Resources: {'ram', 'instances', 'cores'} {{(pid=72090) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 19:32:01 user devstack@n-api.service[72090]: DEBUG nova.compute.api [None req-e1699e73-3d26-43b0-be90-603ea9245ff0 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Going to run 1 instances... {{(pid=72090) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 11 19:32:01 user devstack@n-api.service[72090]: DEBUG nova.compute.api [None req-e1699e73-3d26-43b0-be90-603ea9245ff0 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] [instance: e6e3640a-c262-4e2d-a994-2e4312f22871] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=72090) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 11 19:32:01 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [None req-e1699e73-3d26-43b0-be90-603ea9245ff0 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 399 microversion: 2.1 time: 1.066522 Apr 11 19:32:01 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 183/552] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 11 19:32:00 2023] POST /compute/v2.1/servers => generated 399 bytes in 1068 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 11 19:32:02 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [None req-d46175b2-ec44-448b-b2c1-966bc23941a6 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Calling method '>' {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:32:02 user devstack@n-api.service[72088]: DEBUG nova.compute.api [None req-d46175b2-ec44-448b-b2c1-966bc23941a6 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] [instance: e6e3640a-c262-4e2d-a994-2e4312f22871] Fetching instance by UUID {{(pid=72088) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:32:02 user devstack@n-api.service[72088]: DEBUG nova.policy [None req-d46175b2-ec44-448b-b2c1-966bc23941a6 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5d405421ceb4d99967ef2e7f55e7809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06966e2f4d3a4dec92282c7ad348635d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72088) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:32:02 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [None req-d46175b2-ec44-448b-b2c1-966bc23941a6 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e6e3640a-c262-4e2d-a994-2e4312f22871" status: 200 len: 1236 microversion: 2.1 time: 0.080457 Apr 11 19:32:02 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 181/553] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 19:32:01 2023] GET /compute/v2.1/servers/e6e3640a-c262-4e2d-a994-2e4312f22871 => generated 1236 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:32:05 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [None req-442231f5-3c74-4b96-9f75-343062f0b2f0 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1542491412", "imageRef": "4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b", "flavorRef": "42", "networks": [{"uuid": "18af527e-3475-4ab6-a415-0076cb1766db"}]}} {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:32:05 user devstack@n-api.service[72089]: DEBUG dbcounter [-] [72089] Writing DB stats nova_cell1:SELECT=10 {{(pid=72089) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:32:05 user devstack@n-api.service[72089]: DEBUG dbcounter [-] [72089] Writing DB stats nova_api:SELECT=18,nova_api:INSERT=1 {{(pid=72089) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:32:05 user devstack@n-api.service[72089]: DEBUG nova.network.neutron [None req-442231f5-3c74-4b96-9f75-343062f0b2f0 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] validate_networks() for [('18af527e-3475-4ab6-a415-0076cb1766db', None, None, None, None, None)] {{(pid=72089) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 11 19:32:05 user devstack@n-api.service[72089]: DEBUG nova.virt.hardware [None req-442231f5-3c74-4b96-9f75-343062f0b2f0 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Flavor limits 0:0:0 {{(pid=72089) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 19:32:05 user devstack@n-api.service[72089]: DEBUG nova.virt.hardware [None req-442231f5-3c74-4b96-9f75-343062f0b2f0 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Image limits 0:0:0 {{(pid=72089) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 19:32:05 user devstack@n-api.service[72089]: DEBUG nova.virt.hardware [None req-442231f5-3c74-4b96-9f75-343062f0b2f0 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Flavor pref 0:0:0 {{(pid=72089) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 19:32:05 user devstack@n-api.service[72089]: DEBUG nova.virt.hardware [None req-442231f5-3c74-4b96-9f75-343062f0b2f0 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Image pref 0:0:0 {{(pid=72089) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 19:32:05 user devstack@n-api.service[72089]: DEBUG nova.virt.hardware [None req-442231f5-3c74-4b96-9f75-343062f0b2f0 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72089) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 19:32:05 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-442231f5-3c74-4b96-9f75-343062f0b2f0 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:32:05 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-442231f5-3c74-4b96-9f75-343062f0b2f0 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:32:05 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-442231f5-3c74-4b96-9f75-343062f0b2f0 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:32:05 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-442231f5-3c74-4b96-9f75-343062f0b2f0 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:32:05 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-442231f5-3c74-4b96-9f75-343062f0b2f0 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:32:05 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-442231f5-3c74-4b96-9f75-343062f0b2f0 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:32:05 user devstack@n-api.service[72089]: DEBUG nova.quota [None req-442231f5-3c74-4b96-9f75-343062f0b2f0 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Getting quotas for project 6d5246cf04a7401388cba38d16e298ae. Resources: {'ram', 'instances', 'cores'} {{(pid=72089) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 19:32:05 user devstack@n-api.service[72089]: DEBUG nova.quota [None req-442231f5-3c74-4b96-9f75-343062f0b2f0 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Getting quotas for user 20f337feb0ed4653976ace530bfdd877 and project 6d5246cf04a7401388cba38d16e298ae. Resources: {'ram', 'instances', 'cores'} {{(pid=72089) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 19:32:05 user devstack@n-api.service[72089]: DEBUG nova.compute.api [None req-442231f5-3c74-4b96-9f75-343062f0b2f0 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Going to run 1 instances... {{(pid=72089) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 11 19:32:05 user devstack@n-api.service[72089]: DEBUG nova.compute.api [None req-442231f5-3c74-4b96-9f75-343062f0b2f0 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] [instance: 03bb985c-4903-4d0e-98a1-43a9352f4ec6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=72089) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 11 19:32:05 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [None req-442231f5-3c74-4b96-9f75-343062f0b2f0 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.555917 Apr 11 19:32:05 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 190/554] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 11 19:32:05 2023] POST /compute/v2.1/servers => generated 378 bytes in 557 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 11 19:32:05 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [None req-d899da32-5132-4b38-aaf6-af26167d69ac tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Calling method '>' {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:32:05 user devstack@n-api.service[72090]: DEBUG nova.compute.api [None req-d899da32-5132-4b38-aaf6-af26167d69ac tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] [instance: 03bb985c-4903-4d0e-98a1-43a9352f4ec6] Fetching instance by UUID {{(pid=72090) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:32:05 user devstack@n-api.service[72090]: DEBUG nova.policy [None req-d899da32-5132-4b38-aaf6-af26167d69ac tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20f337feb0ed4653976ace530bfdd877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d5246cf04a7401388cba38d16e298ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72090) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:32:05 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [None req-d899da32-5132-4b38-aaf6-af26167d69ac tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] 10.0.0.210 "GET /compute/v2.1/servers/03bb985c-4903-4d0e-98a1-43a9352f4ec6" status: 200 len: 1213 microversion: 2.1 time: 0.071055 Apr 11 19:32:05 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 184/555] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 19:32:05 2023] GET /compute/v2.1/servers/03bb985c-4903-4d0e-98a1-43a9352f4ec6 => generated 1213 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:32:07 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [req-e0b9a0c4-4e09-41e8-b5c0-03d3091a7334 req-ad0e76e0-7585-4ccd-a740-5822f5aaf898 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e6e3640a-c262-4e2d-a994-2e4312f22871", "tag": "183a0478-c117-4fe1-acce-22e4aee440c9"}]} {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:32:07 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-e0b9a0c4-4e09-41e8-b5c0-03d3091a7334 req-ad0e76e0-7585-4ccd-a740-5822f5aaf898 service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:32:07 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-e0b9a0c4-4e09-41e8-b5c0-03d3091a7334 req-ad0e76e0-7585-4ccd-a740-5822f5aaf898 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:32:07 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-e0b9a0c4-4e09-41e8-b5c0-03d3091a7334 req-ad0e76e0-7585-4ccd-a740-5822f5aaf898 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:32:07 user devstack@n-api.service[72088]: INFO nova.api.openstack.compute.server_external_events [req-e0b9a0c4-4e09-41e8-b5c0-03d3091a7334 req-ad0e76e0-7585-4ccd-a740-5822f5aaf898 service nova] Creating event network-changed:183a0478-c117-4fe1-acce-22e4aee440c9 for instance e6e3640a-c262-4e2d-a994-2e4312f22871 on user Apr 11 19:32:07 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [req-e0b9a0c4-4e09-41e8-b5c0-03d3091a7334 req-ad0e76e0-7585-4ccd-a740-5822f5aaf898 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.122610 Apr 11 19:32:07 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 182/556] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:32:07 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:32:08 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [req-7d047375-5403-46a7-bc47-e28e3479707f req-31421fa2-6ff2-4f21-9d39-ddd23eb89ccd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "03bb985c-4903-4d0e-98a1-43a9352f4ec6", "tag": "2da07e24-d185-4553-ab56-819067f03d48"}]} {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:32:08 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-7d047375-5403-46a7-bc47-e28e3479707f req-31421fa2-6ff2-4f21-9d39-ddd23eb89ccd service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:32:08 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-7d047375-5403-46a7-bc47-e28e3479707f req-31421fa2-6ff2-4f21-9d39-ddd23eb89ccd service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:32:08 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-7d047375-5403-46a7-bc47-e28e3479707f req-31421fa2-6ff2-4f21-9d39-ddd23eb89ccd service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:32:08 user devstack@n-api.service[72089]: INFO nova.api.openstack.compute.server_external_events [req-7d047375-5403-46a7-bc47-e28e3479707f req-31421fa2-6ff2-4f21-9d39-ddd23eb89ccd service nova] Creating event network-changed:2da07e24-d185-4553-ab56-819067f03d48 for instance 03bb985c-4903-4d0e-98a1-43a9352f4ec6 on user Apr 11 19:32:08 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [req-7d047375-5403-46a7-bc47-e28e3479707f req-31421fa2-6ff2-4f21-9d39-ddd23eb89ccd service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028345 Apr 11 19:32:08 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 191/557] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:32:08 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:32:08 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [None req-4b6e035f-ec6e-416c-849d-8abc3d3b8e24 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1884458262", "imageRef": "", "flavorRef": "42", "block_device_mapping_v2": [{"uuid": "fadf1a5b-e35a-4680-a9c6-8aff9616539d", "source_type": "snapshot", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "f22e45e9-cc15-401e-aed7-3506278d3d0d"}]}} {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:32:08 user devstack@n-api.service[72090]: DEBUG nova.network.neutron [None req-4b6e035f-ec6e-416c-849d-8abc3d3b8e24 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] validate_networks() for [('f22e45e9-cc15-401e-aed7-3506278d3d0d', None, None, None, None, None)] {{(pid=72090) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 11 19:32:08 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [None req-88ca11ef-79cc-497e-8068-5181fc5df695 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:32:08 user devstack@n-api.service[72088]: DEBUG nova.compute.api [None req-88ca11ef-79cc-497e-8068-5181fc5df695 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] [instance: 864fcd9b-8e5b-4de8-a2e6-292a8907a834] Fetching instance by UUID {{(pid=72088) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:32:08 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-88ca11ef-79cc-497e-8068-5181fc5df695 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:32:08 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-88ca11ef-79cc-497e-8068-5181fc5df695 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:32:08 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-88ca11ef-79cc-497e-8068-5181fc5df695 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:32:08 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-88ca11ef-79cc-497e-8068-5181fc5df695 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:32:08 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-88ca11ef-79cc-497e-8068-5181fc5df695 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:32:08 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-88ca11ef-79cc-497e-8068-5181fc5df695 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:32:08 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [None req-88ca11ef-79cc-497e-8068-5181fc5df695 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] 10.0.0.210 "POST /compute/v2.1/servers/864fcd9b-8e5b-4de8-a2e6-292a8907a834/action" status: 202 len: 0 microversion: 2.87 time: 0.081695 Apr 11 19:32:08 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 183/558] 10.0.0.210 () {66 vars in 1396 bytes} [Tue Apr 11 19:32:08 2023] POST /compute/v2.1/servers/864fcd9b-8e5b-4de8-a2e6-292a8907a834/action => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 11 19:32:08 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [None req-37733cfe-10bc-4078-89d7-7569850a4235 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Calling method '>' {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:32:08 user devstack@n-api.service[72089]: DEBUG nova.compute.api [None req-37733cfe-10bc-4078-89d7-7569850a4235 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] [instance: 864fcd9b-8e5b-4de8-a2e6-292a8907a834] Fetching instance by UUID {{(pid=72089) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:32:08 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-37733cfe-10bc-4078-89d7-7569850a4235 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:32:08 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-37733cfe-10bc-4078-89d7-7569850a4235 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:32:08 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-37733cfe-10bc-4078-89d7-7569850a4235 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:32:08 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-37733cfe-10bc-4078-89d7-7569850a4235 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:32:08 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-37733cfe-10bc-4078-89d7-7569850a4235 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:32:08 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-37733cfe-10bc-4078-89d7-7569850a4235 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:32:09 user devstack@n-api.service[72089]: DEBUG nova.policy [None req-37733cfe-10bc-4078-89d7-7569850a4235 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b3adca432b04d70818a51d1366f5c6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb91586feb3f4a4c84fa8c2183baaf8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72089) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:32:09 user devstack@n-api.service[72090]: DEBUG nova.virt.hardware [None req-4b6e035f-ec6e-416c-849d-8abc3d3b8e24 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Flavor limits 0:0:0 {{(pid=72090) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 19:32:09 user devstack@n-api.service[72090]: DEBUG nova.virt.hardware [None req-4b6e035f-ec6e-416c-849d-8abc3d3b8e24 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Image limits 0:0:0 {{(pid=72090) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 19:32:09 user devstack@n-api.service[72090]: DEBUG nova.virt.hardware [None req-4b6e035f-ec6e-416c-849d-8abc3d3b8e24 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Flavor pref 0:0:0 {{(pid=72090) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 19:32:09 user devstack@n-api.service[72090]: DEBUG nova.virt.hardware [None req-4b6e035f-ec6e-416c-849d-8abc3d3b8e24 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Image pref 0:0:0 {{(pid=72090) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 19:32:09 user devstack@n-api.service[72090]: DEBUG nova.virt.hardware [None req-4b6e035f-ec6e-416c-849d-8abc3d3b8e24 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72090) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 19:32:09 user devstack@n-api.service[72089]: DEBUG nova.policy [None req-37733cfe-10bc-4078-89d7-7569850a4235 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b3adca432b04d70818a51d1366f5c6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb91586feb3f4a4c84fa8c2183baaf8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72089) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:32:09 user devstack@n-api.service[72089]: DEBUG nova.policy [None req-37733cfe-10bc-4078-89d7-7569850a4235 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b3adca432b04d70818a51d1366f5c6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb91586feb3f4a4c84fa8c2183baaf8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72089) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:32:09 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-4b6e035f-ec6e-416c-849d-8abc3d3b8e24 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:32:09 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-4b6e035f-ec6e-416c-849d-8abc3d3b8e24 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:32:09 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-4b6e035f-ec6e-416c-849d-8abc3d3b8e24 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:32:09 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-4b6e035f-ec6e-416c-849d-8abc3d3b8e24 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:32:09 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [None req-37733cfe-10bc-4078-89d7-7569850a4235 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] 10.0.0.210 "GET /compute/v2.1/servers/864fcd9b-8e5b-4de8-a2e6-292a8907a834" status: 200 len: 1763 microversion: 2.87 time: 0.356586 Apr 11 19:32:09 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-4b6e035f-ec6e-416c-849d-8abc3d3b8e24 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:32:09 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 192/559] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 19:32:08 2023] GET /compute/v2.1/servers/864fcd9b-8e5b-4de8-a2e6-292a8907a834 => generated 1763 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 19:32:09 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-4b6e035f-ec6e-416c-849d-8abc3d3b8e24 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:32:09 user devstack@n-api.service[72090]: DEBUG nova.quota [None req-4b6e035f-ec6e-416c-849d-8abc3d3b8e24 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Getting quotas for project 2caba0618fc743e7bfb2dd866a511df9. Resources: {'ram', 'instances', 'cores'} {{(pid=72090) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 19:32:09 user devstack@n-api.service[72090]: DEBUG nova.quota [None req-4b6e035f-ec6e-416c-849d-8abc3d3b8e24 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Getting quotas for user cf262cd03f4a41c4956d8784cf37d86d and project 2caba0618fc743e7bfb2dd866a511df9. Resources: {'ram', 'instances', 'cores'} {{(pid=72090) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 19:32:09 user devstack@n-api.service[72090]: DEBUG nova.compute.api [None req-4b6e035f-ec6e-416c-849d-8abc3d3b8e24 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Going to run 1 instances... {{(pid=72090) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 11 19:32:09 user devstack@n-api.service[72090]: DEBUG nova.compute.api [None req-4b6e035f-ec6e-416c-849d-8abc3d3b8e24 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] [instance: cbd5aa3c-f6c9-49e2-8ee7-dcf389c9ed08] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='fadf1a5b-e35a-4680-a9c6-8aff9616539d',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=72090) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 11 19:32:09 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [None req-4b6e035f-ec6e-416c-849d-8abc3d3b8e24 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.939031 Apr 11 19:32:09 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 185/560] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 11 19:32:08 2023] POST /compute/v2.1/servers => generated 378 bytes in 941 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 11 19:32:09 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [None req-4981d5ed-5d54-43ab-b945-f405b0bdc4b5 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Calling method '>' {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:32:09 user devstack@n-api.service[72088]: DEBUG nova.compute.api [None req-4981d5ed-5d54-43ab-b945-f405b0bdc4b5 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] [instance: cbd5aa3c-f6c9-49e2-8ee7-dcf389c9ed08] Fetching instance by UUID {{(pid=72088) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:32:09 user devstack@n-api.service[72088]: DEBUG nova.policy [None req-4981d5ed-5d54-43ab-b945-f405b0bdc4b5 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf262cd03f4a41c4956d8784cf37d86d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caba0618fc743e7bfb2dd866a511df9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72088) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:32:09 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [None req-4981d5ed-5d54-43ab-b945-f405b0bdc4b5 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cbd5aa3c-f6c9-49e2-8ee7-dcf389c9ed08" status: 200 len: 1052 microversion: 2.1 time: 0.084729 Apr 11 19:32:09 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 184/561] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 19:32:09 2023] GET /compute/v2.1/servers/cbd5aa3c-f6c9-49e2-8ee7-dcf389c9ed08 => generated 1052 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:32:09 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [req-3760b323-acd0-4e10-b29d-3fd84b907cbb req-c91e5535-5392-446b-b0f0-5ff54ffea01b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e6e3640a-c262-4e2d-a994-2e4312f22871", "name": "network-vif-plugged", "status": "completed", "tag": "183a0478-c117-4fe1-acce-22e4aee440c9"}]} {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:32:09 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-3760b323-acd0-4e10-b29d-3fd84b907cbb req-c91e5535-5392-446b-b0f0-5ff54ffea01b service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:32:09 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-3760b323-acd0-4e10-b29d-3fd84b907cbb req-c91e5535-5392-446b-b0f0-5ff54ffea01b service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:32:09 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-3760b323-acd0-4e10-b29d-3fd84b907cbb req-c91e5535-5392-446b-b0f0-5ff54ffea01b service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:32:10 user devstack@n-api.service[72089]: INFO nova.api.openstack.compute.server_external_events [req-3760b323-acd0-4e10-b29d-3fd84b907cbb req-c91e5535-5392-446b-b0f0-5ff54ffea01b service nova] Creating event network-vif-plugged:183a0478-c117-4fe1-acce-22e4aee440c9 for instance e6e3640a-c262-4e2d-a994-2e4312f22871 on user Apr 11 19:32:10 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [req-3760b323-acd0-4e10-b29d-3fd84b907cbb req-c91e5535-5392-446b-b0f0-5ff54ffea01b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118042 Apr 11 19:32:10 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 193/562] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:32:09 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:32:11 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [None req-b952851a-03f9-48a4-b489-532be7f5004c tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Calling method '>' {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:32:11 user devstack@n-api.service[72090]: DEBUG nova.compute.api [None req-b952851a-03f9-48a4-b489-532be7f5004c tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] [instance: 720c683f-c03a-444c-92a8-daf97c9f524b] Fetching instance by UUID {{(pid=72090) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:32:11 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-b952851a-03f9-48a4-b489-532be7f5004c tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:32:11 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-b952851a-03f9-48a4-b489-532be7f5004c tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:32:11 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-b952851a-03f9-48a4-b489-532be7f5004c tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:32:11 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-b952851a-03f9-48a4-b489-532be7f5004c tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:32:11 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-b952851a-03f9-48a4-b489-532be7f5004c tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:32:11 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-b952851a-03f9-48a4-b489-532be7f5004c tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:32:11 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [None req-b952851a-03f9-48a4-b489-532be7f5004c tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] 10.0.0.210 "GET /compute/v2.1/servers/720c683f-c03a-444c-92a8-daf97c9f524b/os-volume_attachments/b5f0471b-94d7-446d-9313-3c94d2e9355d" status: 200 len: 194 microversion: 2.20 time: 0.150229 Apr 11 19:32:11 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 186/563] 10.0.0.210 () {64 vars in 1531 bytes} [Tue Apr 11 19:32:11 2023] GET /compute/v2.1/servers/720c683f-c03a-444c-92a8-daf97c9f524b/os-volume_attachments/b5f0471b-94d7-446d-9313-3c94d2e9355d => generated 194 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:32:11 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [req-31bc1fef-1a28-41e1-a003-41dbfd385adf req-7237d81a-6bdd-4616-86c9-d752799c0d3a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03bb985c-4903-4d0e-98a1-43a9352f4ec6", "name": "network-vif-plugged", "status": "completed", "tag": "2da07e24-d185-4553-ab56-819067f03d48"}]} {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:32:11 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [None req-042b9b97-06c8-402a-b5d0-ea0424c73ef0 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Calling method '>' {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:32:11 user devstack@n-api.service[72089]: DEBUG nova.compute.api [None req-042b9b97-06c8-402a-b5d0-ea0424c73ef0 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] [instance: 720c683f-c03a-444c-92a8-daf97c9f524b] Fetching instance by UUID {{(pid=72089) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:32:11 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-042b9b97-06c8-402a-b5d0-ea0424c73ef0 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:32:11 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-042b9b97-06c8-402a-b5d0-ea0424c73ef0 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:32:11 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-042b9b97-06c8-402a-b5d0-ea0424c73ef0 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:32:11 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-042b9b97-06c8-402a-b5d0-ea0424c73ef0 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:32:11 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-042b9b97-06c8-402a-b5d0-ea0424c73ef0 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:32:11 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-042b9b97-06c8-402a-b5d0-ea0424c73ef0 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:32:11 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-31bc1fef-1a28-41e1-a003-41dbfd385adf req-7237d81a-6bdd-4616-86c9-d752799c0d3a service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:32:11 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-31bc1fef-1a28-41e1-a003-41dbfd385adf req-7237d81a-6bdd-4616-86c9-d752799c0d3a service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:32:11 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-31bc1fef-1a28-41e1-a003-41dbfd385adf req-7237d81a-6bdd-4616-86c9-d752799c0d3a service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:32:11 user devstack@n-api.service[72088]: INFO nova.api.openstack.compute.server_external_events [req-31bc1fef-1a28-41e1-a003-41dbfd385adf req-7237d81a-6bdd-4616-86c9-d752799c0d3a service nova] Creating event network-vif-plugged:2da07e24-d185-4553-ab56-819067f03d48 for instance 03bb985c-4903-4d0e-98a1-43a9352f4ec6 on user Apr 11 19:32:11 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [req-31bc1fef-1a28-41e1-a003-41dbfd385adf req-7237d81a-6bdd-4616-86c9-d752799c0d3a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031959 Apr 11 19:32:11 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 185/564] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:32:11 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:32:11 user devstack@n-api.service[72089]: DEBUG nova.objects.instance [None req-042b9b97-06c8-402a-b5d0-ea0424c73ef0 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Lazy-loading 'services' on Instance uuid 720c683f-c03a-444c-92a8-daf97c9f524b {{(pid=72089) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 11 19:32:11 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [None req-042b9b97-06c8-402a-b5d0-ea0424c73ef0 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/720c683f-c03a-444c-92a8-daf97c9f524b/os-volume_attachments/b5f0471b-94d7-446d-9313-3c94d2e9355d" status: 202 len: 0 microversion: 2.20 time: 0.199223 Apr 11 19:32:11 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 194/565] 10.0.0.210 () {64 vars in 1534 bytes} [Tue Apr 11 19:32:11 2023] DELETE /compute/v2.1/servers/720c683f-c03a-444c-92a8-daf97c9f524b/os-volume_attachments/b5f0471b-94d7-446d-9313-3c94d2e9355d => generated 0 bytes in 201 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 11 19:32:11 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [None req-0ff9999b-acd5-42b6-ae71-534906eaffc0 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Calling method '>' {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:32:11 user devstack@n-api.service[72090]: DEBUG nova.compute.api [None req-0ff9999b-acd5-42b6-ae71-534906eaffc0 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] [instance: 720c683f-c03a-444c-92a8-daf97c9f524b] Fetching instance by UUID {{(pid=72090) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:32:11 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-0ff9999b-acd5-42b6-ae71-534906eaffc0 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:32:11 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-0ff9999b-acd5-42b6-ae71-534906eaffc0 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:32:11 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-0ff9999b-acd5-42b6-ae71-534906eaffc0 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:32:11 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-0ff9999b-acd5-42b6-ae71-534906eaffc0 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:32:11 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-0ff9999b-acd5-42b6-ae71-534906eaffc0 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:32:11 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-0ff9999b-acd5-42b6-ae71-534906eaffc0 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:32:11 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [None req-0ff9999b-acd5-42b6-ae71-534906eaffc0 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] 10.0.0.210 "GET /compute/v2.1/servers/720c683f-c03a-444c-92a8-daf97c9f524b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.058996 Apr 11 19:32:11 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 187/566] 10.0.0.210 () {64 vars in 1420 bytes} [Tue Apr 11 19:32:11 2023] GET /compute/v2.1/servers/720c683f-c03a-444c-92a8-daf97c9f524b/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:32:12 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [req-8d73ef1b-aeac-47a7-90d4-44047064b173 req-862d328a-00bf-4870-ab7d-a63cd6fbda0c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e6e3640a-c262-4e2d-a994-2e4312f22871", "name": "network-vif-plugged", "status": "completed", "tag": "183a0478-c117-4fe1-acce-22e4aee440c9"}, {"server_uuid": "864fcd9b-8e5b-4de8-a2e6-292a8907a834", "name": "network-vif-unplugged", "status": "completed", "tag": "60f272b0-f7d2-408b-b99b-9bcfcd3f23ff"}, {"server_uuid": "864fcd9b-8e5b-4de8-a2e6-292a8907a834", "name": "network-vif-plugged", "status": "completed", "tag": "60f272b0-f7d2-408b-b99b-9bcfcd3f23ff"}]} {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:32:12 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-8d73ef1b-aeac-47a7-90d4-44047064b173 req-862d328a-00bf-4870-ab7d-a63cd6fbda0c service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:32:12 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-8d73ef1b-aeac-47a7-90d4-44047064b173 req-862d328a-00bf-4870-ab7d-a63cd6fbda0c service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:32:12 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-8d73ef1b-aeac-47a7-90d4-44047064b173 req-862d328a-00bf-4870-ab7d-a63cd6fbda0c service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:32:12 user devstack@n-api.service[72088]: INFO nova.api.openstack.compute.server_external_events [req-8d73ef1b-aeac-47a7-90d4-44047064b173 req-862d328a-00bf-4870-ab7d-a63cd6fbda0c service nova] Creating event network-vif-plugged:183a0478-c117-4fe1-acce-22e4aee440c9 for instance e6e3640a-c262-4e2d-a994-2e4312f22871 on user Apr 11 19:32:12 user devstack@n-api.service[72088]: INFO nova.api.openstack.compute.server_external_events [req-8d73ef1b-aeac-47a7-90d4-44047064b173 req-862d328a-00bf-4870-ab7d-a63cd6fbda0c service nova] Creating event network-vif-unplugged:60f272b0-f7d2-408b-b99b-9bcfcd3f23ff for instance 864fcd9b-8e5b-4de8-a2e6-292a8907a834 on user Apr 11 19:32:12 user devstack@n-api.service[72088]: INFO nova.api.openstack.compute.server_external_events [req-8d73ef1b-aeac-47a7-90d4-44047064b173 req-862d328a-00bf-4870-ab7d-a63cd6fbda0c service nova] Creating event network-vif-plugged:60f272b0-f7d2-408b-b99b-9bcfcd3f23ff for instance 864fcd9b-8e5b-4de8-a2e6-292a8907a834 on user Apr 11 19:32:12 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [req-8d73ef1b-aeac-47a7-90d4-44047064b173 req-862d328a-00bf-4870-ab7d-a63cd6fbda0c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 527 microversion: 2.1 time: 0.034126 Apr 11 19:32:12 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 186/567] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:32:12 2023] POST /compute/v2.1/os-server-external-events => generated 527 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:32:13 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [req-0a949fe5-0e67-4bac-8173-3a19782ed714 req-e792cd5f-8099-4453-a785-164a979b16d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03bb985c-4903-4d0e-98a1-43a9352f4ec6", "name": "network-vif-plugged", "status": "completed", "tag": "2da07e24-d185-4553-ab56-819067f03d48"}, {"name": "network-changed", "server_uuid": "cbd5aa3c-f6c9-49e2-8ee7-dcf389c9ed08", "tag": "07039db4-244e-4941-ae2b-5f396531e40d"}]} {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:32:13 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-0a949fe5-0e67-4bac-8173-3a19782ed714 req-e792cd5f-8099-4453-a785-164a979b16d2 service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:32:13 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-0a949fe5-0e67-4bac-8173-3a19782ed714 req-e792cd5f-8099-4453-a785-164a979b16d2 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:32:13 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-0a949fe5-0e67-4bac-8173-3a19782ed714 req-e792cd5f-8099-4453-a785-164a979b16d2 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:32:13 user devstack@n-api.service[72089]: INFO nova.api.openstack.compute.server_external_events [req-0a949fe5-0e67-4bac-8173-3a19782ed714 req-e792cd5f-8099-4453-a785-164a979b16d2 service nova] Creating event network-vif-plugged:2da07e24-d185-4553-ab56-819067f03d48 for instance 03bb985c-4903-4d0e-98a1-43a9352f4ec6 on user Apr 11 19:32:13 user devstack@n-api.service[72089]: INFO nova.api.openstack.compute.server_external_events [req-0a949fe5-0e67-4bac-8173-3a19782ed714 req-e792cd5f-8099-4453-a785-164a979b16d2 service nova] Creating event network-changed:07039db4-244e-4941-ae2b-5f396531e40d for instance cbd5aa3c-f6c9-49e2-8ee7-dcf389c9ed08 on user Apr 11 19:32:13 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [req-0a949fe5-0e67-4bac-8173-3a19782ed714 req-e792cd5f-8099-4453-a785-164a979b16d2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.035636 Apr 11 19:32:13 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 195/568] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:32:13 2023] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:32:14 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [req-a0b45943-8354-4fd1-9535-3dd9e7fd25c6 req-1fd157b6-294a-4169-bda2-95259e21db87 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "864fcd9b-8e5b-4de8-a2e6-292a8907a834", "name": "network-vif-plugged", "status": "completed", "tag": "60f272b0-f7d2-408b-b99b-9bcfcd3f23ff"}, {"server_uuid": "864fcd9b-8e5b-4de8-a2e6-292a8907a834", "name": "network-vif-plugged", "status": "completed", "tag": "60f272b0-f7d2-408b-b99b-9bcfcd3f23ff"}]} {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:32:14 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-a0b45943-8354-4fd1-9535-3dd9e7fd25c6 req-1fd157b6-294a-4169-bda2-95259e21db87 service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:32:14 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-a0b45943-8354-4fd1-9535-3dd9e7fd25c6 req-1fd157b6-294a-4169-bda2-95259e21db87 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:32:14 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-a0b45943-8354-4fd1-9535-3dd9e7fd25c6 req-1fd157b6-294a-4169-bda2-95259e21db87 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:32:14 user devstack@n-api.service[72090]: INFO nova.api.openstack.compute.server_external_events [req-a0b45943-8354-4fd1-9535-3dd9e7fd25c6 req-1fd157b6-294a-4169-bda2-95259e21db87 service nova] Creating event network-vif-plugged:60f272b0-f7d2-408b-b99b-9bcfcd3f23ff for instance 864fcd9b-8e5b-4de8-a2e6-292a8907a834 on user Apr 11 19:32:14 user devstack@n-api.service[72090]: INFO nova.api.openstack.compute.server_external_events [req-a0b45943-8354-4fd1-9535-3dd9e7fd25c6 req-1fd157b6-294a-4169-bda2-95259e21db87 service nova] Creating event network-vif-plugged:60f272b0-f7d2-408b-b99b-9bcfcd3f23ff for instance 864fcd9b-8e5b-4de8-a2e6-292a8907a834 on user Apr 11 19:32:14 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [req-a0b45943-8354-4fd1-9535-3dd9e7fd25c6 req-1fd157b6-294a-4169-bda2-95259e21db87 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.034722 Apr 11 19:32:14 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 188/569] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:32:14 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:32:23 user devstack@n-api.service[72088]: DEBUG dbcounter [-] [72088] Writing DB stats nova_cell0:SELECT=4 {{(pid=72088) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:32:23 user devstack@n-api.service[72088]: DEBUG dbcounter [-] [72088] Writing DB stats nova_api:SELECT=19,nova_api:DELETE=1 {{(pid=72088) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:32:23 user devstack@n-api.service[72088]: DEBUG dbcounter [-] [72088] Writing DB stats nova_cell1:SELECT=16,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=72088) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:32:23 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [None req-4e96e951-32a3-4bcf-b958-c0267bfbd97e tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:32:23 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-4e96e951-32a3-4bcf-b958-c0267bfbd97e tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:32:23 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-4e96e951-32a3-4bcf-b958-c0267bfbd97e tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:32:23 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-4e96e951-32a3-4bcf-b958-c0267bfbd97e tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:32:23 user devstack@n-api.service[72088]: DEBUG nova.compute.api [None req-4e96e951-32a3-4bcf-b958-c0267bfbd97e tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] [instance: 6802f099-9236-4c79-a892-2963f1b15b0e] Going to try to start instance {{(pid=72088) start /opt/stack/nova/nova/compute/api.py:2787}} Apr 11 19:32:23 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [None req-4e96e951-32a3-4bcf-b958-c0267bfbd97e tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] 10.0.0.210 "POST /compute/v2.1/servers/6802f099-9236-4c79-a892-2963f1b15b0e/action" status: 202 len: 0 microversion: 2.1 time: 0.236390 Apr 11 19:32:23 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 187/570] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Apr 11 19:32:23 2023] POST /compute/v2.1/servers/6802f099-9236-4c79-a892-2963f1b15b0e/action => generated 0 bytes in 239 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 19:32:23 user devstack@n-api.service[72089]: DEBUG dbcounter [-] [72089] Writing DB stats nova_cell0:SELECT=2 {{(pid=72089) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:32:23 user devstack@n-api.service[72089]: DEBUG dbcounter [-] [72089] Writing DB stats nova_cell0:SELECT=10 {{(pid=72089) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:32:23 user devstack@n-api.service[72089]: DEBUG dbcounter [-] [72089] Writing DB stats nova_api:SELECT=24,nova_api:INSERT=3 {{(pid=72089) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:32:23 user devstack@n-api.service[72089]: DEBUG dbcounter [-] [72089] Writing DB stats nova_cell1:SELECT=23,nova_cell1:INSERT=1 {{(pid=72089) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:32:23 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [None req-772ee446-dcc4-47c9-9c40-2bb86b470a64 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Calling method '>' {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:32:23 user devstack@n-api.service[72089]: DEBUG nova.compute.api [None req-772ee446-dcc4-47c9-9c40-2bb86b470a64 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] [instance: 6802f099-9236-4c79-a892-2963f1b15b0e] Fetching instance by UUID {{(pid=72089) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:32:23 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-772ee446-dcc4-47c9-9c40-2bb86b470a64 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:32:23 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-772ee446-dcc4-47c9-9c40-2bb86b470a64 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:32:23 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-772ee446-dcc4-47c9-9c40-2bb86b470a64 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:32:23 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-772ee446-dcc4-47c9-9c40-2bb86b470a64 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:32:23 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-772ee446-dcc4-47c9-9c40-2bb86b470a64 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:32:23 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-772ee446-dcc4-47c9-9c40-2bb86b470a64 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:32:24 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [req-56575115-e408-412b-a370-805e0201647e req-5e898cee-0e5c-4176-8e8d-bb06001f5a26 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cbd5aa3c-f6c9-49e2-8ee7-dcf389c9ed08", "name": "network-vif-plugged", "status": "completed", "tag": "07039db4-244e-4941-ae2b-5f396531e40d"}]} {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:32:24 user devstack@n-api.service[72090]: DEBUG dbcounter [-] [72090] Writing DB stats nova_cell0:SELECT=4 {{(pid=72090) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:32:24 user devstack@n-api.service[72090]: DEBUG dbcounter [-] [72090] Writing DB stats nova_cell0:SELECT=14 {{(pid=72090) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:32:24 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-56575115-e408-412b-a370-805e0201647e req-5e898cee-0e5c-4176-8e8d-bb06001f5a26 service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:32:24 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-56575115-e408-412b-a370-805e0201647e req-5e898cee-0e5c-4176-8e8d-bb06001f5a26 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:32:24 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-56575115-e408-412b-a370-805e0201647e req-5e898cee-0e5c-4176-8e8d-bb06001f5a26 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:32:24 user devstack@n-api.service[72089]: DEBUG nova.policy [None req-772ee446-dcc4-47c9-9c40-2bb86b470a64 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31c237e142784bd6aa460d6f1bf33400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd886d2ec5fc946b49af3c8ca7c8556c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72089) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:32:24 user devstack@n-api.service[72090]: DEBUG dbcounter [-] [72090] Writing DB stats nova_cell1:SELECT=20 {{(pid=72090) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:32:24 user devstack@n-api.service[72090]: INFO nova.api.openstack.compute.server_external_events [req-56575115-e408-412b-a370-805e0201647e req-5e898cee-0e5c-4176-8e8d-bb06001f5a26 service nova] Creating event network-vif-plugged:07039db4-244e-4941-ae2b-5f396531e40d for instance cbd5aa3c-f6c9-49e2-8ee7-dcf389c9ed08 on user Apr 11 19:32:24 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [req-56575115-e408-412b-a370-805e0201647e req-5e898cee-0e5c-4176-8e8d-bb06001f5a26 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075326 Apr 11 19:32:24 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 189/571] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:32:24 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 11 19:32:24 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [None req-772ee446-dcc4-47c9-9c40-2bb86b470a64 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6802f099-9236-4c79-a892-2963f1b15b0e" status: 200 len: 1653 microversion: 2.1 time: 0.300475 Apr 11 19:32:24 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 196/572] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 19:32:23 2023] GET /compute/v2.1/servers/6802f099-9236-4c79-a892-2963f1b15b0e => generated 1653 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:32:26 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [req-a1c07c50-f0f8-4a48-a5c8-0326bb2d5c2c req-3a05dbbb-87d3-42c3-a61a-88be1041f262 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cbd5aa3c-f6c9-49e2-8ee7-dcf389c9ed08", "name": "network-vif-plugged", "status": "completed", "tag": "07039db4-244e-4941-ae2b-5f396531e40d"}]} {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:32:26 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-a1c07c50-f0f8-4a48-a5c8-0326bb2d5c2c req-3a05dbbb-87d3-42c3-a61a-88be1041f262 service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:32:26 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-a1c07c50-f0f8-4a48-a5c8-0326bb2d5c2c req-3a05dbbb-87d3-42c3-a61a-88be1041f262 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:32:26 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-a1c07c50-f0f8-4a48-a5c8-0326bb2d5c2c req-3a05dbbb-87d3-42c3-a61a-88be1041f262 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:32:26 user devstack@n-api.service[72088]: INFO nova.api.openstack.compute.server_external_events [req-a1c07c50-f0f8-4a48-a5c8-0326bb2d5c2c req-3a05dbbb-87d3-42c3-a61a-88be1041f262 service nova] Creating event network-vif-plugged:07039db4-244e-4941-ae2b-5f396531e40d for instance cbd5aa3c-f6c9-49e2-8ee7-dcf389c9ed08 on user Apr 11 19:32:26 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [req-a1c07c50-f0f8-4a48-a5c8-0326bb2d5c2c req-3a05dbbb-87d3-42c3-a61a-88be1041f262 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036615 Apr 11 19:32:26 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 188/573] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:32:26 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:32:28 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [req-a3693abd-304d-4d25-beca-c8a2afee6a4f req-9cca91e4-dc2b-47a4-9f95-83f16be25699 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6802f099-9236-4c79-a892-2963f1b15b0e", "name": "network-vif-plugged", "status": "completed", "tag": "6193819b-0c1b-476b-b89e-dbbfc7938fc5"}, {"server_uuid": "6802f099-9236-4c79-a892-2963f1b15b0e", "name": "network-vif-plugged", "status": "completed", "tag": "6193819b-0c1b-476b-b89e-dbbfc7938fc5"}]} {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:32:28 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-a3693abd-304d-4d25-beca-c8a2afee6a4f req-9cca91e4-dc2b-47a4-9f95-83f16be25699 service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:32:28 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-a3693abd-304d-4d25-beca-c8a2afee6a4f req-9cca91e4-dc2b-47a4-9f95-83f16be25699 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:32:28 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-a3693abd-304d-4d25-beca-c8a2afee6a4f req-9cca91e4-dc2b-47a4-9f95-83f16be25699 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:32:28 user devstack@n-api.service[72090]: INFO nova.api.openstack.compute.server_external_events [req-a3693abd-304d-4d25-beca-c8a2afee6a4f req-9cca91e4-dc2b-47a4-9f95-83f16be25699 service nova] Creating event network-vif-plugged:6193819b-0c1b-476b-b89e-dbbfc7938fc5 for instance 6802f099-9236-4c79-a892-2963f1b15b0e on user Apr 11 19:32:28 user devstack@n-api.service[72090]: INFO nova.api.openstack.compute.server_external_events [req-a3693abd-304d-4d25-beca-c8a2afee6a4f req-9cca91e4-dc2b-47a4-9f95-83f16be25699 service nova] Creating event network-vif-plugged:6193819b-0c1b-476b-b89e-dbbfc7938fc5 for instance 6802f099-9236-4c79-a892-2963f1b15b0e on user Apr 11 19:32:28 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [req-a3693abd-304d-4d25-beca-c8a2afee6a4f req-9cca91e4-dc2b-47a4-9f95-83f16be25699 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.031876 Apr 11 19:32:28 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 190/574] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:32:28 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:32:31 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [None req-845980a7-2355-41ed-83e8-ed58a5895bb8 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Calling method '>' {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:32:31 user devstack@n-api.service[72089]: DEBUG nova.compute.api [None req-845980a7-2355-41ed-83e8-ed58a5895bb8 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] [instance: 6f2616ce-4924-4b82-996a-2596ae8856a4] Fetching instance by UUID {{(pid=72089) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:32:31 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-845980a7-2355-41ed-83e8-ed58a5895bb8 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:32:31 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-845980a7-2355-41ed-83e8-ed58a5895bb8 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:32:31 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-845980a7-2355-41ed-83e8-ed58a5895bb8 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:32:31 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-845980a7-2355-41ed-83e8-ed58a5895bb8 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:32:31 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-845980a7-2355-41ed-83e8-ed58a5895bb8 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:32:31 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-845980a7-2355-41ed-83e8-ed58a5895bb8 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:32:31 user devstack@n-api.service[72089]: DEBUG nova.policy [None req-845980a7-2355-41ed-83e8-ed58a5895bb8 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba7f82b529e74d99838b6264b94d823b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e3a291c54b49db8e12a88ba41865e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72089) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:32:31 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [None req-845980a7-2355-41ed-83e8-ed58a5895bb8 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6f2616ce-4924-4b82-996a-2596ae8856a4" status: 200 len: 1491 microversion: 2.1 time: 0.144174 Apr 11 19:32:31 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 197/575] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 19:32:31 2023] GET /compute/v2.1/servers/6f2616ce-4924-4b82-996a-2596ae8856a4 => generated 1491 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:32:34 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [None req-dfec8090-6e74-4775-a0a8-83f3e10e2276 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Calling method '>' {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:32:34 user devstack@n-api.service[72088]: DEBUG nova.compute.api [None req-dfec8090-6e74-4775-a0a8-83f3e10e2276 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] [instance: 647674d8-af53-405a-8116-4b7a01549bdf] Fetching instance by UUID {{(pid=72088) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:32:34 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-dfec8090-6e74-4775-a0a8-83f3e10e2276 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:32:34 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-dfec8090-6e74-4775-a0a8-83f3e10e2276 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:32:34 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-dfec8090-6e74-4775-a0a8-83f3e10e2276 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:32:34 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-dfec8090-6e74-4775-a0a8-83f3e10e2276 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:32:34 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-dfec8090-6e74-4775-a0a8-83f3e10e2276 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:32:34 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-dfec8090-6e74-4775-a0a8-83f3e10e2276 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:32:34 user devstack@n-api.service[72088]: DEBUG nova.policy [None req-dfec8090-6e74-4775-a0a8-83f3e10e2276 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05fb551c320a48f98a4ec00a7f7492d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60a7381a31b84e97a068528f90813773', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72088) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:32:34 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [None req-dfec8090-6e74-4775-a0a8-83f3e10e2276 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] 10.0.0.210 "GET /compute/v2.1/servers/647674d8-af53-405a-8116-4b7a01549bdf" status: 200 len: 1723 microversion: 2.1 time: 0.254691 Apr 11 19:32:34 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 189/576] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 19:32:34 2023] GET /compute/v2.1/servers/647674d8-af53-405a-8116-4b7a01549bdf => generated 1723 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:32:34 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [None req-e8642a56-f70c-4d64-b3a7-af4a01bdf209 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Calling method '>' {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:32:34 user devstack@n-api.service[72090]: DEBUG nova.compute.api [None req-e8642a56-f70c-4d64-b3a7-af4a01bdf209 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] [instance: 647674d8-af53-405a-8116-4b7a01549bdf] Fetching instance by UUID {{(pid=72090) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:32:34 user devstack@n-api.service[72090]: DEBUG dbcounter [-] [72090] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=6 {{(pid=72090) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:32:34 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-e8642a56-f70c-4d64-b3a7-af4a01bdf209 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:32:34 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-e8642a56-f70c-4d64-b3a7-af4a01bdf209 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:32:34 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-e8642a56-f70c-4d64-b3a7-af4a01bdf209 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:32:34 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-e8642a56-f70c-4d64-b3a7-af4a01bdf209 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:32:34 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-e8642a56-f70c-4d64-b3a7-af4a01bdf209 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:32:34 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-e8642a56-f70c-4d64-b3a7-af4a01bdf209 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:32:34 user devstack@n-api.service[72090]: DEBUG nova.policy [None req-e8642a56-f70c-4d64-b3a7-af4a01bdf209 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05fb551c320a48f98a4ec00a7f7492d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60a7381a31b84e97a068528f90813773', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72090) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:32:34 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [None req-e8642a56-f70c-4d64-b3a7-af4a01bdf209 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] 10.0.0.210 "GET /compute/v2.1/servers/647674d8-af53-405a-8116-4b7a01549bdf" status: 200 len: 1723 microversion: 2.1 time: 0.161503 Apr 11 19:32:34 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 191/577] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 19:32:34 2023] GET /compute/v2.1/servers/647674d8-af53-405a-8116-4b7a01549bdf => generated 1723 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:32:52 user devstack@n-api.service[72089]: DEBUG dbcounter [-] [72089] Writing DB stats nova_api:SELECT=4 {{(pid=72089) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:32:52 user devstack@n-api.service[72089]: DEBUG dbcounter [-] [72089] Writing DB stats nova_cell1:SELECT=12 {{(pid=72089) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:32:52 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [None req-ee72f3d3-4457-4df6-a934-f5373feb1f67 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Calling method '>' {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:32:52 user devstack@n-api.service[72089]: DEBUG nova.compute.api [None req-ee72f3d3-4457-4df6-a934-f5373feb1f67 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] [instance: e6e3640a-c262-4e2d-a994-2e4312f22871] Fetching instance by UUID {{(pid=72089) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:32:52 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-ee72f3d3-4457-4df6-a934-f5373feb1f67 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:32:52 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-ee72f3d3-4457-4df6-a934-f5373feb1f67 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:32:52 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-ee72f3d3-4457-4df6-a934-f5373feb1f67 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:32:52 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-ee72f3d3-4457-4df6-a934-f5373feb1f67 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:32:52 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-ee72f3d3-4457-4df6-a934-f5373feb1f67 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:32:52 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-ee72f3d3-4457-4df6-a934-f5373feb1f67 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:32:52 user devstack@n-api.service[72089]: DEBUG nova.policy [None req-ee72f3d3-4457-4df6-a934-f5373feb1f67 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5d405421ceb4d99967ef2e7f55e7809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06966e2f4d3a4dec92282c7ad348635d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72089) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:32:52 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [None req-ee72f3d3-4457-4df6-a934-f5373feb1f67 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e6e3640a-c262-4e2d-a994-2e4312f22871" status: 200 len: 1545 microversion: 2.1 time: 0.608854 Apr 11 19:32:52 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 198/578] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 19:32:52 2023] GET /compute/v2.1/servers/e6e3640a-c262-4e2d-a994-2e4312f22871 => generated 1545 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:32:55 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [None req-62df1a01-d0e8-41f7-bf73-eb319fd2f391 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Calling method '>' {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:32:55 user devstack@n-api.service[72088]: DEBUG nova.compute.api [None req-62df1a01-d0e8-41f7-bf73-eb319fd2f391 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] [instance: 03bb985c-4903-4d0e-98a1-43a9352f4ec6] Fetching instance by UUID {{(pid=72088) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:32:55 user devstack@n-api.service[72088]: DEBUG dbcounter [-] [72088] Writing DB stats nova_api:SELECT=6 {{(pid=72088) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:32:55 user devstack@n-api.service[72088]: DEBUG dbcounter [-] [72088] Writing DB stats nova_cell1:SELECT=18,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=72088) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:32:55 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-62df1a01-d0e8-41f7-bf73-eb319fd2f391 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:32:55 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-62df1a01-d0e8-41f7-bf73-eb319fd2f391 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:32:55 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-62df1a01-d0e8-41f7-bf73-eb319fd2f391 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:32:55 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-62df1a01-d0e8-41f7-bf73-eb319fd2f391 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:32:55 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-62df1a01-d0e8-41f7-bf73-eb319fd2f391 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:32:55 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-62df1a01-d0e8-41f7-bf73-eb319fd2f391 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:32:55 user devstack@n-api.service[72088]: DEBUG nova.policy [None req-62df1a01-d0e8-41f7-bf73-eb319fd2f391 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20f337feb0ed4653976ace530bfdd877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d5246cf04a7401388cba38d16e298ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72088) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:32:55 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [None req-62df1a01-d0e8-41f7-bf73-eb319fd2f391 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] 10.0.0.210 "GET /compute/v2.1/servers/03bb985c-4903-4d0e-98a1-43a9352f4ec6" status: 200 len: 1496 microversion: 2.1 time: 0.156636 Apr 11 19:32:55 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 190/579] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 19:32:55 2023] GET /compute/v2.1/servers/03bb985c-4903-4d0e-98a1-43a9352f4ec6 => generated 1496 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:32:59 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [None req-64083714-1ab9-43e6-b62a-5d0de46f4744 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Calling method '>' {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:32:59 user devstack@n-api.service[72090]: DEBUG nova.compute.api [None req-64083714-1ab9-43e6-b62a-5d0de46f4744 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] [instance: 864fcd9b-8e5b-4de8-a2e6-292a8907a834] Fetching instance by UUID {{(pid=72090) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:32:59 user devstack@n-api.service[72090]: DEBUG dbcounter [-] [72090] Writing DB stats nova_api:SELECT=1 {{(pid=72090) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:32:59 user devstack@n-api.service[72090]: DEBUG dbcounter [-] [72090] Writing DB stats nova_cell1:SELECT=10 {{(pid=72090) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:32:59 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-64083714-1ab9-43e6-b62a-5d0de46f4744 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:32:59 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-64083714-1ab9-43e6-b62a-5d0de46f4744 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:32:59 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-64083714-1ab9-43e6-b62a-5d0de46f4744 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:32:59 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-64083714-1ab9-43e6-b62a-5d0de46f4744 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:32:59 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-64083714-1ab9-43e6-b62a-5d0de46f4744 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:32:59 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-64083714-1ab9-43e6-b62a-5d0de46f4744 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:32:59 user devstack@n-api.service[72090]: DEBUG nova.policy [None req-64083714-1ab9-43e6-b62a-5d0de46f4744 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b3adca432b04d70818a51d1366f5c6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb91586feb3f4a4c84fa8c2183baaf8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72090) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:32:59 user devstack@n-api.service[72090]: DEBUG nova.policy [None req-64083714-1ab9-43e6-b62a-5d0de46f4744 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b3adca432b04d70818a51d1366f5c6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb91586feb3f4a4c84fa8c2183baaf8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72090) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:32:59 user devstack@n-api.service[72090]: DEBUG nova.policy [None req-64083714-1ab9-43e6-b62a-5d0de46f4744 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b3adca432b04d70818a51d1366f5c6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb91586feb3f4a4c84fa8c2183baaf8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72090) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:32:59 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [None req-64083714-1ab9-43e6-b62a-5d0de46f4744 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] 10.0.0.210 "GET /compute/v2.1/servers/864fcd9b-8e5b-4de8-a2e6-292a8907a834" status: 200 len: 1769 microversion: 2.87 time: 0.149677 Apr 11 19:32:59 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 192/580] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 19:32:59 2023] GET /compute/v2.1/servers/864fcd9b-8e5b-4de8-a2e6-292a8907a834 => generated 1769 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 19:32:59 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [None req-fd4ce7c2-7a4e-4cab-99da-8ae8b7223ee7 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Calling method '>' {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:32:59 user devstack@n-api.service[72089]: DEBUG nova.compute.api [None req-fd4ce7c2-7a4e-4cab-99da-8ae8b7223ee7 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] [instance: cbd5aa3c-f6c9-49e2-8ee7-dcf389c9ed08] Fetching instance by UUID {{(pid=72089) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:32:59 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-fd4ce7c2-7a4e-4cab-99da-8ae8b7223ee7 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:32:59 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-fd4ce7c2-7a4e-4cab-99da-8ae8b7223ee7 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:32:59 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-fd4ce7c2-7a4e-4cab-99da-8ae8b7223ee7 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:32:59 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-fd4ce7c2-7a4e-4cab-99da-8ae8b7223ee7 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:32:59 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-fd4ce7c2-7a4e-4cab-99da-8ae8b7223ee7 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:32:59 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-fd4ce7c2-7a4e-4cab-99da-8ae8b7223ee7 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:32:59 user devstack@n-api.service[72089]: DEBUG nova.policy [None req-fd4ce7c2-7a4e-4cab-99da-8ae8b7223ee7 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf262cd03f4a41c4956d8784cf37d86d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caba0618fc743e7bfb2dd866a511df9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72089) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:32:59 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [None req-fd4ce7c2-7a4e-4cab-99da-8ae8b7223ee7 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cbd5aa3c-f6c9-49e2-8ee7-dcf389c9ed08" status: 200 len: 1380 microversion: 2.1 time: 0.159535 Apr 11 19:32:59 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 199/581] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 19:32:59 2023] GET /compute/v2.1/servers/cbd5aa3c-f6c9-49e2-8ee7-dcf389c9ed08 => generated 1380 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:33:01 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [None req-61d5ba7f-7ff4-4c17-89c7-a73e39725e37 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Calling method '>' {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:33:01 user devstack@n-api.service[72088]: DEBUG nova.compute.api [None req-61d5ba7f-7ff4-4c17-89c7-a73e39725e37 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] [instance: 720c683f-c03a-444c-92a8-daf97c9f524b] Fetching instance by UUID {{(pid=72088) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:33:01 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-61d5ba7f-7ff4-4c17-89c7-a73e39725e37 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:33:01 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-61d5ba7f-7ff4-4c17-89c7-a73e39725e37 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:33:01 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-61d5ba7f-7ff4-4c17-89c7-a73e39725e37 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:33:01 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-61d5ba7f-7ff4-4c17-89c7-a73e39725e37 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:33:01 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-61d5ba7f-7ff4-4c17-89c7-a73e39725e37 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:33:01 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-61d5ba7f-7ff4-4c17-89c7-a73e39725e37 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:33:02 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [None req-61d5ba7f-7ff4-4c17-89c7-a73e39725e37 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] 10.0.0.210 "GET /compute/v2.1/servers/720c683f-c03a-444c-92a8-daf97c9f524b/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.046084 Apr 11 19:33:02 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 191/582] 10.0.0.210 () {64 vars in 1420 bytes} [Tue Apr 11 19:33:01 2023] GET /compute/v2.1/servers/720c683f-c03a-444c-92a8-daf97c9f524b/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:33:02 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [None req-442f03e3-b458-438e-a067-436eeec9cfe2 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Calling method '>' {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:33:02 user devstack@n-api.service[72090]: DEBUG nova.compute.api [None req-442f03e3-b458-438e-a067-436eeec9cfe2 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] [instance: 720c683f-c03a-444c-92a8-daf97c9f524b] Fetching instance by UUID {{(pid=72090) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:33:02 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-442f03e3-b458-438e-a067-436eeec9cfe2 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:33:02 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-442f03e3-b458-438e-a067-436eeec9cfe2 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:33:02 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-442f03e3-b458-438e-a067-436eeec9cfe2 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:33:02 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-442f03e3-b458-438e-a067-436eeec9cfe2 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:33:02 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-442f03e3-b458-438e-a067-436eeec9cfe2 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:33:02 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-442f03e3-b458-438e-a067-436eeec9cfe2 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:33:02 user devstack@n-api.service[72090]: DEBUG nova.compute.api [None req-442f03e3-b458-438e-a067-436eeec9cfe2 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] [instance: 720c683f-c03a-444c-92a8-daf97c9f524b] Going to try to terminate instance {{(pid=72090) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 11 19:33:02 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [None req-442f03e3-b458-438e-a067-436eeec9cfe2 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/720c683f-c03a-444c-92a8-daf97c9f524b" status: 204 len: 0 microversion: 2.20 time: 0.124622 Apr 11 19:33:02 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 193/583] 10.0.0.210 () {64 vars in 1357 bytes} [Tue Apr 11 19:33:02 2023] DELETE /compute/v2.1/servers/720c683f-c03a-444c-92a8-daf97c9f524b => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 11 19:33:02 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [None req-c761e2e0-6a5c-4b1a-803a-5f03e5a1e0f4 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Calling method '>' {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:33:02 user devstack@n-api.service[72089]: DEBUG nova.compute.api [None req-c761e2e0-6a5c-4b1a-803a-5f03e5a1e0f4 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] [instance: 720c683f-c03a-444c-92a8-daf97c9f524b] Fetching instance by UUID {{(pid=72089) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:33:02 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-c761e2e0-6a5c-4b1a-803a-5f03e5a1e0f4 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:33:02 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-c761e2e0-6a5c-4b1a-803a-5f03e5a1e0f4 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:33:02 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-c761e2e0-6a5c-4b1a-803a-5f03e5a1e0f4 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:33:02 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-c761e2e0-6a5c-4b1a-803a-5f03e5a1e0f4 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:33:02 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-c761e2e0-6a5c-4b1a-803a-5f03e5a1e0f4 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:33:02 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-c761e2e0-6a5c-4b1a-803a-5f03e5a1e0f4 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:33:02 user devstack@n-api.service[72089]: DEBUG nova.policy [None req-c761e2e0-6a5c-4b1a-803a-5f03e5a1e0f4 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0558ba5a2b04d36ba2f2411090cc4e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d8b189667e34931aa36149620a036e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72089) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:33:02 user devstack@n-api.service[72089]: DEBUG nova.policy [None req-c761e2e0-6a5c-4b1a-803a-5f03e5a1e0f4 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0558ba5a2b04d36ba2f2411090cc4e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d8b189667e34931aa36149620a036e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72089) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:33:02 user devstack@n-api.service[72089]: DEBUG nova.policy [None req-c761e2e0-6a5c-4b1a-803a-5f03e5a1e0f4 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0558ba5a2b04d36ba2f2411090cc4e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d8b189667e34931aa36149620a036e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72089) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:33:02 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [None req-c761e2e0-6a5c-4b1a-803a-5f03e5a1e0f4 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] 10.0.0.210 "GET /compute/v2.1/servers/720c683f-c03a-444c-92a8-daf97c9f524b" status: 200 len: 1709 microversion: 2.20 time: 0.294209 Apr 11 19:33:02 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 200/584] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 19:33:02 2023] GET /compute/v2.1/servers/720c683f-c03a-444c-92a8-daf97c9f524b => generated 1709 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 11 19:33:02 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [req-7bc691fa-c1f6-4089-b2d1-0a72ffd2d9cd req-6c811fa2-444d-4d68-ada6-f0719603e67b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "720c683f-c03a-444c-92a8-daf97c9f524b", "name": "network-vif-unplugged", "status": "completed", "tag": "9e6087aa-464a-450d-bd04-2653d9420094"}]} {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:33:02 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-7bc691fa-c1f6-4089-b2d1-0a72ffd2d9cd req-6c811fa2-444d-4d68-ada6-f0719603e67b service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:33:02 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-7bc691fa-c1f6-4089-b2d1-0a72ffd2d9cd req-6c811fa2-444d-4d68-ada6-f0719603e67b service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:33:02 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-7bc691fa-c1f6-4089-b2d1-0a72ffd2d9cd req-6c811fa2-444d-4d68-ada6-f0719603e67b service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:33:02 user devstack@n-api.service[72088]: INFO nova.api.openstack.compute.server_external_events [req-7bc691fa-c1f6-4089-b2d1-0a72ffd2d9cd req-6c811fa2-444d-4d68-ada6-f0719603e67b service nova] Creating event network-vif-unplugged:9e6087aa-464a-450d-bd04-2653d9420094 for instance 720c683f-c03a-444c-92a8-daf97c9f524b on user Apr 11 19:33:02 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [req-7bc691fa-c1f6-4089-b2d1-0a72ffd2d9cd req-6c811fa2-444d-4d68-ada6-f0719603e67b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.093913 Apr 11 19:33:02 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 192/585] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:33:02 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:33:03 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [req-695bd9fc-ee0f-4905-8c9a-727194576572 req-c05cfe50-0e7a-4ff2-86cf-4a49fa1bfbb4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "720c683f-c03a-444c-92a8-daf97c9f524b", "name": "network-vif-deleted", "tag": "9e6087aa-464a-450d-bd04-2653d9420094"}]} {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:33:03 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-695bd9fc-ee0f-4905-8c9a-727194576572 req-c05cfe50-0e7a-4ff2-86cf-4a49fa1bfbb4 service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:33:03 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-695bd9fc-ee0f-4905-8c9a-727194576572 req-c05cfe50-0e7a-4ff2-86cf-4a49fa1bfbb4 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:33:03 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-695bd9fc-ee0f-4905-8c9a-727194576572 req-c05cfe50-0e7a-4ff2-86cf-4a49fa1bfbb4 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:33:03 user devstack@n-api.service[72090]: INFO nova.api.openstack.compute.server_external_events [req-695bd9fc-ee0f-4905-8c9a-727194576572 req-c05cfe50-0e7a-4ff2-86cf-4a49fa1bfbb4 service nova] Creating event network-vif-deleted:9e6087aa-464a-450d-bd04-2653d9420094 for instance 720c683f-c03a-444c-92a8-daf97c9f524b on user Apr 11 19:33:03 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [req-695bd9fc-ee0f-4905-8c9a-727194576572 req-c05cfe50-0e7a-4ff2-86cf-4a49fa1bfbb4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029065 Apr 11 19:33:03 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 194/586] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:33:03 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:33:04 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [req-19967530-5776-4031-b52a-31f96b6b1963 req-bb0d4ee3-4029-4ac4-8b85-a0148fdce4da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "720c683f-c03a-444c-92a8-daf97c9f524b", "name": "network-vif-plugged", "status": "completed", "tag": "9e6087aa-464a-450d-bd04-2653d9420094"}]} {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:33:04 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-19967530-5776-4031-b52a-31f96b6b1963 req-bb0d4ee3-4029-4ac4-8b85-a0148fdce4da service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:33:04 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-19967530-5776-4031-b52a-31f96b6b1963 req-bb0d4ee3-4029-4ac4-8b85-a0148fdce4da service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:33:04 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-19967530-5776-4031-b52a-31f96b6b1963 req-bb0d4ee3-4029-4ac4-8b85-a0148fdce4da service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:33:04 user devstack@n-api.service[72089]: INFO nova.api.openstack.compute.server_external_events [req-19967530-5776-4031-b52a-31f96b6b1963 req-bb0d4ee3-4029-4ac4-8b85-a0148fdce4da service nova] Creating event network-vif-plugged:9e6087aa-464a-450d-bd04-2653d9420094 for instance 720c683f-c03a-444c-92a8-daf97c9f524b on user Apr 11 19:33:04 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [req-19967530-5776-4031-b52a-31f96b6b1963 req-bb0d4ee3-4029-4ac4-8b85-a0148fdce4da service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042319 Apr 11 19:33:04 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 201/587] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:33:04 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:33:14 user devstack@n-api.service[72088]: DEBUG dbcounter [-] [72088] Writing DB stats nova_api:SELECT=6 {{(pid=72088) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:33:14 user devstack@n-api.service[72088]: DEBUG dbcounter [-] [72088] Writing DB stats nova_cell1:SELECT=14 {{(pid=72088) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:33:14 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [None req-7bcf8e6e-43fe-4f8f-a557-d5e81317dccb tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Calling method '>' {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:33:14 user devstack@n-api.service[72088]: DEBUG nova.compute.api [None req-7bcf8e6e-43fe-4f8f-a557-d5e81317dccb tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] [instance: 6802f099-9236-4c79-a892-2963f1b15b0e] Fetching instance by UUID {{(pid=72088) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:33:14 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-7bcf8e6e-43fe-4f8f-a557-d5e81317dccb tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:33:14 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-7bcf8e6e-43fe-4f8f-a557-d5e81317dccb tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:33:14 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-7bcf8e6e-43fe-4f8f-a557-d5e81317dccb tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:33:14 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-7bcf8e6e-43fe-4f8f-a557-d5e81317dccb tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:33:14 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-7bcf8e6e-43fe-4f8f-a557-d5e81317dccb tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:33:14 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-7bcf8e6e-43fe-4f8f-a557-d5e81317dccb tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:33:14 user devstack@n-api.service[72088]: DEBUG nova.policy [None req-7bcf8e6e-43fe-4f8f-a557-d5e81317dccb tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31c237e142784bd6aa460d6f1bf33400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd886d2ec5fc946b49af3c8ca7c8556c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72088) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:33:14 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [None req-7bcf8e6e-43fe-4f8f-a557-d5e81317dccb tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6802f099-9236-4c79-a892-2963f1b15b0e" status: 200 len: 1657 microversion: 2.1 time: 0.161482 Apr 11 19:33:14 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 193/588] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 19:33:14 2023] GET /compute/v2.1/servers/6802f099-9236-4c79-a892-2963f1b15b0e => generated 1657 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:33:32 user devstack@n-api.service[72090]: DEBUG dbcounter [-] [72090] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=72090) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:33:32 user devstack@n-api.service[72090]: DEBUG dbcounter [-] [72090] Writing DB stats nova_cell1:SELECT=23,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=72090) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:33:32 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [None req-7e88e809-5d56-4a3b-92a9-d4495ce0b5a1 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Calling method '>' {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:33:32 user devstack@n-api.service[72090]: DEBUG nova.compute.api [None req-7e88e809-5d56-4a3b-92a9-d4495ce0b5a1 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] [instance: 267c17c1-f0b6-4e18-8c18-5e5bbe8a2251] Fetching instance by UUID {{(pid=72090) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:33:32 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-7e88e809-5d56-4a3b-92a9-d4495ce0b5a1 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:33:32 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-7e88e809-5d56-4a3b-92a9-d4495ce0b5a1 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:33:32 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-7e88e809-5d56-4a3b-92a9-d4495ce0b5a1 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:33:32 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-7e88e809-5d56-4a3b-92a9-d4495ce0b5a1 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:33:32 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-7e88e809-5d56-4a3b-92a9-d4495ce0b5a1 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:33:32 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-7e88e809-5d56-4a3b-92a9-d4495ce0b5a1 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:33:32 user devstack@n-api.service[72090]: DEBUG nova.policy [None req-7e88e809-5d56-4a3b-92a9-d4495ce0b5a1 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba7f82b529e74d99838b6264b94d823b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e3a291c54b49db8e12a88ba41865e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72090) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:33:32 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [None req-7e88e809-5d56-4a3b-92a9-d4495ce0b5a1 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] 10.0.0.210 "GET /compute/v2.1/servers/267c17c1-f0b6-4e18-8c18-5e5bbe8a2251" status: 200 len: 1504 microversion: 2.1 time: 0.197229 Apr 11 19:33:32 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 195/589] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 19:33:32 2023] GET /compute/v2.1/servers/267c17c1-f0b6-4e18-8c18-5e5bbe8a2251 => generated 1504 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:33:34 user devstack@n-api.service[72089]: DEBUG dbcounter [-] [72089] Writing DB stats nova_api:SELECT=8 {{(pid=72089) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:33:34 user devstack@n-api.service[72089]: DEBUG dbcounter [-] [72089] Writing DB stats nova_cell1:SELECT=20 {{(pid=72089) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:33:34 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [None req-1d6fddee-6994-44db-ba8a-1d2fb4153d1a tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Calling method '>' {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:33:34 user devstack@n-api.service[72089]: DEBUG nova.compute.api [None req-1d6fddee-6994-44db-ba8a-1d2fb4153d1a tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] [instance: 647674d8-af53-405a-8116-4b7a01549bdf] Fetching instance by UUID {{(pid=72089) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:33:34 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-1d6fddee-6994-44db-ba8a-1d2fb4153d1a tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:33:34 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-1d6fddee-6994-44db-ba8a-1d2fb4153d1a tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:33:34 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-1d6fddee-6994-44db-ba8a-1d2fb4153d1a tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:33:34 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-1d6fddee-6994-44db-ba8a-1d2fb4153d1a tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:33:34 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-1d6fddee-6994-44db-ba8a-1d2fb4153d1a tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:33:34 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-1d6fddee-6994-44db-ba8a-1d2fb4153d1a tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:33:35 user devstack@n-api.service[72089]: DEBUG nova.objects.instance [None req-1d6fddee-6994-44db-ba8a-1d2fb4153d1a tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lazy-loading 'services' on Instance uuid 647674d8-af53-405a-8116-4b7a01549bdf {{(pid=72089) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 11 19:33:35 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [None req-1d6fddee-6994-44db-ba8a-1d2fb4153d1a tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/647674d8-af53-405a-8116-4b7a01549bdf/os-volume_attachments/443c1e0d-cc51-400f-8525-c5352514ce7f" status: 202 len: 0 microversion: 2.1 time: 0.190588 Apr 11 19:33:35 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 202/590] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Apr 11 19:33:34 2023] DELETE /compute/v2.1/servers/647674d8-af53-405a-8116-4b7a01549bdf/os-volume_attachments/443c1e0d-cc51-400f-8525-c5352514ce7f => generated 0 bytes in 193 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 19:33:35 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [None req-c21ef4fd-e135-43c1-b161-88cfe9e51b04 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Calling method '>' {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:33:35 user devstack@n-api.service[72088]: DEBUG nova.compute.api [None req-c21ef4fd-e135-43c1-b161-88cfe9e51b04 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] [instance: 647674d8-af53-405a-8116-4b7a01549bdf] Fetching instance by UUID {{(pid=72088) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:33:35 user devstack@n-api.service[72088]: DEBUG dbcounter [-] [72088] Writing DB stats nova_api:SELECT=2 {{(pid=72088) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:33:35 user devstack@n-api.service[72088]: DEBUG dbcounter [-] [72088] Writing DB stats nova_cell1:SELECT=6 {{(pid=72088) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:33:35 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-c21ef4fd-e135-43c1-b161-88cfe9e51b04 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:33:35 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-c21ef4fd-e135-43c1-b161-88cfe9e51b04 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:33:35 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-c21ef4fd-e135-43c1-b161-88cfe9e51b04 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:33:35 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-c21ef4fd-e135-43c1-b161-88cfe9e51b04 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:33:35 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-c21ef4fd-e135-43c1-b161-88cfe9e51b04 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:33:35 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-c21ef4fd-e135-43c1-b161-88cfe9e51b04 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:33:35 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [None req-c21ef4fd-e135-43c1-b161-88cfe9e51b04 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] 10.0.0.210 "GET /compute/v2.1/servers/647674d8-af53-405a-8116-4b7a01549bdf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052808 Apr 11 19:33:35 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 194/591] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Apr 11 19:33:35 2023] GET /compute/v2.1/servers/647674d8-af53-405a-8116-4b7a01549bdf/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:33:52 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [None req-92a6b502-454a-4a91-9883-87af06712282 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Calling method '>' {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:33:52 user devstack@n-api.service[72090]: DEBUG nova.compute.api [None req-92a6b502-454a-4a91-9883-87af06712282 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] [instance: 720c683f-c03a-444c-92a8-daf97c9f524b] Fetching instance by UUID {{(pid=72090) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:33:52 user devstack@n-api.service[72090]: DEBUG dbcounter [-] [72090] Writing DB stats nova_api:SELECT=2 {{(pid=72090) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:33:52 user devstack@n-api.service[72090]: DEBUG dbcounter [-] [72090] Writing DB stats nova_cell1:SELECT=6 {{(pid=72090) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:33:52 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-92a6b502-454a-4a91-9883-87af06712282 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:33:52 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-92a6b502-454a-4a91-9883-87af06712282 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:33:52 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-92a6b502-454a-4a91-9883-87af06712282 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:33:52 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-92a6b502-454a-4a91-9883-87af06712282 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:33:52 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-92a6b502-454a-4a91-9883-87af06712282 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:33:52 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-92a6b502-454a-4a91-9883-87af06712282 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:33:52 user devstack@n-api.service[72090]: INFO nova.api.openstack.wsgi [None req-92a6b502-454a-4a91-9883-87af06712282 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] HTTP exception thrown: Instance 720c683f-c03a-444c-92a8-daf97c9f524b could not be found. Apr 11 19:33:52 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [None req-92a6b502-454a-4a91-9883-87af06712282 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Request method failure captured: Apr 11 19:33:52 user devstack@n-api.service[72090]: request: GET /compute/v2.1/servers/720c683f-c03a-444c-92a8-daf97c9f524b HTTP/1.1 Apr 11 19:33:52 user devstack@n-api.service[72090]: Accept: application/json Apr 11 19:33:52 user devstack@n-api.service[72090]: Accept-Encoding: identity Apr 11 19:33:52 user devstack@n-api.service[72090]: Connection: close Apr 11 19:33:52 user devstack@n-api.service[72090]: Content-Length: 0 Apr 11 19:33:52 user devstack@n-api.service[72090]: Content-Type: application/json Apr 11 19:33:52 user devstack@n-api.service[72090]: Host: 10.0.0.210 Apr 11 19:33:52 user devstack@n-api.service[72090]: Openstack-System-Scope: None Apr 11 19:33:52 user devstack@n-api.service[72090]: User-Agent: python-urllib3/1.26.15 Apr 11 19:33:52 user devstack@n-api.service[72090]: X-Auth-Token: gAAAAABkNbRo6INLHGJ-FCpv0R8iTq15NRyXrCaZyB4elcR5LG0Nk6-bMCi5rNIeVdoPHHcD8ZB_4iB72kb-2Ue0k8TYx-9LMGkMAHU2x9eZVwN2smD8CJWUfTZvH8wvldsxkuE9fC9VmRhdCryMAv4uVPMG3wvq6LMuFg7oqVTdqSX0j3JCRq0 Apr 11 19:33:52 user devstack@n-api.service[72090]: X-Domain-Id: None Apr 11 19:33:52 user devstack@n-api.service[72090]: X-Domain-Name: None Apr 11 19:33:52 user devstack@n-api.service[72090]: X-Identity-Status: Confirmed Apr 11 19:33:52 user devstack@n-api.service[72090]: X-Is-Admin-Project: True Apr 11 19:33:52 user devstack@n-api.service[72090]: X-Openstack-Nova-Api-Version: 2.20 Apr 11 19:33:52 user devstack@n-api.service[72090]: X-Project-Domain-Id: default Apr 11 19:33:52 user devstack@n-api.service[72090]: X-Project-Domain-Name: Default Apr 11 19:33:52 user devstack@n-api.service[72090]: X-Project-Id: 8d8b189667e34931aa36149620a036e1 Apr 11 19:33:52 user devstack@n-api.service[72090]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-427928846 Apr 11 19:33:52 user devstack@n-api.service[72090]: X-Role: reader,member Apr 11 19:33:52 user devstack@n-api.service[72090]: X-Roles: reader,member Apr 11 19:33:52 user devstack@n-api.service[72090]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8d8b189667e34931aa36149620a036e1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/8d8b189667e34931aa36149620a036e1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8d8b189667e34931aa36149620a036e1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 11 19:33:52 user devstack@n-api.service[72090]: X-Tenant: tempest-AttachVolumeShelveTestJSON-427928846 Apr 11 19:33:52 user devstack@n-api.service[72090]: X-Tenant-Id: 8d8b189667e34931aa36149620a036e1 Apr 11 19:33:52 user devstack@n-api.service[72090]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-427928846 Apr 11 19:33:52 user devstack@n-api.service[72090]: X-User: tempest-AttachVolumeShelveTestJSON-427928846-project-member Apr 11 19:33:52 user devstack@n-api.service[72090]: X-User-Domain-Id: default Apr 11 19:33:52 user devstack@n-api.service[72090]: X-User-Domain-Name: Default Apr 11 19:33:52 user devstack@n-api.service[72090]: X-User-Id: e0558ba5a2b04d36ba2f2411090cc4e4 Apr 11 19:33:52 user devstack@n-api.service[72090]: X-User-Name: tempest-AttachVolumeShelveTestJSON-427928846-project-member Apr 11 19:33:52 user devstack@n-api.service[72090]: method: > Apr 11 19:33:52 user devstack@n-api.service[72090]: exception: Instance 720c683f-c03a-444c-92a8-daf97c9f524b could not be found. Apr 11 19:33:52 user devstack@n-api.service[72090]: action_args: {'id': '720c683f-c03a-444c-92a8-daf97c9f524b'} Apr 11 19:33:52 user devstack@n-api.service[72090]: {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 19:33:52 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:33:52 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 19:33:52 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 19:33:52 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 19:33:52 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 19:33:52 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 19:33:52 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 19:33:52 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 19:33:52 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 19:33:52 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 720c683f-c03a-444c-92a8-daf97c9f524b could not be found. Apr 11 19:33:52 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi Apr 11 19:33:52 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 19:33:52 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi Apr 11 19:33:52 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:33:52 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 19:33:52 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 19:33:52 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 19:33:52 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 19:33:52 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 19:33:52 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 19:33:52 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 19:33:52 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 19:33:52 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 19:33:52 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 19:33:52 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 19:33:52 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 19:33:52 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 720c683f-c03a-444c-92a8-daf97c9f524b could not be found. Apr 11 19:33:52 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi Apr 11 19:33:52 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 19:33:52 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi Apr 11 19:33:52 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:33:52 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 19:33:52 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 19:33:52 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 19:33:52 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 19:33:52 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 720c683f-c03a-444c-92a8-daf97c9f524b could not be found. Apr 11 19:33:52 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi Apr 11 19:33:52 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [None req-92a6b502-454a-4a91-9883-87af06712282 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Returning 404 to user: Instance 720c683f-c03a-444c-92a8-daf97c9f524b could not be found. {{(pid=72090) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 19:33:52 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [None req-92a6b502-454a-4a91-9883-87af06712282 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] 10.0.0.210 "GET /compute/v2.1/servers/720c683f-c03a-444c-92a8-daf97c9f524b" status: 404 len: 111 microversion: 2.20 time: 0.031524 Apr 11 19:33:52 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 196/592] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 19:33:52 2023] GET /compute/v2.1/servers/720c683f-c03a-444c-92a8-daf97c9f524b => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 11 19:33:52 user devstack@n-api.service[72089]: DEBUG dbcounter [-] [72089] Writing DB stats nova_api:SELECT=2 {{(pid=72089) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:33:52 user devstack@n-api.service[72089]: DEBUG dbcounter [-] [72089] Writing DB stats nova_cell1:SELECT=9,nova_cell1:INSERT=1 {{(pid=72089) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:33:52 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [None req-86693a32-35c5-4bbd-b9f7-1a4cd6899a39 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Calling method '.version_select at 0x7f119da84dc0>' {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:33:52 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [None req-86693a32-35c5-4bbd-b9f7-1a4cd6899a39 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-787762884" status: 204 len: 0 microversion: 2.20 time: 0.031165 Apr 11 19:33:52 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 203/593] 10.0.0.210 () {64 vars in 1336 bytes} [Tue Apr 11 19:33:52 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-787762884 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Apr 11 19:33:52 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [None req-aaaf9a7e-9624-4346-a102-33ab743736fa tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Calling method '>' {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:33:52 user devstack@n-api.service[72088]: DEBUG nova.compute.api [None req-aaaf9a7e-9624-4346-a102-33ab743736fa tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] [instance: e6e3640a-c262-4e2d-a994-2e4312f22871] Fetching instance by UUID {{(pid=72088) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:33:52 user devstack@n-api.service[72088]: DEBUG dbcounter [-] [72088] Writing DB stats nova_api:SELECT=2 {{(pid=72088) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:33:52 user devstack@n-api.service[72088]: DEBUG dbcounter [-] [72088] Writing DB stats nova_cell1:SELECT=6 {{(pid=72088) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:33:52 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-aaaf9a7e-9624-4346-a102-33ab743736fa tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:33:52 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-aaaf9a7e-9624-4346-a102-33ab743736fa tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:33:52 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-aaaf9a7e-9624-4346-a102-33ab743736fa tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:33:52 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-aaaf9a7e-9624-4346-a102-33ab743736fa tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:33:52 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-aaaf9a7e-9624-4346-a102-33ab743736fa tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:33:52 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-aaaf9a7e-9624-4346-a102-33ab743736fa tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:33:52 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [None req-aaaf9a7e-9624-4346-a102-33ab743736fa tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e6e3640a-c262-4e2d-a994-2e4312f22871/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.109299 Apr 11 19:33:52 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 195/594] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Apr 11 19:33:52 2023] GET /compute/v2.1/servers/e6e3640a-c262-4e2d-a994-2e4312f22871/os-interface => generated 283 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:33:53 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [None req-04df5784-7874-4436-b93d-e42c3128b16f tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Action: 'create', calling method: .version_select at 0x7f119d9077f0>, body: {"keypair": {"name": "tempest-keypair-1296340783", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKkkJTr5YuxkpX+fjT2biW1YPqt/B9xeGSfz5eI9idL14cBKKQVv2aWXZgrf6S4OtstSLTh3Ew1HBAxse2BI4QjcaST8i9go9QpbAcGCdV8ckJbY2dhHYp7Im1s1H/H33w=="}} {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:33:53 user devstack@n-api.service[72090]: DEBUG nova.quota [None req-04df5784-7874-4436-b93d-e42c3128b16f tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Getting quotas for project 8d8b189667e34931aa36149620a036e1. Resources: {'key_pairs'} {{(pid=72090) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 19:33:53 user devstack@n-api.service[72090]: DEBUG nova.quota [None req-04df5784-7874-4436-b93d-e42c3128b16f tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Getting quotas for user e0558ba5a2b04d36ba2f2411090cc4e4 and project 8d8b189667e34931aa36149620a036e1. Resources: {'key_pairs'} {{(pid=72090) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 19:33:53 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [None req-04df5784-7874-4436-b93d-e42c3128b16f tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.047024 Apr 11 19:33:53 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 197/595] 10.0.0.210 () {66 vars in 1277 bytes} [Tue Apr 11 19:33:53 2023] POST /compute/v2.1/os-keypairs => generated 401 bytes in 48 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Apr 11 19:33:53 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [req-6c99d4e4-1a6d-4747-afda-a8cec2df2255 req-75f5cab2-3c00-40fe-91cf-fdda4caf6c85 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e6e3640a-c262-4e2d-a994-2e4312f22871", "tag": "183a0478-c117-4fe1-acce-22e4aee440c9"}]} {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:33:53 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-6c99d4e4-1a6d-4747-afda-a8cec2df2255 req-75f5cab2-3c00-40fe-91cf-fdda4caf6c85 service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:33:53 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-6c99d4e4-1a6d-4747-afda-a8cec2df2255 req-75f5cab2-3c00-40fe-91cf-fdda4caf6c85 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:33:53 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-6c99d4e4-1a6d-4747-afda-a8cec2df2255 req-75f5cab2-3c00-40fe-91cf-fdda4caf6c85 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:33:53 user devstack@n-api.service[72089]: INFO nova.api.openstack.compute.server_external_events [req-6c99d4e4-1a6d-4747-afda-a8cec2df2255 req-75f5cab2-3c00-40fe-91cf-fdda4caf6c85 service nova] Creating event network-changed:183a0478-c117-4fe1-acce-22e4aee440c9 for instance e6e3640a-c262-4e2d-a994-2e4312f22871 on user Apr 11 19:33:53 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [req-6c99d4e4-1a6d-4747-afda-a8cec2df2255 req-75f5cab2-3c00-40fe-91cf-fdda4caf6c85 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036292 Apr 11 19:33:53 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 204/596] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:33:53 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:33:53 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [None req-2d409146-2351-4546-b0ca-86570af859f4 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Calling method '>' {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:33:53 user devstack@n-api.service[72088]: DEBUG nova.compute.api [None req-2d409146-2351-4546-b0ca-86570af859f4 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] [instance: e6e3640a-c262-4e2d-a994-2e4312f22871] Fetching instance by UUID {{(pid=72088) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:33:53 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-2d409146-2351-4546-b0ca-86570af859f4 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:33:53 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-2d409146-2351-4546-b0ca-86570af859f4 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:33:53 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-2d409146-2351-4546-b0ca-86570af859f4 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:33:53 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-2d409146-2351-4546-b0ca-86570af859f4 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:33:53 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-2d409146-2351-4546-b0ca-86570af859f4 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:33:53 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-2d409146-2351-4546-b0ca-86570af859f4 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:33:53 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [None req-2d409146-2351-4546-b0ca-86570af859f4 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e6e3640a-c262-4e2d-a994-2e4312f22871/ips" status: 200 len: 108 microversion: 2.1 time: 0.037254 Apr 11 19:33:53 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 196/597] 10.0.0.210 () {62 vars in 1325 bytes} [Tue Apr 11 19:33:53 2023] GET /compute/v2.1/servers/e6e3640a-c262-4e2d-a994-2e4312f22871/ips => generated 108 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:33:55 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [None req-2691374e-7e5c-4dc8-9ca8-b62bf47c3dc1 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1228547187", "imageRef": "4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "0fffcabf-f83f-41a3-b4e9-c67b67b4f814"}], "security_groups": [{"name": "tempest-securitygroup--2034109166"}], "key_name": "tempest-keypair-1296340783", "user_data": "}} {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:33:55 user devstack@n-api.service[72090]: DEBUG nova.network.neutron [None req-2691374e-7e5c-4dc8-9ca8-b62bf47c3dc1 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] validate_networks() for [('0fffcabf-f83f-41a3-b4e9-c67b67b4f814', None, None, None, None, None)] {{(pid=72090) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 11 19:33:55 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [None req-8a3c5049-f2c5-4673-94bf-75e147c9333c tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "97161bc5-290b-4bf0-935f-4ab9ffc18101"}} {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:33:55 user devstack@n-api.service[72089]: DEBUG nova.compute.api [None req-8a3c5049-f2c5-4673-94bf-75e147c9333c tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] [instance: e6e3640a-c262-4e2d-a994-2e4312f22871] Fetching instance by UUID {{(pid=72089) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:33:55 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-8a3c5049-f2c5-4673-94bf-75e147c9333c tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:33:55 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-8a3c5049-f2c5-4673-94bf-75e147c9333c tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:33:55 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-8a3c5049-f2c5-4673-94bf-75e147c9333c tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:33:55 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-8a3c5049-f2c5-4673-94bf-75e147c9333c tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:33:55 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-8a3c5049-f2c5-4673-94bf-75e147c9333c tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:33:55 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-8a3c5049-f2c5-4673-94bf-75e147c9333c tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:33:55 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [None req-8a3c5049-f2c5-4673-94bf-75e147c9333c tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] 10.0.0.210 "POST /compute/v2.1/servers/e6e3640a-c262-4e2d-a994-2e4312f22871/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.287160 Apr 11 19:33:55 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 205/598] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Apr 11 19:33:55 2023] POST /compute/v2.1/servers/e6e3640a-c262-4e2d-a994-2e4312f22871/os-volume_attachments => generated 194 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:33:55 user devstack@n-api.service[72090]: DEBUG nova.virt.hardware [None req-2691374e-7e5c-4dc8-9ca8-b62bf47c3dc1 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Flavor limits 0:0:0 {{(pid=72090) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 19:33:55 user devstack@n-api.service[72090]: DEBUG nova.virt.hardware [None req-2691374e-7e5c-4dc8-9ca8-b62bf47c3dc1 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Image limits 0:0:0 {{(pid=72090) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 19:33:55 user devstack@n-api.service[72090]: DEBUG nova.virt.hardware [None req-2691374e-7e5c-4dc8-9ca8-b62bf47c3dc1 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Flavor pref 0:0:0 {{(pid=72090) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 19:33:55 user devstack@n-api.service[72090]: DEBUG nova.virt.hardware [None req-2691374e-7e5c-4dc8-9ca8-b62bf47c3dc1 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Image pref 0:0:0 {{(pid=72090) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 19:33:55 user devstack@n-api.service[72090]: DEBUG nova.virt.hardware [None req-2691374e-7e5c-4dc8-9ca8-b62bf47c3dc1 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72090) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 19:33:55 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-2691374e-7e5c-4dc8-9ca8-b62bf47c3dc1 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:33:55 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-2691374e-7e5c-4dc8-9ca8-b62bf47c3dc1 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:33:55 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-2691374e-7e5c-4dc8-9ca8-b62bf47c3dc1 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:33:55 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-2691374e-7e5c-4dc8-9ca8-b62bf47c3dc1 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:33:55 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-2691374e-7e5c-4dc8-9ca8-b62bf47c3dc1 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:33:55 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-2691374e-7e5c-4dc8-9ca8-b62bf47c3dc1 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:33:55 user devstack@n-api.service[72090]: DEBUG nova.quota [None req-2691374e-7e5c-4dc8-9ca8-b62bf47c3dc1 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Getting quotas for project 8d8b189667e34931aa36149620a036e1. Resources: {'ram', 'instances', 'cores'} {{(pid=72090) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 19:33:55 user devstack@n-api.service[72090]: DEBUG nova.quota [None req-2691374e-7e5c-4dc8-9ca8-b62bf47c3dc1 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Getting quotas for user e0558ba5a2b04d36ba2f2411090cc4e4 and project 8d8b189667e34931aa36149620a036e1. Resources: {'ram', 'instances', 'cores'} {{(pid=72090) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 19:33:55 user devstack@n-api.service[72090]: DEBUG nova.compute.api [None req-2691374e-7e5c-4dc8-9ca8-b62bf47c3dc1 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Going to run 1 instances... {{(pid=72090) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 11 19:33:55 user devstack@n-api.service[72090]: DEBUG nova.compute.api [None req-2691374e-7e5c-4dc8-9ca8-b62bf47c3dc1 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] [instance: fbfa0825-c7c2-4f04-8c9a-102e238c3816] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=72090) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 11 19:33:55 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [None req-2691374e-7e5c-4dc8-9ca8-b62bf47c3dc1 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.20 time: 0.561487 Apr 11 19:33:55 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 198/599] 10.0.0.210 () {66 vars in 1265 bytes} [Tue Apr 11 19:33:55 2023] POST /compute/v2.1/servers => generated 400 bytes in 563 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 11 19:33:55 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [None req-89d3c9b5-6f6b-459c-9568-c2a170fe7bd9 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Calling method '>' {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:33:55 user devstack@n-api.service[72088]: DEBUG nova.compute.api [None req-89d3c9b5-6f6b-459c-9568-c2a170fe7bd9 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] [instance: fbfa0825-c7c2-4f04-8c9a-102e238c3816] Fetching instance by UUID {{(pid=72088) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:33:55 user devstack@n-api.service[72088]: DEBUG nova.policy [None req-89d3c9b5-6f6b-459c-9568-c2a170fe7bd9 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0558ba5a2b04d36ba2f2411090cc4e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d8b189667e34931aa36149620a036e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72088) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:33:55 user devstack@n-api.service[72088]: DEBUG nova.policy [None req-89d3c9b5-6f6b-459c-9568-c2a170fe7bd9 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0558ba5a2b04d36ba2f2411090cc4e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d8b189667e34931aa36149620a036e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72088) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:33:55 user devstack@n-api.service[72088]: DEBUG nova.policy [None req-89d3c9b5-6f6b-459c-9568-c2a170fe7bd9 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0558ba5a2b04d36ba2f2411090cc4e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d8b189667e34931aa36149620a036e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72088) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:33:55 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [None req-89d3c9b5-6f6b-459c-9568-c2a170fe7bd9 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fbfa0825-c7c2-4f04-8c9a-102e238c3816" status: 200 len: 1276 microversion: 2.20 time: 0.068707 Apr 11 19:33:55 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 197/600] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 19:33:55 2023] GET /compute/v2.1/servers/fbfa0825-c7c2-4f04-8c9a-102e238c3816 => generated 1276 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 19:33:56 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [None req-a9a1cc7d-2bba-473b-b7e4-f28ecbec9fa9 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9f851629-8083-428d-908d-5ab3e8e782f7", "device": "/dev/vdb"}} {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:33:56 user devstack@n-api.service[72089]: DEBUG nova.compute.api [None req-a9a1cc7d-2bba-473b-b7e4-f28ecbec9fa9 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] [instance: 03bb985c-4903-4d0e-98a1-43a9352f4ec6] Fetching instance by UUID {{(pid=72089) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:33:56 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-a9a1cc7d-2bba-473b-b7e4-f28ecbec9fa9 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:33:56 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-a9a1cc7d-2bba-473b-b7e4-f28ecbec9fa9 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:33:56 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-a9a1cc7d-2bba-473b-b7e4-f28ecbec9fa9 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:33:56 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-a9a1cc7d-2bba-473b-b7e4-f28ecbec9fa9 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:33:56 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-a9a1cc7d-2bba-473b-b7e4-f28ecbec9fa9 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:33:56 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-a9a1cc7d-2bba-473b-b7e4-f28ecbec9fa9 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:33:56 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [None req-a9a1cc7d-2bba-473b-b7e4-f28ecbec9fa9 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] 10.0.0.210 "POST /compute/v2.1/servers/03bb985c-4903-4d0e-98a1-43a9352f4ec6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.295107 Apr 11 19:33:56 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 206/601] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Apr 11 19:33:56 2023] POST /compute/v2.1/servers/03bb985c-4903-4d0e-98a1-43a9352f4ec6/os-volume_attachments => generated 194 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:33:58 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [req-96ffad30-3610-407e-a42f-a1adfcaccd1e req-19bee2c8-ab42-4752-a913-b1efb4dcfbf4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fbfa0825-c7c2-4f04-8c9a-102e238c3816", "tag": "0be0dfa4-d8ad-4d32-83ab-a090c0f77f34"}]} {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:33:58 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-96ffad30-3610-407e-a42f-a1adfcaccd1e req-19bee2c8-ab42-4752-a913-b1efb4dcfbf4 service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:33:58 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-96ffad30-3610-407e-a42f-a1adfcaccd1e req-19bee2c8-ab42-4752-a913-b1efb4dcfbf4 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:33:58 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-96ffad30-3610-407e-a42f-a1adfcaccd1e req-19bee2c8-ab42-4752-a913-b1efb4dcfbf4 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:33:58 user devstack@n-api.service[72090]: INFO nova.api.openstack.compute.server_external_events [req-96ffad30-3610-407e-a42f-a1adfcaccd1e req-19bee2c8-ab42-4752-a913-b1efb4dcfbf4 service nova] Creating event network-changed:0be0dfa4-d8ad-4d32-83ab-a090c0f77f34 for instance fbfa0825-c7c2-4f04-8c9a-102e238c3816 on user Apr 11 19:33:58 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [req-96ffad30-3610-407e-a42f-a1adfcaccd1e req-19bee2c8-ab42-4752-a913-b1efb4dcfbf4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029329 Apr 11 19:33:58 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 199/602] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:33:58 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:33:59 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [None req-e4913921-1ae8-474e-8a41-ee9b4327c33b tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerBootFromVolumeStableRescueTest-server-1965367859", "imageRef": "4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b", "flavorRef": "42", "networks": [{"uuid": "eeacad54-05f6-4aba-aed7-13baddfb50e2"}]}} {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:33:59 user devstack@n-api.service[72088]: DEBUG nova.network.neutron [None req-e4913921-1ae8-474e-8a41-ee9b4327c33b tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] validate_networks() for [('eeacad54-05f6-4aba-aed7-13baddfb50e2', None, None, None, None, None)] {{(pid=72088) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 11 19:33:59 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [None req-cd6c556e-1d47-4c06-ae9d-57491a51071b tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Calling method '>' {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:33:59 user devstack@n-api.service[72089]: DEBUG nova.compute.api [None req-cd6c556e-1d47-4c06-ae9d-57491a51071b tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] [instance: cbd5aa3c-f6c9-49e2-8ee7-dcf389c9ed08] Fetching instance by UUID {{(pid=72089) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:33:59 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-cd6c556e-1d47-4c06-ae9d-57491a51071b tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:33:59 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-cd6c556e-1d47-4c06-ae9d-57491a51071b tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:33:59 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-cd6c556e-1d47-4c06-ae9d-57491a51071b tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:33:59 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-cd6c556e-1d47-4c06-ae9d-57491a51071b tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:33:59 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-cd6c556e-1d47-4c06-ae9d-57491a51071b tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:33:59 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-cd6c556e-1d47-4c06-ae9d-57491a51071b tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:33:59 user devstack@n-api.service[72089]: DEBUG nova.policy [None req-cd6c556e-1d47-4c06-ae9d-57491a51071b tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf262cd03f4a41c4956d8784cf37d86d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caba0618fc743e7bfb2dd866a511df9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72089) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:33:59 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [None req-cd6c556e-1d47-4c06-ae9d-57491a51071b tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cbd5aa3c-f6c9-49e2-8ee7-dcf389c9ed08" status: 200 len: 1380 microversion: 2.1 time: 0.202705 Apr 11 19:33:59 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 207/603] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 19:33:59 2023] GET /compute/v2.1/servers/cbd5aa3c-f6c9-49e2-8ee7-dcf389c9ed08 => generated 1380 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 19:34:00 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [None req-94bd6161-1cb0-44a6-a1f9-24653fb488ca tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Calling method '>' {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:34:00 user devstack@n-api.service[72090]: DEBUG nova.compute.api [None req-94bd6161-1cb0-44a6-a1f9-24653fb488ca tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] [instance: cbd5aa3c-f6c9-49e2-8ee7-dcf389c9ed08] Fetching instance by UUID {{(pid=72090) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:34:00 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-94bd6161-1cb0-44a6-a1f9-24653fb488ca tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:34:00 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-94bd6161-1cb0-44a6-a1f9-24653fb488ca tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:34:00 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-94bd6161-1cb0-44a6-a1f9-24653fb488ca tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:34:00 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-94bd6161-1cb0-44a6-a1f9-24653fb488ca tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:34:00 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-94bd6161-1cb0-44a6-a1f9-24653fb488ca tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:34:00 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-94bd6161-1cb0-44a6-a1f9-24653fb488ca tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:34:00 user devstack@n-api.service[72090]: DEBUG nova.policy [None req-94bd6161-1cb0-44a6-a1f9-24653fb488ca tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf262cd03f4a41c4956d8784cf37d86d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caba0618fc743e7bfb2dd866a511df9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72090) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:34:00 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [None req-94bd6161-1cb0-44a6-a1f9-24653fb488ca tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cbd5aa3c-f6c9-49e2-8ee7-dcf389c9ed08" status: 200 len: 1380 microversion: 2.1 time: 0.162809 Apr 11 19:34:00 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 200/604] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 19:34:00 2023] GET /compute/v2.1/servers/cbd5aa3c-f6c9-49e2-8ee7-dcf389c9ed08 => generated 1380 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 19:34:00 user devstack@n-api.service[72088]: DEBUG nova.virt.hardware [None req-e4913921-1ae8-474e-8a41-ee9b4327c33b tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Flavor limits 0:0:0 {{(pid=72088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 19:34:00 user devstack@n-api.service[72088]: DEBUG nova.virt.hardware [None req-e4913921-1ae8-474e-8a41-ee9b4327c33b tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Image limits 0:0:0 {{(pid=72088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 19:34:00 user devstack@n-api.service[72088]: DEBUG nova.virt.hardware [None req-e4913921-1ae8-474e-8a41-ee9b4327c33b tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Flavor pref 0:0:0 {{(pid=72088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 19:34:00 user devstack@n-api.service[72088]: DEBUG nova.virt.hardware [None req-e4913921-1ae8-474e-8a41-ee9b4327c33b tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Image pref 0:0:0 {{(pid=72088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 19:34:00 user devstack@n-api.service[72088]: DEBUG nova.virt.hardware [None req-e4913921-1ae8-474e-8a41-ee9b4327c33b tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 19:34:00 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-e4913921-1ae8-474e-8a41-ee9b4327c33b tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:34:00 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-e4913921-1ae8-474e-8a41-ee9b4327c33b tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:34:00 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-e4913921-1ae8-474e-8a41-ee9b4327c33b tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:34:00 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-e4913921-1ae8-474e-8a41-ee9b4327c33b tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:34:00 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-e4913921-1ae8-474e-8a41-ee9b4327c33b tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:34:00 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-e4913921-1ae8-474e-8a41-ee9b4327c33b tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:34:00 user devstack@n-api.service[72088]: DEBUG nova.quota [None req-e4913921-1ae8-474e-8a41-ee9b4327c33b tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Getting quotas for project eb91586feb3f4a4c84fa8c2183baaf8c. Resources: {'ram', 'instances', 'cores'} {{(pid=72088) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 19:34:00 user devstack@n-api.service[72088]: DEBUG nova.quota [None req-e4913921-1ae8-474e-8a41-ee9b4327c33b tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Getting quotas for user 1b3adca432b04d70818a51d1366f5c6d and project eb91586feb3f4a4c84fa8c2183baaf8c. Resources: {'ram', 'instances', 'cores'} {{(pid=72088) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 19:34:00 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [None req-1f74d1dc-585d-4bab-84f7-3bb21fa98bc1 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Calling method '>' {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:34:00 user devstack@n-api.service[72089]: DEBUG nova.compute.api [None req-1f74d1dc-585d-4bab-84f7-3bb21fa98bc1 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] [instance: cbd5aa3c-f6c9-49e2-8ee7-dcf389c9ed08] Fetching instance by UUID {{(pid=72089) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:34:00 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-1f74d1dc-585d-4bab-84f7-3bb21fa98bc1 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:34:00 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-1f74d1dc-585d-4bab-84f7-3bb21fa98bc1 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:34:00 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-1f74d1dc-585d-4bab-84f7-3bb21fa98bc1 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:34:00 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-1f74d1dc-585d-4bab-84f7-3bb21fa98bc1 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:34:00 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-1f74d1dc-585d-4bab-84f7-3bb21fa98bc1 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:34:00 user devstack@n-api.service[72088]: DEBUG nova.compute.api [None req-e4913921-1ae8-474e-8a41-ee9b4327c33b tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Going to run 1 instances... {{(pid=72088) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 11 19:34:00 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-1f74d1dc-585d-4bab-84f7-3bb21fa98bc1 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:34:00 user devstack@n-api.service[72088]: DEBUG nova.compute.api [None req-e4913921-1ae8-474e-8a41-ee9b4327c33b tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] [instance: b079367a-558e-4920-ad8d-972a8065260c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=72088) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 11 19:34:00 user devstack@n-api.service[72089]: DEBUG nova.compute.api [None req-1f74d1dc-585d-4bab-84f7-3bb21fa98bc1 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] [instance: cbd5aa3c-f6c9-49e2-8ee7-dcf389c9ed08] Going to try to terminate instance {{(pid=72089) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 11 19:34:00 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [None req-e4913921-1ae8-474e-8a41-ee9b4327c33b tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.87 time: 0.682144 Apr 11 19:34:00 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 198/605] 10.0.0.210 () {66 vars in 1265 bytes} [Tue Apr 11 19:33:59 2023] POST /compute/v2.1/servers => generated 378 bytes in 684 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 11 19:34:00 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [None req-e11decb3-af25-46e1-8ba6-75802566c514 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Calling method '>' {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:34:00 user devstack@n-api.service[72090]: DEBUG nova.compute.api [None req-e11decb3-af25-46e1-8ba6-75802566c514 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] [instance: b079367a-558e-4920-ad8d-972a8065260c] Fetching instance by UUID {{(pid=72090) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:34:00 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [None req-1f74d1dc-585d-4bab-84f7-3bb21fa98bc1 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/cbd5aa3c-f6c9-49e2-8ee7-dcf389c9ed08" status: 204 len: 0 microversion: 2.1 time: 0.151367 Apr 11 19:34:00 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 208/606] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 19:34:00 2023] DELETE /compute/v2.1/servers/cbd5aa3c-f6c9-49e2-8ee7-dcf389c9ed08 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 11 19:34:00 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [None req-72cd5881-6c2d-4bdd-a17c-2542c414e431 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Calling method '>' {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:34:00 user devstack@n-api.service[72088]: DEBUG nova.compute.api [None req-72cd5881-6c2d-4bdd-a17c-2542c414e431 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] [instance: cbd5aa3c-f6c9-49e2-8ee7-dcf389c9ed08] Fetching instance by UUID {{(pid=72088) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:34:00 user devstack@n-api.service[72090]: DEBUG nova.policy [None req-e11decb3-af25-46e1-8ba6-75802566c514 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b3adca432b04d70818a51d1366f5c6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb91586feb3f4a4c84fa8c2183baaf8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72090) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:34:00 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-72cd5881-6c2d-4bdd-a17c-2542c414e431 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:34:00 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-72cd5881-6c2d-4bdd-a17c-2542c414e431 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:34:00 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-72cd5881-6c2d-4bdd-a17c-2542c414e431 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:34:00 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-72cd5881-6c2d-4bdd-a17c-2542c414e431 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:34:00 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-72cd5881-6c2d-4bdd-a17c-2542c414e431 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:34:00 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-72cd5881-6c2d-4bdd-a17c-2542c414e431 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:34:00 user devstack@n-api.service[72090]: DEBUG nova.policy [None req-e11decb3-af25-46e1-8ba6-75802566c514 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b3adca432b04d70818a51d1366f5c6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb91586feb3f4a4c84fa8c2183baaf8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72090) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:34:00 user devstack@n-api.service[72090]: DEBUG nova.policy [None req-e11decb3-af25-46e1-8ba6-75802566c514 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b3adca432b04d70818a51d1366f5c6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb91586feb3f4a4c84fa8c2183baaf8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72090) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:34:00 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [None req-e11decb3-af25-46e1-8ba6-75802566c514 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b079367a-558e-4920-ad8d-972a8065260c" status: 200 len: 1395 microversion: 2.87 time: 0.119047 Apr 11 19:34:00 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 201/607] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 19:34:00 2023] GET /compute/v2.1/servers/b079367a-558e-4920-ad8d-972a8065260c => generated 1395 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 19:34:00 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [req-3d9c7e8e-26cc-4969-a0c3-8b6e5786550a req-9bbfa250-5995-44c5-9d85-08c8256b2cb3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fbfa0825-c7c2-4f04-8c9a-102e238c3816", "name": "network-vif-plugged", "status": "completed", "tag": "0be0dfa4-d8ad-4d32-83ab-a090c0f77f34"}]} {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:34:00 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-3d9c7e8e-26cc-4969-a0c3-8b6e5786550a req-9bbfa250-5995-44c5-9d85-08c8256b2cb3 service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:34:00 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-3d9c7e8e-26cc-4969-a0c3-8b6e5786550a req-9bbfa250-5995-44c5-9d85-08c8256b2cb3 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:34:00 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-3d9c7e8e-26cc-4969-a0c3-8b6e5786550a req-9bbfa250-5995-44c5-9d85-08c8256b2cb3 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:34:00 user devstack@n-api.service[72089]: INFO nova.api.openstack.compute.server_external_events [req-3d9c7e8e-26cc-4969-a0c3-8b6e5786550a req-9bbfa250-5995-44c5-9d85-08c8256b2cb3 service nova] Creating event network-vif-plugged:0be0dfa4-d8ad-4d32-83ab-a090c0f77f34 for instance fbfa0825-c7c2-4f04-8c9a-102e238c3816 on user Apr 11 19:34:00 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [req-3d9c7e8e-26cc-4969-a0c3-8b6e5786550a req-9bbfa250-5995-44c5-9d85-08c8256b2cb3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035349 Apr 11 19:34:00 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 209/608] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:34:00 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:34:00 user devstack@n-api.service[72088]: DEBUG nova.policy [None req-72cd5881-6c2d-4bdd-a17c-2542c414e431 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf262cd03f4a41c4956d8784cf37d86d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caba0618fc743e7bfb2dd866a511df9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72088) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:34:00 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [None req-72cd5881-6c2d-4bdd-a17c-2542c414e431 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cbd5aa3c-f6c9-49e2-8ee7-dcf389c9ed08" status: 200 len: 1386 microversion: 2.1 time: 0.240751 Apr 11 19:34:00 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 199/609] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 19:34:00 2023] GET /compute/v2.1/servers/cbd5aa3c-f6c9-49e2-8ee7-dcf389c9ed08 => generated 1386 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:34:00 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [req-895b16cc-db18-4011-963a-f2d7c84da3fa req-dee1c8d7-ba79-43f9-bed6-3deac5ad17a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cbd5aa3c-f6c9-49e2-8ee7-dcf389c9ed08", "name": "network-vif-unplugged", "status": "completed", "tag": "07039db4-244e-4941-ae2b-5f396531e40d"}]} {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:34:00 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-895b16cc-db18-4011-963a-f2d7c84da3fa req-dee1c8d7-ba79-43f9-bed6-3deac5ad17a7 service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:34:00 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-895b16cc-db18-4011-963a-f2d7c84da3fa req-dee1c8d7-ba79-43f9-bed6-3deac5ad17a7 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:34:00 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-895b16cc-db18-4011-963a-f2d7c84da3fa req-dee1c8d7-ba79-43f9-bed6-3deac5ad17a7 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:34:00 user devstack@n-api.service[72090]: INFO nova.api.openstack.compute.server_external_events [req-895b16cc-db18-4011-963a-f2d7c84da3fa req-dee1c8d7-ba79-43f9-bed6-3deac5ad17a7 service nova] Creating event network-vif-unplugged:07039db4-244e-4941-ae2b-5f396531e40d for instance cbd5aa3c-f6c9-49e2-8ee7-dcf389c9ed08 on user Apr 11 19:34:00 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [req-895b16cc-db18-4011-963a-f2d7c84da3fa req-dee1c8d7-ba79-43f9-bed6-3deac5ad17a7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.038252 Apr 11 19:34:00 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 202/610] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:34:00 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:34:02 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [None req-222fdbcf-2a59-4779-b822-e5be35336bf4 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Calling method '>' {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:34:02 user devstack@n-api.service[72089]: DEBUG nova.compute.api [None req-222fdbcf-2a59-4779-b822-e5be35336bf4 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] [instance: e6e3640a-c262-4e2d-a994-2e4312f22871] Fetching instance by UUID {{(pid=72089) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:34:02 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-222fdbcf-2a59-4779-b822-e5be35336bf4 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:34:02 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-222fdbcf-2a59-4779-b822-e5be35336bf4 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:34:02 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-222fdbcf-2a59-4779-b822-e5be35336bf4 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:34:02 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-222fdbcf-2a59-4779-b822-e5be35336bf4 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:34:02 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-222fdbcf-2a59-4779-b822-e5be35336bf4 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:34:02 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-222fdbcf-2a59-4779-b822-e5be35336bf4 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:34:02 user devstack@n-api.service[72089]: DEBUG nova.objects.instance [None req-222fdbcf-2a59-4779-b822-e5be35336bf4 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Lazy-loading 'services' on Instance uuid e6e3640a-c262-4e2d-a994-2e4312f22871 {{(pid=72089) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 11 19:34:02 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [None req-222fdbcf-2a59-4779-b822-e5be35336bf4 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/e6e3640a-c262-4e2d-a994-2e4312f22871/os-volume_attachments/97161bc5-290b-4bf0-935f-4ab9ffc18101" status: 202 len: 0 microversion: 2.1 time: 0.155981 Apr 11 19:34:02 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 210/611] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Apr 11 19:34:02 2023] DELETE /compute/v2.1/servers/e6e3640a-c262-4e2d-a994-2e4312f22871/os-volume_attachments/97161bc5-290b-4bf0-935f-4ab9ffc18101 => generated 0 bytes in 158 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 19:34:02 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [None req-0c4dd12c-42a8-40d8-8fbc-514095fb1bc7 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Calling method '>' {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:34:02 user devstack@n-api.service[72088]: DEBUG nova.compute.api [None req-0c4dd12c-42a8-40d8-8fbc-514095fb1bc7 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] [instance: e6e3640a-c262-4e2d-a994-2e4312f22871] Fetching instance by UUID {{(pid=72088) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:34:02 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-0c4dd12c-42a8-40d8-8fbc-514095fb1bc7 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:34:02 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-0c4dd12c-42a8-40d8-8fbc-514095fb1bc7 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:34:02 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-0c4dd12c-42a8-40d8-8fbc-514095fb1bc7 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:34:02 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-0c4dd12c-42a8-40d8-8fbc-514095fb1bc7 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:34:02 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-0c4dd12c-42a8-40d8-8fbc-514095fb1bc7 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:34:02 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-0c4dd12c-42a8-40d8-8fbc-514095fb1bc7 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:34:02 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [None req-0c4dd12c-42a8-40d8-8fbc-514095fb1bc7 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e6e3640a-c262-4e2d-a994-2e4312f22871/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041768 Apr 11 19:34:02 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 200/612] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Apr 11 19:34:02 2023] GET /compute/v2.1/servers/e6e3640a-c262-4e2d-a994-2e4312f22871/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:34:02 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [req-f3ed1f58-814e-47b4-926e-50e4b2f01a6c req-59b30f58-6b11-4d0f-997a-39a8512b3163 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fbfa0825-c7c2-4f04-8c9a-102e238c3816", "name": "network-vif-plugged", "status": "completed", "tag": "0be0dfa4-d8ad-4d32-83ab-a090c0f77f34"}]} {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:34:02 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-f3ed1f58-814e-47b4-926e-50e4b2f01a6c req-59b30f58-6b11-4d0f-997a-39a8512b3163 service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:34:02 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-f3ed1f58-814e-47b4-926e-50e4b2f01a6c req-59b30f58-6b11-4d0f-997a-39a8512b3163 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:34:02 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-f3ed1f58-814e-47b4-926e-50e4b2f01a6c req-59b30f58-6b11-4d0f-997a-39a8512b3163 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:34:02 user devstack@n-api.service[72090]: INFO nova.api.openstack.compute.server_external_events [req-f3ed1f58-814e-47b4-926e-50e4b2f01a6c req-59b30f58-6b11-4d0f-997a-39a8512b3163 service nova] Creating event network-vif-plugged:0be0dfa4-d8ad-4d32-83ab-a090c0f77f34 for instance fbfa0825-c7c2-4f04-8c9a-102e238c3816 on user Apr 11 19:34:02 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [req-f3ed1f58-814e-47b4-926e-50e4b2f01a6c req-59b30f58-6b11-4d0f-997a-39a8512b3163 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038419 Apr 11 19:34:02 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 203/613] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:34:02 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:34:03 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [req-83f1d004-d350-4287-a435-e71ff32fc34e req-922ecf3d-a84c-4344-895e-a2f61b455ccb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cbd5aa3c-f6c9-49e2-8ee7-dcf389c9ed08", "name": "network-vif-plugged", "status": "completed", "tag": "07039db4-244e-4941-ae2b-5f396531e40d"}]} {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:34:03 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-83f1d004-d350-4287-a435-e71ff32fc34e req-922ecf3d-a84c-4344-895e-a2f61b455ccb service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:34:03 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-83f1d004-d350-4287-a435-e71ff32fc34e req-922ecf3d-a84c-4344-895e-a2f61b455ccb service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:34:03 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-83f1d004-d350-4287-a435-e71ff32fc34e req-922ecf3d-a84c-4344-895e-a2f61b455ccb service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:34:03 user devstack@n-api.service[72089]: INFO nova.api.openstack.compute.server_external_events [req-83f1d004-d350-4287-a435-e71ff32fc34e req-922ecf3d-a84c-4344-895e-a2f61b455ccb service nova] Creating event network-vif-plugged:07039db4-244e-4941-ae2b-5f396531e40d for instance cbd5aa3c-f6c9-49e2-8ee7-dcf389c9ed08 on user Apr 11 19:34:03 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [req-83f1d004-d350-4287-a435-e71ff32fc34e req-922ecf3d-a84c-4344-895e-a2f61b455ccb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047624 Apr 11 19:34:03 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 211/614] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:34:03 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:34:04 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [req-42abf785-9b62-4838-b1ed-f12a18023c8e req-13afcedb-aa22-4b2c-b562-eb23749040ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cbd5aa3c-f6c9-49e2-8ee7-dcf389c9ed08", "name": "network-vif-deleted", "tag": "07039db4-244e-4941-ae2b-5f396531e40d"}]} {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:34:04 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-42abf785-9b62-4838-b1ed-f12a18023c8e req-13afcedb-aa22-4b2c-b562-eb23749040ba service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:34:04 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-42abf785-9b62-4838-b1ed-f12a18023c8e req-13afcedb-aa22-4b2c-b562-eb23749040ba service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:34:04 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-42abf785-9b62-4838-b1ed-f12a18023c8e req-13afcedb-aa22-4b2c-b562-eb23749040ba service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:34:04 user devstack@n-api.service[72088]: INFO nova.api.openstack.compute.server_external_events [req-42abf785-9b62-4838-b1ed-f12a18023c8e req-13afcedb-aa22-4b2c-b562-eb23749040ba service nova] Creating event network-vif-deleted:07039db4-244e-4941-ae2b-5f396531e40d for instance cbd5aa3c-f6c9-49e2-8ee7-dcf389c9ed08 on user Apr 11 19:34:04 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [req-42abf785-9b62-4838-b1ed-f12a18023c8e req-13afcedb-aa22-4b2c-b562-eb23749040ba service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034269 Apr 11 19:34:04 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 201/615] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:34:04 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 11 19:34:05 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [req-62e18b75-7758-43b6-a601-edb397df52c8 req-5e8eeff5-a2af-46e0-b334-7b6d6045a2cb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b079367a-558e-4920-ad8d-972a8065260c", "tag": "54168103-37cf-4abe-a4e5-bac3eeeca578"}]} {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:34:05 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-62e18b75-7758-43b6-a601-edb397df52c8 req-5e8eeff5-a2af-46e0-b334-7b6d6045a2cb service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:34:05 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-62e18b75-7758-43b6-a601-edb397df52c8 req-5e8eeff5-a2af-46e0-b334-7b6d6045a2cb service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:34:05 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-62e18b75-7758-43b6-a601-edb397df52c8 req-5e8eeff5-a2af-46e0-b334-7b6d6045a2cb service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:34:05 user devstack@n-api.service[72090]: INFO nova.api.openstack.compute.server_external_events [req-62e18b75-7758-43b6-a601-edb397df52c8 req-5e8eeff5-a2af-46e0-b334-7b6d6045a2cb service nova] Creating event network-changed:54168103-37cf-4abe-a4e5-bac3eeeca578 for instance b079367a-558e-4920-ad8d-972a8065260c on user Apr 11 19:34:05 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [req-62e18b75-7758-43b6-a601-edb397df52c8 req-5e8eeff5-a2af-46e0-b334-7b6d6045a2cb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033026 Apr 11 19:34:05 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 204/616] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:34:05 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:34:06 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [req-646910c8-b013-4db5-9230-76153d16b9d6 req-1f24bb63-4889-4632-94cf-344cfdb68b9a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b079367a-558e-4920-ad8d-972a8065260c", "name": "network-vif-plugged", "status": "completed", "tag": "54168103-37cf-4abe-a4e5-bac3eeeca578"}, {"server_uuid": "b079367a-558e-4920-ad8d-972a8065260c", "name": "network-vif-plugged", "status": "completed", "tag": "54168103-37cf-4abe-a4e5-bac3eeeca578"}]} {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:34:06 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-646910c8-b013-4db5-9230-76153d16b9d6 req-1f24bb63-4889-4632-94cf-344cfdb68b9a service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:34:06 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-646910c8-b013-4db5-9230-76153d16b9d6 req-1f24bb63-4889-4632-94cf-344cfdb68b9a service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:34:06 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-646910c8-b013-4db5-9230-76153d16b9d6 req-1f24bb63-4889-4632-94cf-344cfdb68b9a service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:34:06 user devstack@n-api.service[72089]: INFO nova.api.openstack.compute.server_external_events [req-646910c8-b013-4db5-9230-76153d16b9d6 req-1f24bb63-4889-4632-94cf-344cfdb68b9a service nova] Creating event network-vif-plugged:54168103-37cf-4abe-a4e5-bac3eeeca578 for instance b079367a-558e-4920-ad8d-972a8065260c on user Apr 11 19:34:06 user devstack@n-api.service[72089]: INFO nova.api.openstack.compute.server_external_events [req-646910c8-b013-4db5-9230-76153d16b9d6 req-1f24bb63-4889-4632-94cf-344cfdb68b9a service nova] Creating event network-vif-plugged:54168103-37cf-4abe-a4e5-bac3eeeca578 for instance b079367a-558e-4920-ad8d-972a8065260c on user Apr 11 19:34:06 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [req-646910c8-b013-4db5-9230-76153d16b9d6 req-1f24bb63-4889-4632-94cf-344cfdb68b9a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.031122 Apr 11 19:34:06 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 212/617] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:34:06 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:34:11 user devstack@n-api.service[72088]: DEBUG dbcounter [-] [72088] Writing DB stats nova_cell0:SELECT=2 {{(pid=72088) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:34:11 user devstack@n-api.service[72088]: DEBUG dbcounter [-] [72088] Writing DB stats nova_cell0:SELECT=8 {{(pid=72088) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:34:11 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [None req-ee8e63c2-b0fc-407a-ae31-0e2c5e338498 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Calling method '>' {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:34:11 user devstack@n-api.service[72088]: DEBUG nova.compute.api [None req-ee8e63c2-b0fc-407a-ae31-0e2c5e338498 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] [instance: 03bb985c-4903-4d0e-98a1-43a9352f4ec6] Fetching instance by UUID {{(pid=72088) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:34:11 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-ee8e63c2-b0fc-407a-ae31-0e2c5e338498 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:34:11 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-ee8e63c2-b0fc-407a-ae31-0e2c5e338498 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:34:11 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-ee8e63c2-b0fc-407a-ae31-0e2c5e338498 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:34:11 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-ee8e63c2-b0fc-407a-ae31-0e2c5e338498 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:34:11 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-ee8e63c2-b0fc-407a-ae31-0e2c5e338498 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:34:11 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-ee8e63c2-b0fc-407a-ae31-0e2c5e338498 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:34:11 user devstack@n-api.service[72088]: DEBUG nova.objects.instance [None req-ee8e63c2-b0fc-407a-ae31-0e2c5e338498 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Lazy-loading 'services' on Instance uuid 03bb985c-4903-4d0e-98a1-43a9352f4ec6 {{(pid=72088) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 11 19:34:11 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [None req-ee8e63c2-b0fc-407a-ae31-0e2c5e338498 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/03bb985c-4903-4d0e-98a1-43a9352f4ec6/os-volume_attachments/9f851629-8083-428d-908d-5ab3e8e782f7" status: 202 len: 0 microversion: 2.1 time: 0.208514 Apr 11 19:34:11 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 202/618] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Apr 11 19:34:11 2023] DELETE /compute/v2.1/servers/03bb985c-4903-4d0e-98a1-43a9352f4ec6/os-volume_attachments/9f851629-8083-428d-908d-5ab3e8e782f7 => generated 0 bytes in 211 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 19:34:11 user devstack@n-api.service[72090]: DEBUG dbcounter [-] [72090] Writing DB stats nova_cell0:SELECT=2 {{(pid=72090) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:34:11 user devstack@n-api.service[72090]: DEBUG dbcounter [-] [72090] Writing DB stats nova_cell0:SELECT=12 {{(pid=72090) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:34:11 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [None req-03d27963-1f01-4a13-9372-9af9ec36c9c9 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Calling method '>' {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:34:11 user devstack@n-api.service[72090]: DEBUG nova.compute.api [None req-03d27963-1f01-4a13-9372-9af9ec36c9c9 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] [instance: 03bb985c-4903-4d0e-98a1-43a9352f4ec6] Fetching instance by UUID {{(pid=72090) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:34:11 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-03d27963-1f01-4a13-9372-9af9ec36c9c9 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:34:11 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-03d27963-1f01-4a13-9372-9af9ec36c9c9 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:34:11 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-03d27963-1f01-4a13-9372-9af9ec36c9c9 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:34:11 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-03d27963-1f01-4a13-9372-9af9ec36c9c9 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:34:11 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-03d27963-1f01-4a13-9372-9af9ec36c9c9 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:34:11 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-03d27963-1f01-4a13-9372-9af9ec36c9c9 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:34:11 user devstack@n-api.service[72090]: DEBUG nova.compute.api [None req-03d27963-1f01-4a13-9372-9af9ec36c9c9 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] [instance: 03bb985c-4903-4d0e-98a1-43a9352f4ec6] Going to try to terminate instance {{(pid=72090) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 11 19:34:11 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [None req-03d27963-1f01-4a13-9372-9af9ec36c9c9 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/03bb985c-4903-4d0e-98a1-43a9352f4ec6" status: 204 len: 0 microversion: 2.1 time: 0.135640 Apr 11 19:34:11 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 205/619] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 19:34:11 2023] DELETE /compute/v2.1/servers/03bb985c-4903-4d0e-98a1-43a9352f4ec6 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 11 19:34:11 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [None req-6e4e00a1-15ea-4c6f-b75a-3d69ebb3aa18 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Calling method '>' {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:34:11 user devstack@n-api.service[72089]: DEBUG nova.compute.api [None req-6e4e00a1-15ea-4c6f-b75a-3d69ebb3aa18 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] [instance: 03bb985c-4903-4d0e-98a1-43a9352f4ec6] Fetching instance by UUID {{(pid=72089) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:34:11 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-6e4e00a1-15ea-4c6f-b75a-3d69ebb3aa18 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:34:11 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-6e4e00a1-15ea-4c6f-b75a-3d69ebb3aa18 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:34:11 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-6e4e00a1-15ea-4c6f-b75a-3d69ebb3aa18 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:34:11 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-6e4e00a1-15ea-4c6f-b75a-3d69ebb3aa18 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:34:11 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-6e4e00a1-15ea-4c6f-b75a-3d69ebb3aa18 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:34:11 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-6e4e00a1-15ea-4c6f-b75a-3d69ebb3aa18 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:34:11 user devstack@n-api.service[72089]: DEBUG nova.policy [None req-6e4e00a1-15ea-4c6f-b75a-3d69ebb3aa18 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20f337feb0ed4653976ace530bfdd877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d5246cf04a7401388cba38d16e298ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72089) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:34:11 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [None req-6e4e00a1-15ea-4c6f-b75a-3d69ebb3aa18 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] 10.0.0.210 "GET /compute/v2.1/servers/03bb985c-4903-4d0e-98a1-43a9352f4ec6" status: 200 len: 1548 microversion: 2.1 time: 0.222937 Apr 11 19:34:11 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 213/620] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 19:34:11 2023] GET /compute/v2.1/servers/03bb985c-4903-4d0e-98a1-43a9352f4ec6 => generated 1548 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:34:13 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [req-83a94fa3-17fe-4d50-84ce-46d40c32c902 req-4b18e4f8-fc2b-471b-af1b-ad2ec798759b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03bb985c-4903-4d0e-98a1-43a9352f4ec6", "name": "network-vif-unplugged", "status": "completed", "tag": "2da07e24-d185-4553-ab56-819067f03d48"}]} {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:34:13 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-83a94fa3-17fe-4d50-84ce-46d40c32c902 req-4b18e4f8-fc2b-471b-af1b-ad2ec798759b service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:34:13 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-83a94fa3-17fe-4d50-84ce-46d40c32c902 req-4b18e4f8-fc2b-471b-af1b-ad2ec798759b service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:34:13 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-83a94fa3-17fe-4d50-84ce-46d40c32c902 req-4b18e4f8-fc2b-471b-af1b-ad2ec798759b service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:34:13 user devstack@n-api.service[72088]: INFO nova.api.openstack.compute.server_external_events [req-83a94fa3-17fe-4d50-84ce-46d40c32c902 req-4b18e4f8-fc2b-471b-af1b-ad2ec798759b service nova] Creating event network-vif-unplugged:2da07e24-d185-4553-ab56-819067f03d48 for instance 03bb985c-4903-4d0e-98a1-43a9352f4ec6 on user Apr 11 19:34:13 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [req-83a94fa3-17fe-4d50-84ce-46d40c32c902 req-4b18e4f8-fc2b-471b-af1b-ad2ec798759b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.029764 Apr 11 19:34:13 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 203/621] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:34:13 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:34:14 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [None req-41bc8d03-bffd-487c-a1f8-030ab8b82be8 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Calling method '>' {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:34:14 user devstack@n-api.service[72090]: DEBUG nova.compute.api [None req-41bc8d03-bffd-487c-a1f8-030ab8b82be8 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] [instance: 6802f099-9236-4c79-a892-2963f1b15b0e] Fetching instance by UUID {{(pid=72090) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:34:14 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-41bc8d03-bffd-487c-a1f8-030ab8b82be8 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:34:14 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-41bc8d03-bffd-487c-a1f8-030ab8b82be8 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:34:14 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-41bc8d03-bffd-487c-a1f8-030ab8b82be8 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:34:14 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-41bc8d03-bffd-487c-a1f8-030ab8b82be8 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:34:14 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-41bc8d03-bffd-487c-a1f8-030ab8b82be8 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:34:14 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-41bc8d03-bffd-487c-a1f8-030ab8b82be8 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:34:14 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [None req-41bc8d03-bffd-487c-a1f8-030ab8b82be8 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6802f099-9236-4c79-a892-2963f1b15b0e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.052535 Apr 11 19:34:14 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 206/622] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Apr 11 19:34:14 2023] GET /compute/v2.1/servers/6802f099-9236-4c79-a892-2963f1b15b0e/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 11 19:34:14 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [None req-dee7959c-7e20-4ddc-b4d5-e2024be3b2d1 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Calling method '>' {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:34:14 user devstack@n-api.service[72089]: DEBUG nova.compute.api [None req-dee7959c-7e20-4ddc-b4d5-e2024be3b2d1 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] [instance: 6802f099-9236-4c79-a892-2963f1b15b0e] Fetching instance by UUID {{(pid=72089) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:34:14 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-dee7959c-7e20-4ddc-b4d5-e2024be3b2d1 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:34:14 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-dee7959c-7e20-4ddc-b4d5-e2024be3b2d1 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:34:14 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-dee7959c-7e20-4ddc-b4d5-e2024be3b2d1 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:34:14 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-dee7959c-7e20-4ddc-b4d5-e2024be3b2d1 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:34:14 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-dee7959c-7e20-4ddc-b4d5-e2024be3b2d1 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:34:14 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-dee7959c-7e20-4ddc-b4d5-e2024be3b2d1 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:34:14 user devstack@n-api.service[72089]: DEBUG nova.compute.api [None req-dee7959c-7e20-4ddc-b4d5-e2024be3b2d1 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] [instance: 6802f099-9236-4c79-a892-2963f1b15b0e] Going to try to terminate instance {{(pid=72089) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 11 19:34:14 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [None req-dee7959c-7e20-4ddc-b4d5-e2024be3b2d1 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/6802f099-9236-4c79-a892-2963f1b15b0e" status: 204 len: 0 microversion: 2.1 time: 0.133337 Apr 11 19:34:14 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 214/623] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 19:34:14 2023] DELETE /compute/v2.1/servers/6802f099-9236-4c79-a892-2963f1b15b0e => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 11 19:34:14 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [None req-99cb3f4a-5695-4aa0-869b-d9ebbe3b02ae tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Calling method '>' {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:34:14 user devstack@n-api.service[72088]: DEBUG nova.compute.api [None req-99cb3f4a-5695-4aa0-869b-d9ebbe3b02ae tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] [instance: 6802f099-9236-4c79-a892-2963f1b15b0e] Fetching instance by UUID {{(pid=72088) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:34:14 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-99cb3f4a-5695-4aa0-869b-d9ebbe3b02ae tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:34:14 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-99cb3f4a-5695-4aa0-869b-d9ebbe3b02ae tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:34:14 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-99cb3f4a-5695-4aa0-869b-d9ebbe3b02ae tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:34:14 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-99cb3f4a-5695-4aa0-869b-d9ebbe3b02ae tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:34:14 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-99cb3f4a-5695-4aa0-869b-d9ebbe3b02ae tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:34:14 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-99cb3f4a-5695-4aa0-869b-d9ebbe3b02ae tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:34:15 user devstack@n-api.service[72088]: DEBUG nova.policy [None req-99cb3f4a-5695-4aa0-869b-d9ebbe3b02ae tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31c237e142784bd6aa460d6f1bf33400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd886d2ec5fc946b49af3c8ca7c8556c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72088) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:34:15 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [None req-99cb3f4a-5695-4aa0-869b-d9ebbe3b02ae tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6802f099-9236-4c79-a892-2963f1b15b0e" status: 200 len: 1663 microversion: 2.1 time: 0.229994 Apr 11 19:34:15 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 204/624] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 19:34:14 2023] GET /compute/v2.1/servers/6802f099-9236-4c79-a892-2963f1b15b0e => generated 1663 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:34:15 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [req-f18861af-a0bf-455a-9ec4-f7b5514a006e req-c1bb124f-4c3a-41e2-84b5-85fd428c8c00 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03bb985c-4903-4d0e-98a1-43a9352f4ec6", "name": "network-vif-plugged", "status": "completed", "tag": "2da07e24-d185-4553-ab56-819067f03d48"}, {"server_uuid": "03bb985c-4903-4d0e-98a1-43a9352f4ec6", "name": "network-vif-deleted", "tag": "2da07e24-d185-4553-ab56-819067f03d48"}, {"server_uuid": "6802f099-9236-4c79-a892-2963f1b15b0e", "name": "network-vif-unplugged", "status": "completed", "tag": "6193819b-0c1b-476b-b89e-dbbfc7938fc5"}, {"server_uuid": "6802f099-9236-4c79-a892-2963f1b15b0e", "name": "network-vif-plugged", "status": "completed", "tag": "6193819b-0c1b-476b-b89e-dbbfc7938fc5"}]} {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:34:15 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-f18861af-a0bf-455a-9ec4-f7b5514a006e req-c1bb124f-4c3a-41e2-84b5-85fd428c8c00 service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:34:15 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-f18861af-a0bf-455a-9ec4-f7b5514a006e req-c1bb124f-4c3a-41e2-84b5-85fd428c8c00 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:34:15 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-f18861af-a0bf-455a-9ec4-f7b5514a006e req-c1bb124f-4c3a-41e2-84b5-85fd428c8c00 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:34:15 user devstack@n-api.service[72090]: INFO nova.api.openstack.compute.server_external_events [req-f18861af-a0bf-455a-9ec4-f7b5514a006e req-c1bb124f-4c3a-41e2-84b5-85fd428c8c00 service nova] Creating event network-vif-plugged:2da07e24-d185-4553-ab56-819067f03d48 for instance 03bb985c-4903-4d0e-98a1-43a9352f4ec6 on user Apr 11 19:34:15 user devstack@n-api.service[72090]: INFO nova.api.openstack.compute.server_external_events [req-f18861af-a0bf-455a-9ec4-f7b5514a006e req-c1bb124f-4c3a-41e2-84b5-85fd428c8c00 service nova] Creating event network-vif-deleted:2da07e24-d185-4553-ab56-819067f03d48 for instance 03bb985c-4903-4d0e-98a1-43a9352f4ec6 on user Apr 11 19:34:15 user devstack@n-api.service[72090]: INFO nova.api.openstack.compute.server_external_events [req-f18861af-a0bf-455a-9ec4-f7b5514a006e req-c1bb124f-4c3a-41e2-84b5-85fd428c8c00 service nova] Creating event network-vif-unplugged:6193819b-0c1b-476b-b89e-dbbfc7938fc5 for instance 6802f099-9236-4c79-a892-2963f1b15b0e on user Apr 11 19:34:15 user devstack@n-api.service[72090]: INFO nova.api.openstack.compute.server_external_events [req-f18861af-a0bf-455a-9ec4-f7b5514a006e req-c1bb124f-4c3a-41e2-84b5-85fd428c8c00 service nova] Creating event network-vif-plugged:6193819b-0c1b-476b-b89e-dbbfc7938fc5 for instance 6802f099-9236-4c79-a892-2963f1b15b0e on user Apr 11 19:34:15 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [req-f18861af-a0bf-455a-9ec4-f7b5514a006e req-c1bb124f-4c3a-41e2-84b5-85fd428c8c00 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 698 microversion: 2.1 time: 0.032522 Apr 11 19:34:15 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 207/625] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:34:15 2023] POST /compute/v2.1/os-server-external-events => generated 698 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:34:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [req-2d525ecb-80c6-4cf2-bbe5-38b6fa0f2d43 req-9404ef0c-f600-4c91-b4d4-45fd6b3b1d4d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6802f099-9236-4c79-a892-2963f1b15b0e", "name": "network-vif-deleted", "tag": "6193819b-0c1b-476b-b89e-dbbfc7938fc5"}]} {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:34:17 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-2d525ecb-80c6-4cf2-bbe5-38b6fa0f2d43 req-9404ef0c-f600-4c91-b4d4-45fd6b3b1d4d service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:34:17 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-2d525ecb-80c6-4cf2-bbe5-38b6fa0f2d43 req-9404ef0c-f600-4c91-b4d4-45fd6b3b1d4d service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:34:17 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-2d525ecb-80c6-4cf2-bbe5-38b6fa0f2d43 req-9404ef0c-f600-4c91-b4d4-45fd6b3b1d4d service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:34:17 user devstack@n-api.service[72089]: INFO nova.api.openstack.compute.server_external_events [req-2d525ecb-80c6-4cf2-bbe5-38b6fa0f2d43 req-9404ef0c-f600-4c91-b4d4-45fd6b3b1d4d service nova] Creating event network-vif-deleted:6193819b-0c1b-476b-b89e-dbbfc7938fc5 for instance 6802f099-9236-4c79-a892-2963f1b15b0e on user Apr 11 19:34:17 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [req-2d525ecb-80c6-4cf2-bbe5-38b6fa0f2d43 req-9404ef0c-f600-4c91-b4d4-45fd6b3b1d4d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029431 Apr 11 19:34:17 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 215/626] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:34:17 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 11 19:34:25 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [None req-b6cb7d9a-194a-4a55-b0e4-1a24887a2870 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Calling method '>' {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:34:25 user devstack@n-api.service[72088]: DEBUG nova.compute.api [None req-b6cb7d9a-194a-4a55-b0e4-1a24887a2870 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] [instance: 647674d8-af53-405a-8116-4b7a01549bdf] Fetching instance by UUID {{(pid=72088) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:34:25 user devstack@n-api.service[72088]: DEBUG dbcounter [-] [72088] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=72088) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:34:25 user devstack@n-api.service[72088]: DEBUG dbcounter [-] [72088] Writing DB stats nova_cell1:SELECT=41,nova_cell1:INSERT=1 {{(pid=72088) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:34:25 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-b6cb7d9a-194a-4a55-b0e4-1a24887a2870 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:34:25 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-b6cb7d9a-194a-4a55-b0e4-1a24887a2870 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:34:25 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-b6cb7d9a-194a-4a55-b0e4-1a24887a2870 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:34:25 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-b6cb7d9a-194a-4a55-b0e4-1a24887a2870 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:34:25 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-b6cb7d9a-194a-4a55-b0e4-1a24887a2870 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:34:25 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-b6cb7d9a-194a-4a55-b0e4-1a24887a2870 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:34:25 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [None req-b6cb7d9a-194a-4a55-b0e4-1a24887a2870 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] 10.0.0.210 "GET /compute/v2.1/servers/647674d8-af53-405a-8116-4b7a01549bdf/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047222 Apr 11 19:34:25 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 205/627] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Apr 11 19:34:25 2023] GET /compute/v2.1/servers/647674d8-af53-405a-8116-4b7a01549bdf/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 11 19:34:25 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [None req-79db16d5-eab1-4bb2-87c0-b4ad13b7e2ba tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Calling method '>' {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:34:25 user devstack@n-api.service[72090]: DEBUG nova.compute.api [None req-79db16d5-eab1-4bb2-87c0-b4ad13b7e2ba tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] [instance: 647674d8-af53-405a-8116-4b7a01549bdf] Fetching instance by UUID {{(pid=72090) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:34:25 user devstack@n-api.service[72090]: DEBUG dbcounter [-] [72090] Writing DB stats nova_api:SELECT=56,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=72090) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:34:25 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-79db16d5-eab1-4bb2-87c0-b4ad13b7e2ba tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:34:25 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-79db16d5-eab1-4bb2-87c0-b4ad13b7e2ba tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:34:25 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-79db16d5-eab1-4bb2-87c0-b4ad13b7e2ba tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:34:25 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-79db16d5-eab1-4bb2-87c0-b4ad13b7e2ba tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:34:25 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-79db16d5-eab1-4bb2-87c0-b4ad13b7e2ba tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:34:25 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-79db16d5-eab1-4bb2-87c0-b4ad13b7e2ba tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:34:25 user devstack@n-api.service[72090]: DEBUG dbcounter [-] [72090] Writing DB stats nova_cell1:SELECT=42,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=72090) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:34:25 user devstack@n-api.service[72090]: DEBUG nova.policy [None req-79db16d5-eab1-4bb2-87c0-b4ad13b7e2ba tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05fb551c320a48f98a4ec00a7f7492d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60a7381a31b84e97a068528f90813773', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72090) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:34:25 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [None req-79db16d5-eab1-4bb2-87c0-b4ad13b7e2ba tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] 10.0.0.210 "GET /compute/v2.1/servers/647674d8-af53-405a-8116-4b7a01549bdf" status: 200 len: 1677 microversion: 2.1 time: 0.143252 Apr 11 19:34:25 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 208/628] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 19:34:25 2023] GET /compute/v2.1/servers/647674d8-af53-405a-8116-4b7a01549bdf => generated 1677 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:34:25 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [None req-4735e6a8-c8f3-410e-ab6f-d07cbe5a767b tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Calling method '>' {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:34:25 user devstack@n-api.service[72089]: DEBUG nova.compute.api [None req-4735e6a8-c8f3-410e-ab6f-d07cbe5a767b tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] [instance: 647674d8-af53-405a-8116-4b7a01549bdf] Fetching instance by UUID {{(pid=72089) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:34:25 user devstack@n-api.service[72089]: DEBUG dbcounter [-] [72089] Writing DB stats nova_api:SELECT=38,nova_api:DELETE=1,nova_api:UPDATE=2 {{(pid=72089) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:34:25 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-4735e6a8-c8f3-410e-ab6f-d07cbe5a767b tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:34:25 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-4735e6a8-c8f3-410e-ab6f-d07cbe5a767b tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:34:25 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-4735e6a8-c8f3-410e-ab6f-d07cbe5a767b tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:34:25 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-4735e6a8-c8f3-410e-ab6f-d07cbe5a767b tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:34:25 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-4735e6a8-c8f3-410e-ab6f-d07cbe5a767b tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:34:25 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-4735e6a8-c8f3-410e-ab6f-d07cbe5a767b tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:34:25 user devstack@n-api.service[72089]: DEBUG dbcounter [-] [72089] Writing DB stats nova_cell1:SELECT=84,nova_cell1:UPDATE=8,nova_cell1:INSERT=5 {{(pid=72089) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:34:25 user devstack@n-api.service[72089]: DEBUG nova.policy [None req-4735e6a8-c8f3-410e-ab6f-d07cbe5a767b tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05fb551c320a48f98a4ec00a7f7492d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60a7381a31b84e97a068528f90813773', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72089) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:34:25 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [None req-4735e6a8-c8f3-410e-ab6f-d07cbe5a767b tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] 10.0.0.210 "GET /compute/v2.1/servers/647674d8-af53-405a-8116-4b7a01549bdf" status: 200 len: 1677 microversion: 2.1 time: 0.154892 Apr 11 19:34:25 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 216/629] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 19:34:25 2023] GET /compute/v2.1/servers/647674d8-af53-405a-8116-4b7a01549bdf => generated 1677 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:34:25 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [None req-903efbb4-ac3a-45a9-9d55-eedc2f19d47c tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Calling method '>' {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:34:25 user devstack@n-api.service[72088]: DEBUG nova.compute.api [None req-903efbb4-ac3a-45a9-9d55-eedc2f19d47c tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] [instance: 647674d8-af53-405a-8116-4b7a01549bdf] Fetching instance by UUID {{(pid=72088) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:34:25 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-903efbb4-ac3a-45a9-9d55-eedc2f19d47c tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:34:25 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-903efbb4-ac3a-45a9-9d55-eedc2f19d47c tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:34:25 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-903efbb4-ac3a-45a9-9d55-eedc2f19d47c tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:34:25 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-903efbb4-ac3a-45a9-9d55-eedc2f19d47c tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:34:25 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-903efbb4-ac3a-45a9-9d55-eedc2f19d47c tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:34:25 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-903efbb4-ac3a-45a9-9d55-eedc2f19d47c tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:34:25 user devstack@n-api.service[72088]: DEBUG nova.policy [None req-903efbb4-ac3a-45a9-9d55-eedc2f19d47c tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05fb551c320a48f98a4ec00a7f7492d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60a7381a31b84e97a068528f90813773', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72088) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:34:25 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [None req-903efbb4-ac3a-45a9-9d55-eedc2f19d47c tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] 10.0.0.210 "GET /compute/v2.1/servers/647674d8-af53-405a-8116-4b7a01549bdf" status: 200 len: 1677 microversion: 2.1 time: 0.148808 Apr 11 19:34:25 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 206/630] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 19:34:25 2023] GET /compute/v2.1/servers/647674d8-af53-405a-8116-4b7a01549bdf => generated 1677 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:34:33 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [None req-773009d8-b992-409b-a39b-6e309a6350d2 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:34:33 user devstack@n-api.service[72090]: DEBUG nova.compute.api [None req-773009d8-b992-409b-a39b-6e309a6350d2 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] [instance: 267c17c1-f0b6-4e18-8c18-5e5bbe8a2251] Fetching instance by UUID {{(pid=72090) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:34:33 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-773009d8-b992-409b-a39b-6e309a6350d2 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:34:33 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-773009d8-b992-409b-a39b-6e309a6350d2 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:34:33 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-773009d8-b992-409b-a39b-6e309a6350d2 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:34:33 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-773009d8-b992-409b-a39b-6e309a6350d2 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:34:33 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-773009d8-b992-409b-a39b-6e309a6350d2 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:34:33 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-773009d8-b992-409b-a39b-6e309a6350d2 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:34:33 user devstack@n-api.service[72090]: DEBUG nova.objects.instance [None req-773009d8-b992-409b-a39b-6e309a6350d2 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Lazy-loading 'flavor' on Instance uuid 267c17c1-f0b6-4e18-8c18-5e5bbe8a2251 {{(pid=72090) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 11 19:34:33 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [None req-773009d8-b992-409b-a39b-6e309a6350d2 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] 10.0.0.210 "POST /compute/v2.1/servers/267c17c1-f0b6-4e18-8c18-5e5bbe8a2251/action" status: 200 len: 32 microversion: 2.1 time: 0.096264 Apr 11 19:34:33 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 209/631] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Apr 11 19:34:33 2023] POST /compute/v2.1/servers/267c17c1-f0b6-4e18-8c18-5e5bbe8a2251/action => generated 32 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 11 19:34:33 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [None req-f5e9fa74-c2d6-419d-a6f8-977b757fd463 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Calling method '>' {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:34:33 user devstack@n-api.service[72089]: DEBUG nova.compute.api [None req-f5e9fa74-c2d6-419d-a6f8-977b757fd463 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] [instance: 267c17c1-f0b6-4e18-8c18-5e5bbe8a2251] Fetching instance by UUID {{(pid=72089) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:34:33 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-f5e9fa74-c2d6-419d-a6f8-977b757fd463 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:34:33 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-f5e9fa74-c2d6-419d-a6f8-977b757fd463 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:34:33 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-f5e9fa74-c2d6-419d-a6f8-977b757fd463 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:34:33 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-f5e9fa74-c2d6-419d-a6f8-977b757fd463 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:34:33 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-f5e9fa74-c2d6-419d-a6f8-977b757fd463 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:34:33 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-f5e9fa74-c2d6-419d-a6f8-977b757fd463 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:34:33 user devstack@n-api.service[72089]: DEBUG nova.policy [None req-f5e9fa74-c2d6-419d-a6f8-977b757fd463 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba7f82b529e74d99838b6264b94d823b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e3a291c54b49db8e12a88ba41865e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72089) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:34:33 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [None req-f5e9fa74-c2d6-419d-a6f8-977b757fd463 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] 10.0.0.210 "GET /compute/v2.1/servers/267c17c1-f0b6-4e18-8c18-5e5bbe8a2251" status: 200 len: 1510 microversion: 2.1 time: 0.147814 Apr 11 19:34:33 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 217/632] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 19:34:33 2023] GET /compute/v2.1/servers/267c17c1-f0b6-4e18-8c18-5e5bbe8a2251 => generated 1510 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:34:34 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [req-ecb9c65b-1bef-446c-879b-02216df9fdd2 req-7d156b3a-1a81-41a4-9817-ef37983947db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "267c17c1-f0b6-4e18-8c18-5e5bbe8a2251", "name": "network-vif-unplugged", "status": "completed", "tag": "06fea704-e356-4605-811e-aac91617290e"}]} {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:34:34 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-ecb9c65b-1bef-446c-879b-02216df9fdd2 req-7d156b3a-1a81-41a4-9817-ef37983947db service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:34:34 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-ecb9c65b-1bef-446c-879b-02216df9fdd2 req-7d156b3a-1a81-41a4-9817-ef37983947db service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:34:34 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-ecb9c65b-1bef-446c-879b-02216df9fdd2 req-7d156b3a-1a81-41a4-9817-ef37983947db service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:34:34 user devstack@n-api.service[72088]: INFO nova.api.openstack.compute.server_external_events [req-ecb9c65b-1bef-446c-879b-02216df9fdd2 req-7d156b3a-1a81-41a4-9817-ef37983947db service nova] Creating event network-vif-unplugged:06fea704-e356-4605-811e-aac91617290e for instance 267c17c1-f0b6-4e18-8c18-5e5bbe8a2251 on user Apr 11 19:34:34 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [req-ecb9c65b-1bef-446c-879b-02216df9fdd2 req-7d156b3a-1a81-41a4-9817-ef37983947db service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.029861 Apr 11 19:34:34 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 207/633] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:34:34 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:34:36 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [req-29b21c0c-e602-4248-b72c-ecd9d684604c req-152702d8-c5af-48ff-859b-305d8c0282aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "267c17c1-f0b6-4e18-8c18-5e5bbe8a2251", "name": "network-vif-plugged", "status": "completed", "tag": "06fea704-e356-4605-811e-aac91617290e"}]} {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:34:36 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-29b21c0c-e602-4248-b72c-ecd9d684604c req-152702d8-c5af-48ff-859b-305d8c0282aa service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:34:36 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-29b21c0c-e602-4248-b72c-ecd9d684604c req-152702d8-c5af-48ff-859b-305d8c0282aa service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:34:36 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-29b21c0c-e602-4248-b72c-ecd9d684604c req-152702d8-c5af-48ff-859b-305d8c0282aa service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:34:36 user devstack@n-api.service[72090]: INFO nova.api.openstack.compute.server_external_events [req-29b21c0c-e602-4248-b72c-ecd9d684604c req-152702d8-c5af-48ff-859b-305d8c0282aa service nova] Creating event network-vif-plugged:06fea704-e356-4605-811e-aac91617290e for instance 267c17c1-f0b6-4e18-8c18-5e5bbe8a2251 on user Apr 11 19:34:36 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [req-29b21c0c-e602-4248-b72c-ecd9d684604c req-152702d8-c5af-48ff-859b-305d8c0282aa service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031308 Apr 11 19:34:36 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 210/634] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:34:36 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:34:38 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [req-c93e716c-806d-43cd-a19c-e7c834dffed6 req-56dd9f9c-172c-4020-9718-ab8c82b5eb75 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "267c17c1-f0b6-4e18-8c18-5e5bbe8a2251", "name": "network-vif-plugged", "status": "completed", "tag": "06fea704-e356-4605-811e-aac91617290e"}, {"server_uuid": "267c17c1-f0b6-4e18-8c18-5e5bbe8a2251", "name": "network-vif-plugged", "status": "completed", "tag": "06fea704-e356-4605-811e-aac91617290e"}]} {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:34:38 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-c93e716c-806d-43cd-a19c-e7c834dffed6 req-56dd9f9c-172c-4020-9718-ab8c82b5eb75 service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:34:38 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-c93e716c-806d-43cd-a19c-e7c834dffed6 req-56dd9f9c-172c-4020-9718-ab8c82b5eb75 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:34:38 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-c93e716c-806d-43cd-a19c-e7c834dffed6 req-56dd9f9c-172c-4020-9718-ab8c82b5eb75 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:34:38 user devstack@n-api.service[72089]: INFO nova.api.openstack.compute.server_external_events [req-c93e716c-806d-43cd-a19c-e7c834dffed6 req-56dd9f9c-172c-4020-9718-ab8c82b5eb75 service nova] Creating event network-vif-plugged:06fea704-e356-4605-811e-aac91617290e for instance 267c17c1-f0b6-4e18-8c18-5e5bbe8a2251 on user Apr 11 19:34:38 user devstack@n-api.service[72089]: INFO nova.api.openstack.compute.server_external_events [req-c93e716c-806d-43cd-a19c-e7c834dffed6 req-56dd9f9c-172c-4020-9718-ab8c82b5eb75 service nova] Creating event network-vif-plugged:06fea704-e356-4605-811e-aac91617290e for instance 267c17c1-f0b6-4e18-8c18-5e5bbe8a2251 on user Apr 11 19:34:38 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [req-c93e716c-806d-43cd-a19c-e7c834dffed6 req-56dd9f9c-172c-4020-9718-ab8c82b5eb75 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.028690 Apr 11 19:34:38 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 218/635] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:34:38 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:34:45 user devstack@n-api.service[72088]: DEBUG dbcounter [-] [72088] Writing DB stats nova_api:SELECT=6 {{(pid=72088) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:34:45 user devstack@n-api.service[72088]: DEBUG dbcounter [-] [72088] Writing DB stats nova_cell1:SELECT=14 {{(pid=72088) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:34:45 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [None req-6a1b1ea6-85e0-48db-81a3-095b2df0d718 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Calling method '>' {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:34:45 user devstack@n-api.service[72088]: DEBUG nova.compute.api [None req-6a1b1ea6-85e0-48db-81a3-095b2df0d718 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] [instance: fbfa0825-c7c2-4f04-8c9a-102e238c3816] Fetching instance by UUID {{(pid=72088) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:34:45 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-6a1b1ea6-85e0-48db-81a3-095b2df0d718 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:34:45 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-6a1b1ea6-85e0-48db-81a3-095b2df0d718 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:34:45 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-6a1b1ea6-85e0-48db-81a3-095b2df0d718 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:34:45 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-6a1b1ea6-85e0-48db-81a3-095b2df0d718 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:34:45 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-6a1b1ea6-85e0-48db-81a3-095b2df0d718 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:34:45 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-6a1b1ea6-85e0-48db-81a3-095b2df0d718 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:34:45 user devstack@n-api.service[72088]: DEBUG nova.policy [None req-6a1b1ea6-85e0-48db-81a3-095b2df0d718 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0558ba5a2b04d36ba2f2411090cc4e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d8b189667e34931aa36149620a036e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72088) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:34:45 user devstack@n-api.service[72088]: DEBUG nova.policy [None req-6a1b1ea6-85e0-48db-81a3-095b2df0d718 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0558ba5a2b04d36ba2f2411090cc4e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d8b189667e34931aa36149620a036e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72088) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:34:45 user devstack@n-api.service[72088]: DEBUG nova.policy [None req-6a1b1ea6-85e0-48db-81a3-095b2df0d718 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0558ba5a2b04d36ba2f2411090cc4e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d8b189667e34931aa36149620a036e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72088) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:34:45 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [None req-6a1b1ea6-85e0-48db-81a3-095b2df0d718 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fbfa0825-c7c2-4f04-8c9a-102e238c3816" status: 200 len: 1588 microversion: 2.20 time: 0.174706 Apr 11 19:34:45 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 208/636] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 19:34:45 2023] GET /compute/v2.1/servers/fbfa0825-c7c2-4f04-8c9a-102e238c3816 => generated 1588 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 19:34:50 user devstack@n-api.service[72090]: DEBUG dbcounter [-] [72090] Writing DB stats nova_api:SELECT=5 {{(pid=72090) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:34:50 user devstack@n-api.service[72090]: DEBUG dbcounter [-] [72090] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=72090) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:34:50 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [None req-d0d358e8-f106-45f6-a6a6-56f60972d303 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Calling method '>' {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:34:50 user devstack@n-api.service[72090]: DEBUG nova.compute.api [None req-d0d358e8-f106-45f6-a6a6-56f60972d303 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] [instance: b079367a-558e-4920-ad8d-972a8065260c] Fetching instance by UUID {{(pid=72090) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:34:50 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-d0d358e8-f106-45f6-a6a6-56f60972d303 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:34:50 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-d0d358e8-f106-45f6-a6a6-56f60972d303 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:34:50 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-d0d358e8-f106-45f6-a6a6-56f60972d303 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:34:50 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-d0d358e8-f106-45f6-a6a6-56f60972d303 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:34:50 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-d0d358e8-f106-45f6-a6a6-56f60972d303 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:34:50 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-d0d358e8-f106-45f6-a6a6-56f60972d303 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:34:50 user devstack@n-api.service[72090]: DEBUG nova.policy [None req-d0d358e8-f106-45f6-a6a6-56f60972d303 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b3adca432b04d70818a51d1366f5c6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb91586feb3f4a4c84fa8c2183baaf8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72090) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:34:50 user devstack@n-api.service[72090]: DEBUG nova.policy [None req-d0d358e8-f106-45f6-a6a6-56f60972d303 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b3adca432b04d70818a51d1366f5c6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb91586feb3f4a4c84fa8c2183baaf8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72090) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:34:50 user devstack@n-api.service[72090]: DEBUG nova.policy [None req-d0d358e8-f106-45f6-a6a6-56f60972d303 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b3adca432b04d70818a51d1366f5c6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb91586feb3f4a4c84fa8c2183baaf8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72090) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:34:50 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [None req-d0d358e8-f106-45f6-a6a6-56f60972d303 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b079367a-558e-4920-ad8d-972a8065260c" status: 200 len: 1690 microversion: 2.87 time: 0.159123 Apr 11 19:34:50 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 211/637] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 19:34:50 2023] GET /compute/v2.1/servers/b079367a-558e-4920-ad8d-972a8065260c => generated 1690 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 11 19:34:50 user devstack@n-api.service[72089]: DEBUG dbcounter [-] [72089] Writing DB stats nova_api:SELECT=5 {{(pid=72089) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:34:50 user devstack@n-api.service[72089]: DEBUG dbcounter [-] [72089] Writing DB stats nova_cell1:SELECT=13 {{(pid=72089) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:34:50 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [None req-a8e30b97-228d-41a5-87a7-f0ce5a0045b6 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Calling method '>' {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:34:50 user devstack@n-api.service[72089]: DEBUG nova.compute.api [None req-a8e30b97-228d-41a5-87a7-f0ce5a0045b6 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] [instance: cbd5aa3c-f6c9-49e2-8ee7-dcf389c9ed08] Fetching instance by UUID {{(pid=72089) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:34:50 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-a8e30b97-228d-41a5-87a7-f0ce5a0045b6 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:34:50 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-a8e30b97-228d-41a5-87a7-f0ce5a0045b6 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:34:50 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-a8e30b97-228d-41a5-87a7-f0ce5a0045b6 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:34:50 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-a8e30b97-228d-41a5-87a7-f0ce5a0045b6 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:34:50 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-a8e30b97-228d-41a5-87a7-f0ce5a0045b6 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:34:50 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-a8e30b97-228d-41a5-87a7-f0ce5a0045b6 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:34:50 user devstack@n-api.service[72089]: INFO nova.api.openstack.wsgi [None req-a8e30b97-228d-41a5-87a7-f0ce5a0045b6 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] HTTP exception thrown: Instance cbd5aa3c-f6c9-49e2-8ee7-dcf389c9ed08 could not be found. Apr 11 19:34:50 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [None req-a8e30b97-228d-41a5-87a7-f0ce5a0045b6 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Request method failure captured: Apr 11 19:34:50 user devstack@n-api.service[72089]: request: GET /compute/v2.1/servers/cbd5aa3c-f6c9-49e2-8ee7-dcf389c9ed08 HTTP/1.1 Apr 11 19:34:50 user devstack@n-api.service[72089]: Accept: application/json Apr 11 19:34:50 user devstack@n-api.service[72089]: Accept-Encoding: identity Apr 11 19:34:50 user devstack@n-api.service[72089]: Connection: close Apr 11 19:34:50 user devstack@n-api.service[72089]: Content-Length: 0 Apr 11 19:34:50 user devstack@n-api.service[72089]: Content-Type: application/json Apr 11 19:34:50 user devstack@n-api.service[72089]: Host: 10.0.0.210 Apr 11 19:34:50 user devstack@n-api.service[72089]: Openstack-System-Scope: None Apr 11 19:34:50 user devstack@n-api.service[72089]: User-Agent: python-urllib3/1.26.15 Apr 11 19:34:50 user devstack@n-api.service[72089]: X-Auth-Token: gAAAAABkNbWuPL7tpG6O55jvFSGO371AELCQlFZHf6FrRxh7vClaI6XXjuETFNQG4Gook2-ws7z2jCWcd2rLpcqQWtWmqjJ0M2xKefxUzDSsHikQ381w5ena7_2Zjp6vyHkrh7PG-gVY2vEL8dYAJIJ3D9B2mOuFBAai8zWGdpQnauKzi-Qcl_M Apr 11 19:34:50 user devstack@n-api.service[72089]: X-Domain-Id: None Apr 11 19:34:50 user devstack@n-api.service[72089]: X-Domain-Name: None Apr 11 19:34:50 user devstack@n-api.service[72089]: X-Identity-Status: Confirmed Apr 11 19:34:50 user devstack@n-api.service[72089]: X-Is-Admin-Project: True Apr 11 19:34:50 user devstack@n-api.service[72089]: X-Project-Domain-Id: default Apr 11 19:34:50 user devstack@n-api.service[72089]: X-Project-Domain-Name: Default Apr 11 19:34:50 user devstack@n-api.service[72089]: X-Project-Id: 2caba0618fc743e7bfb2dd866a511df9 Apr 11 19:34:50 user devstack@n-api.service[72089]: X-Project-Name: tempest-TestVolumeBootPattern-935343500 Apr 11 19:34:50 user devstack@n-api.service[72089]: X-Role: reader,member Apr 11 19:34:50 user devstack@n-api.service[72089]: X-Roles: reader,member Apr 11 19:34:50 user devstack@n-api.service[72089]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2caba0618fc743e7bfb2dd866a511df9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/2caba0618fc743e7bfb2dd866a511df9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2caba0618fc743e7bfb2dd866a511df9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 11 19:34:50 user devstack@n-api.service[72089]: X-Tenant: tempest-TestVolumeBootPattern-935343500 Apr 11 19:34:50 user devstack@n-api.service[72089]: X-Tenant-Id: 2caba0618fc743e7bfb2dd866a511df9 Apr 11 19:34:50 user devstack@n-api.service[72089]: X-Tenant-Name: tempest-TestVolumeBootPattern-935343500 Apr 11 19:34:50 user devstack@n-api.service[72089]: X-User: tempest-TestVolumeBootPattern-935343500-project-member Apr 11 19:34:50 user devstack@n-api.service[72089]: X-User-Domain-Id: default Apr 11 19:34:50 user devstack@n-api.service[72089]: X-User-Domain-Name: Default Apr 11 19:34:50 user devstack@n-api.service[72089]: X-User-Id: cf262cd03f4a41c4956d8784cf37d86d Apr 11 19:34:50 user devstack@n-api.service[72089]: X-User-Name: tempest-TestVolumeBootPattern-935343500-project-member Apr 11 19:34:50 user devstack@n-api.service[72089]: method: > Apr 11 19:34:50 user devstack@n-api.service[72089]: exception: Instance cbd5aa3c-f6c9-49e2-8ee7-dcf389c9ed08 could not be found. Apr 11 19:34:50 user devstack@n-api.service[72089]: action_args: {'id': 'cbd5aa3c-f6c9-49e2-8ee7-dcf389c9ed08'} Apr 11 19:34:50 user devstack@n-api.service[72089]: {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 19:34:50 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:34:50 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 19:34:50 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 19:34:50 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 19:34:50 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 19:34:50 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 19:34:50 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 19:34:50 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 19:34:50 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 19:34:50 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cbd5aa3c-f6c9-49e2-8ee7-dcf389c9ed08 could not be found. Apr 11 19:34:50 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi Apr 11 19:34:50 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 19:34:50 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi Apr 11 19:34:50 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:34:50 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 19:34:50 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 19:34:50 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 19:34:50 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 19:34:50 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 19:34:50 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 19:34:50 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 19:34:50 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 19:34:50 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 19:34:50 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 19:34:50 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 19:34:50 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 19:34:50 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cbd5aa3c-f6c9-49e2-8ee7-dcf389c9ed08 could not be found. Apr 11 19:34:50 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi Apr 11 19:34:50 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 19:34:50 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi Apr 11 19:34:50 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:34:50 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 19:34:50 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 19:34:50 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 19:34:50 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 19:34:50 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cbd5aa3c-f6c9-49e2-8ee7-dcf389c9ed08 could not be found. Apr 11 19:34:50 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi Apr 11 19:34:50 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [None req-a8e30b97-228d-41a5-87a7-f0ce5a0045b6 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Returning 404 to user: Instance cbd5aa3c-f6c9-49e2-8ee7-dcf389c9ed08 could not be found. {{(pid=72089) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 19:34:50 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [None req-a8e30b97-228d-41a5-87a7-f0ce5a0045b6 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cbd5aa3c-f6c9-49e2-8ee7-dcf389c9ed08" status: 404 len: 111 microversion: 2.1 time: 0.032718 Apr 11 19:34:50 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 219/638] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 19:34:50 2023] GET /compute/v2.1/servers/cbd5aa3c-f6c9-49e2-8ee7-dcf389c9ed08 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 19:34:50 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [None req-c3181056-7667-41f7-8324-ba3a666844d3 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Calling method '>' {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:34:50 user devstack@n-api.service[72088]: DEBUG nova.compute.api [None req-c3181056-7667-41f7-8324-ba3a666844d3 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] [instance: cbd5aa3c-f6c9-49e2-8ee7-dcf389c9ed08] Fetching instance by UUID {{(pid=72088) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:34:50 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-c3181056-7667-41f7-8324-ba3a666844d3 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:34:50 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-c3181056-7667-41f7-8324-ba3a666844d3 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:34:50 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-c3181056-7667-41f7-8324-ba3a666844d3 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:34:50 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-c3181056-7667-41f7-8324-ba3a666844d3 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:34:50 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-c3181056-7667-41f7-8324-ba3a666844d3 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:34:50 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-c3181056-7667-41f7-8324-ba3a666844d3 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:34:50 user devstack@n-api.service[72088]: INFO nova.api.openstack.wsgi [None req-c3181056-7667-41f7-8324-ba3a666844d3 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] HTTP exception thrown: Instance cbd5aa3c-f6c9-49e2-8ee7-dcf389c9ed08 could not be found. Apr 11 19:34:50 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [None req-c3181056-7667-41f7-8324-ba3a666844d3 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Request method failure captured: Apr 11 19:34:50 user devstack@n-api.service[72088]: request: DELETE /compute/v2.1/servers/cbd5aa3c-f6c9-49e2-8ee7-dcf389c9ed08 HTTP/1.1 Apr 11 19:34:50 user devstack@n-api.service[72088]: Accept: application/json Apr 11 19:34:50 user devstack@n-api.service[72088]: Accept-Encoding: identity Apr 11 19:34:50 user devstack@n-api.service[72088]: Connection: close Apr 11 19:34:50 user devstack@n-api.service[72088]: Content-Length: 0 Apr 11 19:34:50 user devstack@n-api.service[72088]: Content-Type: application/json Apr 11 19:34:50 user devstack@n-api.service[72088]: Host: 10.0.0.210 Apr 11 19:34:50 user devstack@n-api.service[72088]: Openstack-System-Scope: None Apr 11 19:34:50 user devstack@n-api.service[72088]: User-Agent: python-urllib3/1.26.15 Apr 11 19:34:50 user devstack@n-api.service[72088]: X-Auth-Token: gAAAAABkNbWuPL7tpG6O55jvFSGO371AELCQlFZHf6FrRxh7vClaI6XXjuETFNQG4Gook2-ws7z2jCWcd2rLpcqQWtWmqjJ0M2xKefxUzDSsHikQ381w5ena7_2Zjp6vyHkrh7PG-gVY2vEL8dYAJIJ3D9B2mOuFBAai8zWGdpQnauKzi-Qcl_M Apr 11 19:34:50 user devstack@n-api.service[72088]: X-Domain-Id: None Apr 11 19:34:50 user devstack@n-api.service[72088]: X-Domain-Name: None Apr 11 19:34:50 user devstack@n-api.service[72088]: X-Identity-Status: Confirmed Apr 11 19:34:50 user devstack@n-api.service[72088]: X-Is-Admin-Project: True Apr 11 19:34:50 user devstack@n-api.service[72088]: X-Project-Domain-Id: default Apr 11 19:34:50 user devstack@n-api.service[72088]: X-Project-Domain-Name: Default Apr 11 19:34:50 user devstack@n-api.service[72088]: X-Project-Id: 2caba0618fc743e7bfb2dd866a511df9 Apr 11 19:34:50 user devstack@n-api.service[72088]: X-Project-Name: tempest-TestVolumeBootPattern-935343500 Apr 11 19:34:50 user devstack@n-api.service[72088]: X-Role: reader,member Apr 11 19:34:50 user devstack@n-api.service[72088]: X-Roles: reader,member Apr 11 19:34:50 user devstack@n-api.service[72088]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2caba0618fc743e7bfb2dd866a511df9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/2caba0618fc743e7bfb2dd866a511df9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2caba0618fc743e7bfb2dd866a511df9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 11 19:34:50 user devstack@n-api.service[72088]: X-Tenant: tempest-TestVolumeBootPattern-935343500 Apr 11 19:34:50 user devstack@n-api.service[72088]: X-Tenant-Id: 2caba0618fc743e7bfb2dd866a511df9 Apr 11 19:34:50 user devstack@n-api.service[72088]: X-Tenant-Name: tempest-TestVolumeBootPattern-935343500 Apr 11 19:34:50 user devstack@n-api.service[72088]: X-User: tempest-TestVolumeBootPattern-935343500-project-member Apr 11 19:34:50 user devstack@n-api.service[72088]: X-User-Domain-Id: default Apr 11 19:34:50 user devstack@n-api.service[72088]: X-User-Domain-Name: Default Apr 11 19:34:50 user devstack@n-api.service[72088]: X-User-Id: cf262cd03f4a41c4956d8784cf37d86d Apr 11 19:34:50 user devstack@n-api.service[72088]: X-User-Name: tempest-TestVolumeBootPattern-935343500-project-member Apr 11 19:34:50 user devstack@n-api.service[72088]: method: > Apr 11 19:34:50 user devstack@n-api.service[72088]: exception: Instance cbd5aa3c-f6c9-49e2-8ee7-dcf389c9ed08 could not be found. Apr 11 19:34:50 user devstack@n-api.service[72088]: action_args: {'id': 'cbd5aa3c-f6c9-49e2-8ee7-dcf389c9ed08'} Apr 11 19:34:50 user devstack@n-api.service[72088]: {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 19:34:50 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:34:50 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 19:34:50 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 19:34:50 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 19:34:50 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 19:34:50 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 19:34:50 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 19:34:50 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 19:34:50 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 19:34:50 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cbd5aa3c-f6c9-49e2-8ee7-dcf389c9ed08 could not be found. Apr 11 19:34:50 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi Apr 11 19:34:50 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 19:34:50 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi Apr 11 19:34:50 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:34:50 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 19:34:50 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 19:34:50 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 19:34:50 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 19:34:50 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 19:34:50 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 19:34:50 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 11 19:34:50 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 11 19:34:50 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 11 19:34:50 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 11 19:34:50 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 19:34:50 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 19:34:50 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 19:34:50 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 19:34:50 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cbd5aa3c-f6c9-49e2-8ee7-dcf389c9ed08 could not be found. Apr 11 19:34:50 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi Apr 11 19:34:50 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 19:34:50 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi Apr 11 19:34:50 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:34:50 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 19:34:50 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 19:34:50 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 19:34:50 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 19:34:50 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cbd5aa3c-f6c9-49e2-8ee7-dcf389c9ed08 could not be found. Apr 11 19:34:50 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi Apr 11 19:34:50 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [None req-c3181056-7667-41f7-8324-ba3a666844d3 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Returning 404 to user: Instance cbd5aa3c-f6c9-49e2-8ee7-dcf389c9ed08 could not be found. {{(pid=72088) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 19:34:50 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [None req-c3181056-7667-41f7-8324-ba3a666844d3 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/cbd5aa3c-f6c9-49e2-8ee7-dcf389c9ed08" status: 404 len: 111 microversion: 2.1 time: 0.027096 Apr 11 19:34:50 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 209/639] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 19:34:50 2023] DELETE /compute/v2.1/servers/cbd5aa3c-f6c9-49e2-8ee7-dcf389c9ed08 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 19:34:50 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [None req-cc067d7f-c1f1-4b79-af31-1f634b6fa8c9 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Calling method '>' {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:34:50 user devstack@n-api.service[72090]: DEBUG nova.compute.api [None req-cc067d7f-c1f1-4b79-af31-1f634b6fa8c9 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] [instance: cbd5aa3c-f6c9-49e2-8ee7-dcf389c9ed08] Fetching instance by UUID {{(pid=72090) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:34:50 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-cc067d7f-c1f1-4b79-af31-1f634b6fa8c9 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:34:50 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-cc067d7f-c1f1-4b79-af31-1f634b6fa8c9 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:34:50 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-cc067d7f-c1f1-4b79-af31-1f634b6fa8c9 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:34:50 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-cc067d7f-c1f1-4b79-af31-1f634b6fa8c9 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:34:50 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-cc067d7f-c1f1-4b79-af31-1f634b6fa8c9 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:34:50 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-cc067d7f-c1f1-4b79-af31-1f634b6fa8c9 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:34:50 user devstack@n-api.service[72090]: INFO nova.api.openstack.wsgi [None req-cc067d7f-c1f1-4b79-af31-1f634b6fa8c9 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] HTTP exception thrown: Instance cbd5aa3c-f6c9-49e2-8ee7-dcf389c9ed08 could not be found. Apr 11 19:34:50 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [None req-cc067d7f-c1f1-4b79-af31-1f634b6fa8c9 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Request method failure captured: Apr 11 19:34:50 user devstack@n-api.service[72090]: request: GET /compute/v2.1/servers/cbd5aa3c-f6c9-49e2-8ee7-dcf389c9ed08 HTTP/1.1 Apr 11 19:34:50 user devstack@n-api.service[72090]: Accept: application/json Apr 11 19:34:50 user devstack@n-api.service[72090]: Accept-Encoding: identity Apr 11 19:34:50 user devstack@n-api.service[72090]: Connection: close Apr 11 19:34:50 user devstack@n-api.service[72090]: Content-Length: 0 Apr 11 19:34:50 user devstack@n-api.service[72090]: Content-Type: application/json Apr 11 19:34:50 user devstack@n-api.service[72090]: Host: 10.0.0.210 Apr 11 19:34:50 user devstack@n-api.service[72090]: Openstack-System-Scope: None Apr 11 19:34:50 user devstack@n-api.service[72090]: User-Agent: python-urllib3/1.26.15 Apr 11 19:34:50 user devstack@n-api.service[72090]: X-Auth-Token: gAAAAABkNbWuPL7tpG6O55jvFSGO371AELCQlFZHf6FrRxh7vClaI6XXjuETFNQG4Gook2-ws7z2jCWcd2rLpcqQWtWmqjJ0M2xKefxUzDSsHikQ381w5ena7_2Zjp6vyHkrh7PG-gVY2vEL8dYAJIJ3D9B2mOuFBAai8zWGdpQnauKzi-Qcl_M Apr 11 19:34:50 user devstack@n-api.service[72090]: X-Domain-Id: None Apr 11 19:34:50 user devstack@n-api.service[72090]: X-Domain-Name: None Apr 11 19:34:50 user devstack@n-api.service[72090]: X-Identity-Status: Confirmed Apr 11 19:34:50 user devstack@n-api.service[72090]: X-Is-Admin-Project: True Apr 11 19:34:50 user devstack@n-api.service[72090]: X-Project-Domain-Id: default Apr 11 19:34:50 user devstack@n-api.service[72090]: X-Project-Domain-Name: Default Apr 11 19:34:50 user devstack@n-api.service[72090]: X-Project-Id: 2caba0618fc743e7bfb2dd866a511df9 Apr 11 19:34:50 user devstack@n-api.service[72090]: X-Project-Name: tempest-TestVolumeBootPattern-935343500 Apr 11 19:34:50 user devstack@n-api.service[72090]: X-Role: reader,member Apr 11 19:34:50 user devstack@n-api.service[72090]: X-Roles: reader,member Apr 11 19:34:50 user devstack@n-api.service[72090]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2caba0618fc743e7bfb2dd866a511df9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/2caba0618fc743e7bfb2dd866a511df9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2caba0618fc743e7bfb2dd866a511df9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 11 19:34:50 user devstack@n-api.service[72090]: X-Tenant: tempest-TestVolumeBootPattern-935343500 Apr 11 19:34:50 user devstack@n-api.service[72090]: X-Tenant-Id: 2caba0618fc743e7bfb2dd866a511df9 Apr 11 19:34:50 user devstack@n-api.service[72090]: X-Tenant-Name: tempest-TestVolumeBootPattern-935343500 Apr 11 19:34:50 user devstack@n-api.service[72090]: X-User: tempest-TestVolumeBootPattern-935343500-project-member Apr 11 19:34:50 user devstack@n-api.service[72090]: X-User-Domain-Id: default Apr 11 19:34:50 user devstack@n-api.service[72090]: X-User-Domain-Name: Default Apr 11 19:34:50 user devstack@n-api.service[72090]: X-User-Id: cf262cd03f4a41c4956d8784cf37d86d Apr 11 19:34:50 user devstack@n-api.service[72090]: X-User-Name: tempest-TestVolumeBootPattern-935343500-project-member Apr 11 19:34:50 user devstack@n-api.service[72090]: method: > Apr 11 19:34:50 user devstack@n-api.service[72090]: exception: Instance cbd5aa3c-f6c9-49e2-8ee7-dcf389c9ed08 could not be found. Apr 11 19:34:50 user devstack@n-api.service[72090]: action_args: {'id': 'cbd5aa3c-f6c9-49e2-8ee7-dcf389c9ed08'} Apr 11 19:34:50 user devstack@n-api.service[72090]: {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 19:34:50 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:34:50 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 19:34:50 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 19:34:50 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 19:34:50 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 19:34:50 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 19:34:50 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 19:34:50 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 19:34:50 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 19:34:50 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cbd5aa3c-f6c9-49e2-8ee7-dcf389c9ed08 could not be found. Apr 11 19:34:50 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi Apr 11 19:34:50 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 19:34:50 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi Apr 11 19:34:50 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:34:50 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 19:34:50 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 19:34:50 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 19:34:50 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 19:34:50 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 19:34:50 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 19:34:50 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 19:34:50 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 19:34:50 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 19:34:50 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 19:34:50 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 19:34:50 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 19:34:50 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cbd5aa3c-f6c9-49e2-8ee7-dcf389c9ed08 could not be found. Apr 11 19:34:50 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi Apr 11 19:34:50 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 19:34:50 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi Apr 11 19:34:50 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:34:50 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 19:34:50 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 19:34:50 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 19:34:50 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 19:34:50 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cbd5aa3c-f6c9-49e2-8ee7-dcf389c9ed08 could not be found. Apr 11 19:34:50 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi Apr 11 19:34:50 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [None req-cc067d7f-c1f1-4b79-af31-1f634b6fa8c9 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Returning 404 to user: Instance cbd5aa3c-f6c9-49e2-8ee7-dcf389c9ed08 could not be found. {{(pid=72090) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 19:34:50 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [None req-cc067d7f-c1f1-4b79-af31-1f634b6fa8c9 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cbd5aa3c-f6c9-49e2-8ee7-dcf389c9ed08" status: 404 len: 111 microversion: 2.1 time: 0.025799 Apr 11 19:34:50 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 212/640] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 19:34:50 2023] GET /compute/v2.1/servers/cbd5aa3c-f6c9-49e2-8ee7-dcf389c9ed08 => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 19:34:52 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [None req-a649b178-1f6b-4cb9-901c-624d7188ac13 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Calling method '>' {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:34:52 user devstack@n-api.service[72089]: DEBUG nova.compute.api [None req-a649b178-1f6b-4cb9-901c-624d7188ac13 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] [instance: e6e3640a-c262-4e2d-a994-2e4312f22871] Fetching instance by UUID {{(pid=72089) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:34:52 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-a649b178-1f6b-4cb9-901c-624d7188ac13 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:34:52 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-a649b178-1f6b-4cb9-901c-624d7188ac13 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:34:52 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-a649b178-1f6b-4cb9-901c-624d7188ac13 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:34:52 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-a649b178-1f6b-4cb9-901c-624d7188ac13 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:34:52 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-a649b178-1f6b-4cb9-901c-624d7188ac13 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:34:52 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-a649b178-1f6b-4cb9-901c-624d7188ac13 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:34:52 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [None req-a649b178-1f6b-4cb9-901c-624d7188ac13 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e6e3640a-c262-4e2d-a994-2e4312f22871/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042586 Apr 11 19:34:52 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 220/641] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Apr 11 19:34:52 2023] GET /compute/v2.1/servers/e6e3640a-c262-4e2d-a994-2e4312f22871/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 11 19:34:52 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [None req-6086418a-8d60-4e33-8310-5440d33d09ef tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Calling method '>' {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:34:52 user devstack@n-api.service[72088]: DEBUG nova.compute.api [None req-6086418a-8d60-4e33-8310-5440d33d09ef tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] [instance: e6e3640a-c262-4e2d-a994-2e4312f22871] Fetching instance by UUID {{(pid=72088) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:34:52 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-6086418a-8d60-4e33-8310-5440d33d09ef tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:34:52 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-6086418a-8d60-4e33-8310-5440d33d09ef tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:34:52 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-6086418a-8d60-4e33-8310-5440d33d09ef tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:34:52 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-6086418a-8d60-4e33-8310-5440d33d09ef tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:34:52 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-6086418a-8d60-4e33-8310-5440d33d09ef tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:34:52 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-6086418a-8d60-4e33-8310-5440d33d09ef tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:34:52 user devstack@n-api.service[72088]: DEBUG nova.compute.api [None req-6086418a-8d60-4e33-8310-5440d33d09ef tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] [instance: e6e3640a-c262-4e2d-a994-2e4312f22871] Going to try to terminate instance {{(pid=72088) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 11 19:34:52 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [None req-6086418a-8d60-4e33-8310-5440d33d09ef tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/e6e3640a-c262-4e2d-a994-2e4312f22871" status: 204 len: 0 microversion: 2.1 time: 0.120985 Apr 11 19:34:52 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 210/642] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 19:34:52 2023] DELETE /compute/v2.1/servers/e6e3640a-c262-4e2d-a994-2e4312f22871 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Apr 11 19:34:52 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [None req-0e301f41-1933-4fef-9706-bb747e57953e tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Calling method '>' {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:34:52 user devstack@n-api.service[72090]: DEBUG nova.compute.api [None req-0e301f41-1933-4fef-9706-bb747e57953e tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] [instance: e6e3640a-c262-4e2d-a994-2e4312f22871] Fetching instance by UUID {{(pid=72090) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:34:52 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-0e301f41-1933-4fef-9706-bb747e57953e tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:34:52 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-0e301f41-1933-4fef-9706-bb747e57953e tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:34:52 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-0e301f41-1933-4fef-9706-bb747e57953e tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:34:52 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-0e301f41-1933-4fef-9706-bb747e57953e tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:34:52 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-0e301f41-1933-4fef-9706-bb747e57953e tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:34:52 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-0e301f41-1933-4fef-9706-bb747e57953e tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:34:52 user devstack@n-api.service[72090]: DEBUG nova.policy [None req-0e301f41-1933-4fef-9706-bb747e57953e tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5d405421ceb4d99967ef2e7f55e7809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06966e2f4d3a4dec92282c7ad348635d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72090) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:34:52 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [None req-0e301f41-1933-4fef-9706-bb747e57953e tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e6e3640a-c262-4e2d-a994-2e4312f22871" status: 200 len: 1669 microversion: 2.1 time: 0.182249 Apr 11 19:34:52 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 213/643] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 19:34:52 2023] GET /compute/v2.1/servers/e6e3640a-c262-4e2d-a994-2e4312f22871 => generated 1669 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 19:34:52 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [req-60c5830a-a630-473c-83fd-a243fc2e58dd req-67f8ec37-e865-4bd5-a2f9-504f3c9bbbd5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e6e3640a-c262-4e2d-a994-2e4312f22871", "name": "network-vif-unplugged", "status": "completed", "tag": "183a0478-c117-4fe1-acce-22e4aee440c9"}]} {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:34:52 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-60c5830a-a630-473c-83fd-a243fc2e58dd req-67f8ec37-e865-4bd5-a2f9-504f3c9bbbd5 service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:34:52 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-60c5830a-a630-473c-83fd-a243fc2e58dd req-67f8ec37-e865-4bd5-a2f9-504f3c9bbbd5 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:34:52 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-60c5830a-a630-473c-83fd-a243fc2e58dd req-67f8ec37-e865-4bd5-a2f9-504f3c9bbbd5 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:34:52 user devstack@n-api.service[72089]: INFO nova.api.openstack.compute.server_external_events [req-60c5830a-a630-473c-83fd-a243fc2e58dd req-67f8ec37-e865-4bd5-a2f9-504f3c9bbbd5 service nova] Creating event network-vif-unplugged:183a0478-c117-4fe1-acce-22e4aee440c9 for instance e6e3640a-c262-4e2d-a994-2e4312f22871 on user Apr 11 19:34:52 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [req-60c5830a-a630-473c-83fd-a243fc2e58dd req-67f8ec37-e865-4bd5-a2f9-504f3c9bbbd5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.029232 Apr 11 19:34:52 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 221/644] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:34:52 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:34:54 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [None req-3f55a066-d3cc-4187-b323-ac8f2fc57fa5 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-volume-backed-server-96679831", "imageRef": "", "flavorRef": "42", "block_device_mapping_v2": [{"uuid": "cfa96911-0869-4a41-97fe-ebf8f5bf1574", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "f22e45e9-cc15-401e-aed7-3506278d3d0d"}]}} {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:34:54 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [req-78fee767-2a6a-4026-98e5-56f1fb7b184b req-1ebb266d-d627-4e6f-8348-1da4d4e49914 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e6e3640a-c262-4e2d-a994-2e4312f22871", "name": "network-vif-deleted", "tag": "183a0478-c117-4fe1-acce-22e4aee440c9"}]} {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:34:54 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-78fee767-2a6a-4026-98e5-56f1fb7b184b req-1ebb266d-d627-4e6f-8348-1da4d4e49914 service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:34:54 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-78fee767-2a6a-4026-98e5-56f1fb7b184b req-1ebb266d-d627-4e6f-8348-1da4d4e49914 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:34:54 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-78fee767-2a6a-4026-98e5-56f1fb7b184b req-1ebb266d-d627-4e6f-8348-1da4d4e49914 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:34:54 user devstack@n-api.service[72090]: INFO nova.api.openstack.compute.server_external_events [req-78fee767-2a6a-4026-98e5-56f1fb7b184b req-1ebb266d-d627-4e6f-8348-1da4d4e49914 service nova] Creating event network-vif-deleted:183a0478-c117-4fe1-acce-22e4aee440c9 for instance e6e3640a-c262-4e2d-a994-2e4312f22871 on user Apr 11 19:34:54 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [req-78fee767-2a6a-4026-98e5-56f1fb7b184b req-1ebb266d-d627-4e6f-8348-1da4d4e49914 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.027108 Apr 11 19:34:54 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 214/645] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:34:54 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:34:54 user devstack@n-api.service[72088]: DEBUG nova.network.neutron [None req-3f55a066-d3cc-4187-b323-ac8f2fc57fa5 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] validate_networks() for [('f22e45e9-cc15-401e-aed7-3506278d3d0d', None, None, None, None, None)] {{(pid=72088) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 11 19:34:54 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [req-00d4c2f2-b4b2-4da2-a385-ebe3b812a32c req-8f822912-353e-46c0-aa8d-bf6a67cd2c14 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e6e3640a-c262-4e2d-a994-2e4312f22871", "name": "network-vif-plugged", "status": "completed", "tag": "183a0478-c117-4fe1-acce-22e4aee440c9"}]} {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:34:54 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-00d4c2f2-b4b2-4da2-a385-ebe3b812a32c req-8f822912-353e-46c0-aa8d-bf6a67cd2c14 service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:34:54 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-00d4c2f2-b4b2-4da2-a385-ebe3b812a32c req-8f822912-353e-46c0-aa8d-bf6a67cd2c14 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:34:54 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-00d4c2f2-b4b2-4da2-a385-ebe3b812a32c req-8f822912-353e-46c0-aa8d-bf6a67cd2c14 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:34:54 user devstack@n-api.service[72089]: INFO nova.api.openstack.compute.server_external_events [req-00d4c2f2-b4b2-4da2-a385-ebe3b812a32c req-8f822912-353e-46c0-aa8d-bf6a67cd2c14 service nova] Creating event network-vif-plugged:183a0478-c117-4fe1-acce-22e4aee440c9 for instance e6e3640a-c262-4e2d-a994-2e4312f22871 on user Apr 11 19:34:54 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [req-00d4c2f2-b4b2-4da2-a385-ebe3b812a32c req-8f822912-353e-46c0-aa8d-bf6a67cd2c14 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031171 Apr 11 19:34:54 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 222/646] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:34:54 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:34:55 user devstack@n-api.service[72088]: DEBUG nova.virt.hardware [None req-3f55a066-d3cc-4187-b323-ac8f2fc57fa5 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Flavor limits 0:0:0 {{(pid=72088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 19:34:55 user devstack@n-api.service[72088]: DEBUG nova.virt.hardware [None req-3f55a066-d3cc-4187-b323-ac8f2fc57fa5 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Image limits 0:0:0 {{(pid=72088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 19:34:55 user devstack@n-api.service[72088]: DEBUG nova.virt.hardware [None req-3f55a066-d3cc-4187-b323-ac8f2fc57fa5 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Flavor pref 0:0:0 {{(pid=72088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 19:34:55 user devstack@n-api.service[72088]: DEBUG nova.virt.hardware [None req-3f55a066-d3cc-4187-b323-ac8f2fc57fa5 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Image pref 0:0:0 {{(pid=72088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 19:34:55 user devstack@n-api.service[72088]: DEBUG nova.virt.hardware [None req-3f55a066-d3cc-4187-b323-ac8f2fc57fa5 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 19:34:55 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-3f55a066-d3cc-4187-b323-ac8f2fc57fa5 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:34:55 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-3f55a066-d3cc-4187-b323-ac8f2fc57fa5 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:34:55 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-3f55a066-d3cc-4187-b323-ac8f2fc57fa5 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:34:55 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-3f55a066-d3cc-4187-b323-ac8f2fc57fa5 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:34:55 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-3f55a066-d3cc-4187-b323-ac8f2fc57fa5 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:34:55 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-3f55a066-d3cc-4187-b323-ac8f2fc57fa5 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:34:55 user devstack@n-api.service[72088]: DEBUG nova.quota [None req-3f55a066-d3cc-4187-b323-ac8f2fc57fa5 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Getting quotas for project 2caba0618fc743e7bfb2dd866a511df9. Resources: {'ram', 'instances', 'cores'} {{(pid=72088) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 19:34:55 user devstack@n-api.service[72088]: DEBUG nova.quota [None req-3f55a066-d3cc-4187-b323-ac8f2fc57fa5 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Getting quotas for user cf262cd03f4a41c4956d8784cf37d86d and project 2caba0618fc743e7bfb2dd866a511df9. Resources: {'ram', 'instances', 'cores'} {{(pid=72088) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 19:34:55 user devstack@n-api.service[72088]: DEBUG nova.compute.api [None req-3f55a066-d3cc-4187-b323-ac8f2fc57fa5 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Going to run 1 instances... {{(pid=72088) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 11 19:34:55 user devstack@n-api.service[72088]: DEBUG nova.compute.api [None req-3f55a066-d3cc-4187-b323-ac8f2fc57fa5 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] [instance: afc22926-012a-43fe-99e6-063294c593a6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='cfa96911-0869-4a41-97fe-ebf8f5bf1574',volume_size=None,volume_type=None)] {{(pid=72088) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 11 19:34:55 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [None req-3f55a066-d3cc-4187-b323-ac8f2fc57fa5 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.670043 Apr 11 19:34:55 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 211/647] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 11 19:34:54 2023] POST /compute/v2.1/servers => generated 378 bytes in 672 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 11 19:34:55 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [None req-3a390f2f-e2a0-42ff-bd40-8d25e055bfef tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Calling method '>' {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:34:55 user devstack@n-api.service[72090]: DEBUG nova.compute.api [None req-3a390f2f-e2a0-42ff-bd40-8d25e055bfef tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] [instance: afc22926-012a-43fe-99e6-063294c593a6] Fetching instance by UUID {{(pid=72090) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:34:55 user devstack@n-api.service[72090]: DEBUG nova.policy [None req-3a390f2f-e2a0-42ff-bd40-8d25e055bfef tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf262cd03f4a41c4956d8784cf37d86d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caba0618fc743e7bfb2dd866a511df9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72090) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:34:55 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [None req-3a390f2f-e2a0-42ff-bd40-8d25e055bfef tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] 10.0.0.210 "GET /compute/v2.1/servers/afc22926-012a-43fe-99e6-063294c593a6" status: 200 len: 1064 microversion: 2.1 time: 0.059214 Apr 11 19:34:55 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 215/648] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 19:34:55 2023] GET /compute/v2.1/servers/afc22926-012a-43fe-99e6-063294c593a6 => generated 1064 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:34:57 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [req-2fded05f-3b6b-4694-aa53-1eef5869c726 req-9a0dc307-efe4-4711-9c2b-ff968a80db26 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "afc22926-012a-43fe-99e6-063294c593a6", "tag": "8491f5dc-f77b-491b-b24f-19791271647d"}]} {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:34:57 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-2fded05f-3b6b-4694-aa53-1eef5869c726 req-9a0dc307-efe4-4711-9c2b-ff968a80db26 service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:34:57 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-2fded05f-3b6b-4694-aa53-1eef5869c726 req-9a0dc307-efe4-4711-9c2b-ff968a80db26 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:34:57 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-2fded05f-3b6b-4694-aa53-1eef5869c726 req-9a0dc307-efe4-4711-9c2b-ff968a80db26 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:34:57 user devstack@n-api.service[72089]: INFO nova.api.openstack.compute.server_external_events [req-2fded05f-3b6b-4694-aa53-1eef5869c726 req-9a0dc307-efe4-4711-9c2b-ff968a80db26 service nova] Creating event network-changed:8491f5dc-f77b-491b-b24f-19791271647d for instance afc22926-012a-43fe-99e6-063294c593a6 on user Apr 11 19:34:57 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [req-2fded05f-3b6b-4694-aa53-1eef5869c726 req-9a0dc307-efe4-4711-9c2b-ff968a80db26 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.027559 Apr 11 19:34:57 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 223/649] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:34:57 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:35:01 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [None req-db355bd1-7bcf-41e1-89cf-6ad12ae8481a tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Calling method '>' {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:35:01 user devstack@n-api.service[72088]: DEBUG nova.compute.api [None req-db355bd1-7bcf-41e1-89cf-6ad12ae8481a tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] [instance: 03bb985c-4903-4d0e-98a1-43a9352f4ec6] Fetching instance by UUID {{(pid=72088) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:35:01 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-db355bd1-7bcf-41e1-89cf-6ad12ae8481a tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:35:01 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-db355bd1-7bcf-41e1-89cf-6ad12ae8481a tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:35:01 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-db355bd1-7bcf-41e1-89cf-6ad12ae8481a tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:35:01 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-db355bd1-7bcf-41e1-89cf-6ad12ae8481a tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:35:01 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-db355bd1-7bcf-41e1-89cf-6ad12ae8481a tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:35:01 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-db355bd1-7bcf-41e1-89cf-6ad12ae8481a tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:35:01 user devstack@n-api.service[72088]: INFO nova.api.openstack.wsgi [None req-db355bd1-7bcf-41e1-89cf-6ad12ae8481a tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] HTTP exception thrown: Instance 03bb985c-4903-4d0e-98a1-43a9352f4ec6 could not be found. Apr 11 19:35:01 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [None req-db355bd1-7bcf-41e1-89cf-6ad12ae8481a tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Request method failure captured: Apr 11 19:35:01 user devstack@n-api.service[72088]: request: GET /compute/v2.1/servers/03bb985c-4903-4d0e-98a1-43a9352f4ec6 HTTP/1.1 Apr 11 19:35:01 user devstack@n-api.service[72088]: Accept: application/json Apr 11 19:35:01 user devstack@n-api.service[72088]: Accept-Encoding: identity Apr 11 19:35:01 user devstack@n-api.service[72088]: Connection: close Apr 11 19:35:01 user devstack@n-api.service[72088]: Content-Length: 0 Apr 11 19:35:01 user devstack@n-api.service[72088]: Content-Type: application/json Apr 11 19:35:01 user devstack@n-api.service[72088]: Host: 10.0.0.210 Apr 11 19:35:01 user devstack@n-api.service[72088]: Openstack-System-Scope: None Apr 11 19:35:01 user devstack@n-api.service[72088]: User-Agent: python-urllib3/1.26.15 Apr 11 19:35:01 user devstack@n-api.service[72088]: X-Auth-Token: gAAAAABkNbWxfDFKvn38W01Z_CjCssLnT-2BMZi4Dl6isPkuIHw5SDhhYv0jQoPwwxoD-e_SKkKKh35dCiVbaYZDq700KdWh3p4FHBYXX2UA3fda-7SUfUt46bP3z3-JnANOAlnsiSw2JUmzEz5ZrxLU1V0Ries66oBuu5YQITBWxUCpmKcvp70 Apr 11 19:35:01 user devstack@n-api.service[72088]: X-Domain-Id: None Apr 11 19:35:01 user devstack@n-api.service[72088]: X-Domain-Name: None Apr 11 19:35:01 user devstack@n-api.service[72088]: X-Identity-Status: Confirmed Apr 11 19:35:01 user devstack@n-api.service[72088]: X-Is-Admin-Project: True Apr 11 19:35:01 user devstack@n-api.service[72088]: X-Project-Domain-Id: default Apr 11 19:35:01 user devstack@n-api.service[72088]: X-Project-Domain-Name: Default Apr 11 19:35:01 user devstack@n-api.service[72088]: X-Project-Id: 6d5246cf04a7401388cba38d16e298ae Apr 11 19:35:01 user devstack@n-api.service[72088]: X-Project-Name: tempest-VolumesSnapshotTestJSON-111705993 Apr 11 19:35:01 user devstack@n-api.service[72088]: X-Role: reader,member Apr 11 19:35:01 user devstack@n-api.service[72088]: X-Roles: reader,member Apr 11 19:35:01 user devstack@n-api.service[72088]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/6d5246cf04a7401388cba38d16e298ae"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/6d5246cf04a7401388cba38d16e298ae"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/6d5246cf04a7401388cba38d16e298ae"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 11 19:35:01 user devstack@n-api.service[72088]: X-Tenant: tempest-VolumesSnapshotTestJSON-111705993 Apr 11 19:35:01 user devstack@n-api.service[72088]: X-Tenant-Id: 6d5246cf04a7401388cba38d16e298ae Apr 11 19:35:01 user devstack@n-api.service[72088]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-111705993 Apr 11 19:35:01 user devstack@n-api.service[72088]: X-User: tempest-VolumesSnapshotTestJSON-111705993-project-member Apr 11 19:35:01 user devstack@n-api.service[72088]: X-User-Domain-Id: default Apr 11 19:35:01 user devstack@n-api.service[72088]: X-User-Domain-Name: Default Apr 11 19:35:01 user devstack@n-api.service[72088]: X-User-Id: 20f337feb0ed4653976ace530bfdd877 Apr 11 19:35:01 user devstack@n-api.service[72088]: X-User-Name: tempest-VolumesSnapshotTestJSON-111705993-project-member Apr 11 19:35:01 user devstack@n-api.service[72088]: method: > Apr 11 19:35:01 user devstack@n-api.service[72088]: exception: Instance 03bb985c-4903-4d0e-98a1-43a9352f4ec6 could not be found. Apr 11 19:35:01 user devstack@n-api.service[72088]: action_args: {'id': '03bb985c-4903-4d0e-98a1-43a9352f4ec6'} Apr 11 19:35:01 user devstack@n-api.service[72088]: {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 19:35:01 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:35:01 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 19:35:01 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 19:35:01 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 19:35:01 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 19:35:01 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 19:35:01 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 19:35:01 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 19:35:01 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 19:35:01 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 03bb985c-4903-4d0e-98a1-43a9352f4ec6 could not be found. Apr 11 19:35:01 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi Apr 11 19:35:01 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 19:35:01 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi Apr 11 19:35:01 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:35:01 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 19:35:01 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 19:35:01 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 19:35:01 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 19:35:01 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 19:35:01 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 19:35:01 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 19:35:01 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 19:35:01 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 19:35:01 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 19:35:01 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 19:35:01 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 19:35:01 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 03bb985c-4903-4d0e-98a1-43a9352f4ec6 could not be found. Apr 11 19:35:01 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi Apr 11 19:35:01 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 19:35:01 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi Apr 11 19:35:01 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:35:01 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 19:35:01 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 19:35:01 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 19:35:01 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 19:35:01 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 03bb985c-4903-4d0e-98a1-43a9352f4ec6 could not be found. Apr 11 19:35:01 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi Apr 11 19:35:01 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [None req-db355bd1-7bcf-41e1-89cf-6ad12ae8481a tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Returning 404 to user: Instance 03bb985c-4903-4d0e-98a1-43a9352f4ec6 could not be found. {{(pid=72088) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 19:35:01 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [None req-db355bd1-7bcf-41e1-89cf-6ad12ae8481a tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] 10.0.0.210 "GET /compute/v2.1/servers/03bb985c-4903-4d0e-98a1-43a9352f4ec6" status: 404 len: 111 microversion: 2.1 time: 0.047258 Apr 11 19:35:01 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 212/650] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 19:35:01 2023] GET /compute/v2.1/servers/03bb985c-4903-4d0e-98a1-43a9352f4ec6 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 19:35:03 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [req-3640d549-22b1-4442-8c35-ed7a5465bc46 req-8b2bc96b-7a0e-4ad5-826b-efa528d6a444 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "afc22926-012a-43fe-99e6-063294c593a6", "name": "network-vif-plugged", "status": "completed", "tag": "8491f5dc-f77b-491b-b24f-19791271647d"}]} {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:35:03 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-3640d549-22b1-4442-8c35-ed7a5465bc46 req-8b2bc96b-7a0e-4ad5-826b-efa528d6a444 service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:35:03 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-3640d549-22b1-4442-8c35-ed7a5465bc46 req-8b2bc96b-7a0e-4ad5-826b-efa528d6a444 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:35:03 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-3640d549-22b1-4442-8c35-ed7a5465bc46 req-8b2bc96b-7a0e-4ad5-826b-efa528d6a444 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:35:03 user devstack@n-api.service[72090]: INFO nova.api.openstack.compute.server_external_events [req-3640d549-22b1-4442-8c35-ed7a5465bc46 req-8b2bc96b-7a0e-4ad5-826b-efa528d6a444 service nova] Creating event network-vif-plugged:8491f5dc-f77b-491b-b24f-19791271647d for instance afc22926-012a-43fe-99e6-063294c593a6 on user Apr 11 19:35:03 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [req-3640d549-22b1-4442-8c35-ed7a5465bc46 req-8b2bc96b-7a0e-4ad5-826b-efa528d6a444 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036705 Apr 11 19:35:03 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 216/651] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:35:03 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:35:05 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [None req-5ba8fdb9-cc3a-473a-901d-4a453a07d2a0 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Calling method '>' {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:35:05 user devstack@n-api.service[72089]: DEBUG nova.compute.api [None req-5ba8fdb9-cc3a-473a-901d-4a453a07d2a0 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] [instance: 6802f099-9236-4c79-a892-2963f1b15b0e] Fetching instance by UUID {{(pid=72089) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:35:05 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-5ba8fdb9-cc3a-473a-901d-4a453a07d2a0 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:35:05 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-5ba8fdb9-cc3a-473a-901d-4a453a07d2a0 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:35:05 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-5ba8fdb9-cc3a-473a-901d-4a453a07d2a0 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:35:05 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-5ba8fdb9-cc3a-473a-901d-4a453a07d2a0 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:35:05 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-5ba8fdb9-cc3a-473a-901d-4a453a07d2a0 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:35:05 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-5ba8fdb9-cc3a-473a-901d-4a453a07d2a0 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:35:05 user devstack@n-api.service[72089]: INFO nova.api.openstack.wsgi [None req-5ba8fdb9-cc3a-473a-901d-4a453a07d2a0 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] HTTP exception thrown: Instance 6802f099-9236-4c79-a892-2963f1b15b0e could not be found. Apr 11 19:35:05 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [None req-5ba8fdb9-cc3a-473a-901d-4a453a07d2a0 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Request method failure captured: Apr 11 19:35:05 user devstack@n-api.service[72089]: request: GET /compute/v2.1/servers/6802f099-9236-4c79-a892-2963f1b15b0e HTTP/1.1 Apr 11 19:35:05 user devstack@n-api.service[72089]: Accept: application/json Apr 11 19:35:05 user devstack@n-api.service[72089]: Accept-Encoding: identity Apr 11 19:35:05 user devstack@n-api.service[72089]: Connection: close Apr 11 19:35:05 user devstack@n-api.service[72089]: Content-Length: 0 Apr 11 19:35:05 user devstack@n-api.service[72089]: Content-Type: application/json Apr 11 19:35:05 user devstack@n-api.service[72089]: Host: 10.0.0.210 Apr 11 19:35:05 user devstack@n-api.service[72089]: Openstack-System-Scope: None Apr 11 19:35:05 user devstack@n-api.service[72089]: User-Agent: python-urllib3/1.26.15 Apr 11 19:35:05 user devstack@n-api.service[72089]: X-Auth-Token: gAAAAABkNbP8CMA9AeqH6ZTVBd6hPwyKW_mqzEk8TCy4_VwSHrn57Z_Bda3pQyUpuJX-ml6c86d6mPZr4tj0gPWVWRPU1qaBq_1kuRr0YmufsHHqiO99gy3dKVELLchOjYaKmeBKQQIjjUs9wfAR3HauKGrU7HoBmX3383Ea9RGxN47AXJGWJkA Apr 11 19:35:05 user devstack@n-api.service[72089]: X-Domain-Id: None Apr 11 19:35:05 user devstack@n-api.service[72089]: X-Domain-Name: None Apr 11 19:35:05 user devstack@n-api.service[72089]: X-Identity-Status: Confirmed Apr 11 19:35:05 user devstack@n-api.service[72089]: X-Is-Admin-Project: True Apr 11 19:35:05 user devstack@n-api.service[72089]: X-Project-Domain-Id: default Apr 11 19:35:05 user devstack@n-api.service[72089]: X-Project-Domain-Name: Default Apr 11 19:35:05 user devstack@n-api.service[72089]: X-Project-Id: d886d2ec5fc946b49af3c8ca7c8556c7 Apr 11 19:35:05 user devstack@n-api.service[72089]: X-Project-Name: tempest-AttachVolumeTestJSON-2144032498 Apr 11 19:35:05 user devstack@n-api.service[72089]: X-Role: reader,member Apr 11 19:35:05 user devstack@n-api.service[72089]: X-Roles: reader,member Apr 11 19:35:05 user devstack@n-api.service[72089]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d886d2ec5fc946b49af3c8ca7c8556c7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/d886d2ec5fc946b49af3c8ca7c8556c7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d886d2ec5fc946b49af3c8ca7c8556c7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 11 19:35:05 user devstack@n-api.service[72089]: X-Tenant: tempest-AttachVolumeTestJSON-2144032498 Apr 11 19:35:05 user devstack@n-api.service[72089]: X-Tenant-Id: d886d2ec5fc946b49af3c8ca7c8556c7 Apr 11 19:35:05 user devstack@n-api.service[72089]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2144032498 Apr 11 19:35:05 user devstack@n-api.service[72089]: X-User: tempest-AttachVolumeTestJSON-2144032498-project-member Apr 11 19:35:05 user devstack@n-api.service[72089]: X-User-Domain-Id: default Apr 11 19:35:05 user devstack@n-api.service[72089]: X-User-Domain-Name: Default Apr 11 19:35:05 user devstack@n-api.service[72089]: X-User-Id: 31c237e142784bd6aa460d6f1bf33400 Apr 11 19:35:05 user devstack@n-api.service[72089]: X-User-Name: tempest-AttachVolumeTestJSON-2144032498-project-member Apr 11 19:35:05 user devstack@n-api.service[72089]: method: > Apr 11 19:35:05 user devstack@n-api.service[72089]: exception: Instance 6802f099-9236-4c79-a892-2963f1b15b0e could not be found. Apr 11 19:35:05 user devstack@n-api.service[72089]: action_args: {'id': '6802f099-9236-4c79-a892-2963f1b15b0e'} Apr 11 19:35:05 user devstack@n-api.service[72089]: {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 19:35:05 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:35:05 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 19:35:05 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 19:35:05 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 19:35:05 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 19:35:05 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 19:35:05 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 19:35:05 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 19:35:05 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 19:35:05 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6802f099-9236-4c79-a892-2963f1b15b0e could not be found. Apr 11 19:35:05 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi Apr 11 19:35:05 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 19:35:05 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi Apr 11 19:35:05 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:35:05 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 19:35:05 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 19:35:05 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 19:35:05 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 19:35:05 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 19:35:05 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 19:35:05 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 19:35:05 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 19:35:05 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 19:35:05 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 19:35:05 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 19:35:05 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 19:35:05 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6802f099-9236-4c79-a892-2963f1b15b0e could not be found. Apr 11 19:35:05 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi Apr 11 19:35:05 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 19:35:05 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi Apr 11 19:35:05 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:35:05 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 19:35:05 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 19:35:05 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 19:35:05 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 19:35:05 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6802f099-9236-4c79-a892-2963f1b15b0e could not be found. Apr 11 19:35:05 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi Apr 11 19:35:05 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [None req-5ba8fdb9-cc3a-473a-901d-4a453a07d2a0 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Returning 404 to user: Instance 6802f099-9236-4c79-a892-2963f1b15b0e could not be found. {{(pid=72089) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 19:35:05 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [None req-5ba8fdb9-cc3a-473a-901d-4a453a07d2a0 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6802f099-9236-4c79-a892-2963f1b15b0e" status: 404 len: 111 microversion: 2.1 time: 0.027930 Apr 11 19:35:05 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 224/652] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 19:35:05 2023] GET /compute/v2.1/servers/6802f099-9236-4c79-a892-2963f1b15b0e => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 19:35:05 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [None req-826ed3a6-6c1f-463f-b9a2-01f2ab3f872d tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Calling method '.version_select at 0x7f119da36e60>' {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:35:05 user devstack@n-api.service[72088]: DEBUG dbcounter [-] [72088] Writing DB stats nova_cell0:SELECT=2 {{(pid=72088) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:35:05 user devstack@n-api.service[72088]: DEBUG dbcounter [-] [72088] Writing DB stats nova_cell0:SELECT=6 {{(pid=72088) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:35:05 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [None req-826ed3a6-6c1f-463f-b9a2-01f2ab3f872d tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1431410116" status: 202 len: 0 microversion: 2.1 time: 0.024903 Apr 11 19:35:05 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 213/653] 10.0.0.210 () {62 vars in 1298 bytes} [Tue Apr 11 19:35:05 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1431410116 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 11 19:35:05 user devstack@n-api.service[72090]: DEBUG dbcounter [-] [72090] Writing DB stats nova_cell0:SELECT=2 {{(pid=72090) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:35:05 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [req-8df607cc-023a-4f77-9cde-16d740e5ce15 req-c776e41c-1aca-4054-be30-a38c3e4b1423 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "afc22926-012a-43fe-99e6-063294c593a6", "name": "network-vif-plugged", "status": "completed", "tag": "8491f5dc-f77b-491b-b24f-19791271647d"}]} {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:35:05 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-8df607cc-023a-4f77-9cde-16d740e5ce15 req-c776e41c-1aca-4054-be30-a38c3e4b1423 service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:35:05 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-8df607cc-023a-4f77-9cde-16d740e5ce15 req-c776e41c-1aca-4054-be30-a38c3e4b1423 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:35:05 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-8df607cc-023a-4f77-9cde-16d740e5ce15 req-c776e41c-1aca-4054-be30-a38c3e4b1423 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:35:05 user devstack@n-api.service[72090]: INFO nova.api.openstack.compute.server_external_events [req-8df607cc-023a-4f77-9cde-16d740e5ce15 req-c776e41c-1aca-4054-be30-a38c3e4b1423 service nova] Creating event network-vif-plugged:8491f5dc-f77b-491b-b24f-19791271647d for instance afc22926-012a-43fe-99e6-063294c593a6 on user Apr 11 19:35:05 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [req-8df607cc-023a-4f77-9cde-16d740e5ce15 req-c776e41c-1aca-4054-be30-a38c3e4b1423 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037352 Apr 11 19:35:05 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 217/654] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:35:05 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:35:06 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [None req-67189626-e3d8-4ee9-a7ea-77d59d235d8c tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Action: 'create', calling method: .version_select at 0x7f119dbeb7f0>, body: {"keypair": {"name": "tempest-keypair-1741457082", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHj5U4wRknz1MMM6VxHMYJlHXKjuSjf0vHEAMH6+Udiac3pru4iQbtKDLsL6uIMSU8FT7pn+fHTrDxPsnf9BfAtyaZLT+gR1T3aHFQYwoKhwFOr64bBxhyIiMbG8SlmhFw=="}} {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:35:06 user devstack@n-api.service[72089]: DEBUG nova.quota [None req-67189626-e3d8-4ee9-a7ea-77d59d235d8c tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Getting quotas for project d886d2ec5fc946b49af3c8ca7c8556c7. Resources: {'key_pairs'} {{(pid=72089) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 19:35:06 user devstack@n-api.service[72089]: DEBUG nova.quota [None req-67189626-e3d8-4ee9-a7ea-77d59d235d8c tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Getting quotas for user 31c237e142784bd6aa460d6f1bf33400 and project d886d2ec5fc946b49af3c8ca7c8556c7. Resources: {'key_pairs'} {{(pid=72089) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 19:35:06 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [None req-67189626-e3d8-4ee9-a7ea-77d59d235d8c tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.055208 Apr 11 19:35:06 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 225/655] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Apr 11 19:35:06 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:35:06 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [None req-ef04d3b5-eea6-4f46-8dd7-af6736ebcd5f tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-90407416", "imageRef": "4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b", "flavorRef": "42", "networks": [{"uuid": "18af527e-3475-4ab6-a415-0076cb1766db"}]}} {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:35:06 user devstack@n-api.service[72088]: DEBUG nova.network.neutron [None req-ef04d3b5-eea6-4f46-8dd7-af6736ebcd5f tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] validate_networks() for [('18af527e-3475-4ab6-a415-0076cb1766db', None, None, None, None, None)] {{(pid=72088) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 11 19:35:07 user devstack@n-api.service[72088]: DEBUG nova.virt.hardware [None req-ef04d3b5-eea6-4f46-8dd7-af6736ebcd5f tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Flavor limits 0:0:0 {{(pid=72088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 19:35:07 user devstack@n-api.service[72088]: DEBUG nova.virt.hardware [None req-ef04d3b5-eea6-4f46-8dd7-af6736ebcd5f tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Image limits 0:0:0 {{(pid=72088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 19:35:07 user devstack@n-api.service[72088]: DEBUG nova.virt.hardware [None req-ef04d3b5-eea6-4f46-8dd7-af6736ebcd5f tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Flavor pref 0:0:0 {{(pid=72088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 19:35:07 user devstack@n-api.service[72088]: DEBUG nova.virt.hardware [None req-ef04d3b5-eea6-4f46-8dd7-af6736ebcd5f tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Image pref 0:0:0 {{(pid=72088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 19:35:07 user devstack@n-api.service[72088]: DEBUG nova.virt.hardware [None req-ef04d3b5-eea6-4f46-8dd7-af6736ebcd5f tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 19:35:07 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-ef04d3b5-eea6-4f46-8dd7-af6736ebcd5f tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:35:07 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-ef04d3b5-eea6-4f46-8dd7-af6736ebcd5f tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:35:07 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-ef04d3b5-eea6-4f46-8dd7-af6736ebcd5f tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:35:07 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-ef04d3b5-eea6-4f46-8dd7-af6736ebcd5f tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:35:07 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-ef04d3b5-eea6-4f46-8dd7-af6736ebcd5f tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:35:07 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-ef04d3b5-eea6-4f46-8dd7-af6736ebcd5f tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:35:07 user devstack@n-api.service[72088]: DEBUG nova.quota [None req-ef04d3b5-eea6-4f46-8dd7-af6736ebcd5f tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Getting quotas for project 6d5246cf04a7401388cba38d16e298ae. Resources: {'ram', 'instances', 'cores'} {{(pid=72088) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 19:35:07 user devstack@n-api.service[72088]: DEBUG nova.quota [None req-ef04d3b5-eea6-4f46-8dd7-af6736ebcd5f tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Getting quotas for user 20f337feb0ed4653976ace530bfdd877 and project 6d5246cf04a7401388cba38d16e298ae. Resources: {'ram', 'instances', 'cores'} {{(pid=72088) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 19:35:07 user devstack@n-api.service[72088]: DEBUG nova.compute.api [None req-ef04d3b5-eea6-4f46-8dd7-af6736ebcd5f tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Going to run 1 instances... {{(pid=72088) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 11 19:35:07 user devstack@n-api.service[72088]: DEBUG nova.compute.api [None req-ef04d3b5-eea6-4f46-8dd7-af6736ebcd5f tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] [instance: 5d000531-5884-405d-9e17-1dc5f39226d0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=72088) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 11 19:35:07 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [None req-ef04d3b5-eea6-4f46-8dd7-af6736ebcd5f tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.533948 Apr 11 19:35:07 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 214/656] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 11 19:35:06 2023] POST /compute/v2.1/servers => generated 378 bytes in 535 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 11 19:35:07 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [None req-e041d9ba-c079-4eae-b4ad-bc328a68025d tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Calling method '>' {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:35:07 user devstack@n-api.service[72090]: DEBUG nova.compute.api [None req-e041d9ba-c079-4eae-b4ad-bc328a68025d tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] [instance: 5d000531-5884-405d-9e17-1dc5f39226d0] Fetching instance by UUID {{(pid=72090) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:35:07 user devstack@n-api.service[72090]: DEBUG nova.policy [None req-e041d9ba-c079-4eae-b4ad-bc328a68025d tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20f337feb0ed4653976ace530bfdd877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d5246cf04a7401388cba38d16e298ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72090) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:35:07 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [None req-e041d9ba-c079-4eae-b4ad-bc328a68025d tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5d000531-5884-405d-9e17-1dc5f39226d0" status: 200 len: 1211 microversion: 2.1 time: 0.064423 Apr 11 19:35:07 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 218/657] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 19:35:07 2023] GET /compute/v2.1/servers/5d000531-5884-405d-9e17-1dc5f39226d0 => generated 1211 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:35:07 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [None req-17d6d4fa-b1a9-46f5-9f0a-449cea91d951 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-239003632", "imageRef": "4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "5e65a1b0-a59c-43dd-abed-4aa020abdf5a"}], "security_groups": [{"name": "tempest-securitygroup--1380145196"}], "key_name": "tempest-keypair-1741457082", "user_data": "}} {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:35:08 user devstack@n-api.service[72089]: DEBUG nova.network.neutron [None req-17d6d4fa-b1a9-46f5-9f0a-449cea91d951 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] validate_networks() for [('5e65a1b0-a59c-43dd-abed-4aa020abdf5a', None, None, None, None, None)] {{(pid=72089) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 11 19:35:08 user devstack@n-api.service[72089]: DEBUG nova.virt.hardware [None req-17d6d4fa-b1a9-46f5-9f0a-449cea91d951 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Flavor limits 0:0:0 {{(pid=72089) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 19:35:08 user devstack@n-api.service[72089]: DEBUG nova.virt.hardware [None req-17d6d4fa-b1a9-46f5-9f0a-449cea91d951 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Image limits 0:0:0 {{(pid=72089) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 19:35:08 user devstack@n-api.service[72089]: DEBUG nova.virt.hardware [None req-17d6d4fa-b1a9-46f5-9f0a-449cea91d951 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Flavor pref 0:0:0 {{(pid=72089) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 19:35:08 user devstack@n-api.service[72089]: DEBUG nova.virt.hardware [None req-17d6d4fa-b1a9-46f5-9f0a-449cea91d951 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Image pref 0:0:0 {{(pid=72089) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 19:35:08 user devstack@n-api.service[72089]: DEBUG nova.virt.hardware [None req-17d6d4fa-b1a9-46f5-9f0a-449cea91d951 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72089) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 19:35:08 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-17d6d4fa-b1a9-46f5-9f0a-449cea91d951 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:35:08 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-17d6d4fa-b1a9-46f5-9f0a-449cea91d951 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:35:08 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-17d6d4fa-b1a9-46f5-9f0a-449cea91d951 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:35:08 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-17d6d4fa-b1a9-46f5-9f0a-449cea91d951 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:35:08 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-17d6d4fa-b1a9-46f5-9f0a-449cea91d951 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:35:08 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-17d6d4fa-b1a9-46f5-9f0a-449cea91d951 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:35:08 user devstack@n-api.service[72089]: DEBUG nova.quota [None req-17d6d4fa-b1a9-46f5-9f0a-449cea91d951 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Getting quotas for project d886d2ec5fc946b49af3c8ca7c8556c7. Resources: {'ram', 'instances', 'cores'} {{(pid=72089) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 19:35:08 user devstack@n-api.service[72089]: DEBUG nova.quota [None req-17d6d4fa-b1a9-46f5-9f0a-449cea91d951 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Getting quotas for user 31c237e142784bd6aa460d6f1bf33400 and project d886d2ec5fc946b49af3c8ca7c8556c7. Resources: {'ram', 'instances', 'cores'} {{(pid=72089) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 19:35:08 user devstack@n-api.service[72089]: DEBUG nova.compute.api [None req-17d6d4fa-b1a9-46f5-9f0a-449cea91d951 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Going to run 1 instances... {{(pid=72089) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 11 19:35:08 user devstack@n-api.service[72089]: DEBUG nova.compute.api [None req-17d6d4fa-b1a9-46f5-9f0a-449cea91d951 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] [instance: bd559e67-3c8f-42b4-b1d6-fd171c8850b8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=72089) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 11 19:35:08 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [None req-17d6d4fa-b1a9-46f5-9f0a-449cea91d951 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 1.000489 Apr 11 19:35:08 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 226/658] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 11 19:35:07 2023] POST /compute/v2.1/servers => generated 400 bytes in 1002 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 11 19:35:09 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [None req-16b6a931-8ad5-45b1-a021-ca757e707e65 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Calling method '>' {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:35:09 user devstack@n-api.service[72088]: DEBUG nova.compute.api [None req-16b6a931-8ad5-45b1-a021-ca757e707e65 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] [instance: bd559e67-3c8f-42b4-b1d6-fd171c8850b8] Fetching instance by UUID {{(pid=72088) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:35:09 user devstack@n-api.service[72088]: DEBUG nova.policy [None req-16b6a931-8ad5-45b1-a021-ca757e707e65 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31c237e142784bd6aa460d6f1bf33400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd886d2ec5fc946b49af3c8ca7c8556c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72088) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:35:09 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [None req-16b6a931-8ad5-45b1-a021-ca757e707e65 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bd559e67-3c8f-42b4-b1d6-fd171c8850b8" status: 200 len: 1231 microversion: 2.1 time: 0.074929 Apr 11 19:35:09 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 215/659] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 19:35:09 2023] GET /compute/v2.1/servers/bd559e67-3c8f-42b4-b1d6-fd171c8850b8 => generated 1231 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:35:09 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [req-0d01936c-ee5d-4684-848a-fcd61c4c551c req-cef5e749-4c40-431c-953e-528f753620e5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5d000531-5884-405d-9e17-1dc5f39226d0", "tag": "0ff284fa-ebe1-4fe5-9942-7d57a7bb641a"}]} {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:35:09 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-0d01936c-ee5d-4684-848a-fcd61c4c551c req-cef5e749-4c40-431c-953e-528f753620e5 service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:35:09 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-0d01936c-ee5d-4684-848a-fcd61c4c551c req-cef5e749-4c40-431c-953e-528f753620e5 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:35:09 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-0d01936c-ee5d-4684-848a-fcd61c4c551c req-cef5e749-4c40-431c-953e-528f753620e5 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:35:09 user devstack@n-api.service[72090]: INFO nova.api.openstack.compute.server_external_events [req-0d01936c-ee5d-4684-848a-fcd61c4c551c req-cef5e749-4c40-431c-953e-528f753620e5 service nova] Creating event network-changed:0ff284fa-ebe1-4fe5-9942-7d57a7bb641a for instance 5d000531-5884-405d-9e17-1dc5f39226d0 on user Apr 11 19:35:09 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [req-0d01936c-ee5d-4684-848a-fcd61c4c551c req-cef5e749-4c40-431c-953e-528f753620e5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032070 Apr 11 19:35:09 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 219/660] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:35:09 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:35:11 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [req-5de0b140-909a-4ca2-b847-9fd3fa1dffdd req-bdd62476-ac9d-4ca7-9354-5354ec0ff719 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bd559e67-3c8f-42b4-b1d6-fd171c8850b8", "tag": "ed9fd5c5-52fb-4d71-9ba0-911eaa1a92a2"}]} {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:35:11 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-5de0b140-909a-4ca2-b847-9fd3fa1dffdd req-bdd62476-ac9d-4ca7-9354-5354ec0ff719 service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:35:11 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-5de0b140-909a-4ca2-b847-9fd3fa1dffdd req-bdd62476-ac9d-4ca7-9354-5354ec0ff719 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:35:11 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-5de0b140-909a-4ca2-b847-9fd3fa1dffdd req-bdd62476-ac9d-4ca7-9354-5354ec0ff719 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:35:11 user devstack@n-api.service[72089]: INFO nova.api.openstack.compute.server_external_events [req-5de0b140-909a-4ca2-b847-9fd3fa1dffdd req-bdd62476-ac9d-4ca7-9354-5354ec0ff719 service nova] Creating event network-changed:ed9fd5c5-52fb-4d71-9ba0-911eaa1a92a2 for instance bd559e67-3c8f-42b4-b1d6-fd171c8850b8 on user Apr 11 19:35:11 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [req-5de0b140-909a-4ca2-b847-9fd3fa1dffdd req-bdd62476-ac9d-4ca7-9354-5354ec0ff719 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032941 Apr 11 19:35:11 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 227/661] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:35:11 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:35:12 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [req-d1f61cba-8dbd-4357-b971-c167497448ec req-1699885c-c34d-43ef-9f57-4943c55f7153 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d000531-5884-405d-9e17-1dc5f39226d0", "name": "network-vif-plugged", "status": "completed", "tag": "0ff284fa-ebe1-4fe5-9942-7d57a7bb641a"}]} {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:35:12 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-d1f61cba-8dbd-4357-b971-c167497448ec req-1699885c-c34d-43ef-9f57-4943c55f7153 service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:35:12 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-d1f61cba-8dbd-4357-b971-c167497448ec req-1699885c-c34d-43ef-9f57-4943c55f7153 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:35:12 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-d1f61cba-8dbd-4357-b971-c167497448ec req-1699885c-c34d-43ef-9f57-4943c55f7153 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:35:12 user devstack@n-api.service[72088]: INFO nova.api.openstack.compute.server_external_events [req-d1f61cba-8dbd-4357-b971-c167497448ec req-1699885c-c34d-43ef-9f57-4943c55f7153 service nova] Creating event network-vif-plugged:0ff284fa-ebe1-4fe5-9942-7d57a7bb641a for instance 5d000531-5884-405d-9e17-1dc5f39226d0 on user Apr 11 19:35:12 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [req-d1f61cba-8dbd-4357-b971-c167497448ec req-1699885c-c34d-43ef-9f57-4943c55f7153 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029876 Apr 11 19:35:12 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 216/662] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:35:12 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:35:13 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [req-72842ccf-141f-45ff-aa32-94e3236c7a5e req-f35b9568-e50e-4f70-a268-81a687cf2882 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd559e67-3c8f-42b4-b1d6-fd171c8850b8", "name": "network-vif-plugged", "status": "completed", "tag": "ed9fd5c5-52fb-4d71-9ba0-911eaa1a92a2"}]} {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:35:13 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-72842ccf-141f-45ff-aa32-94e3236c7a5e req-f35b9568-e50e-4f70-a268-81a687cf2882 service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:35:13 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-72842ccf-141f-45ff-aa32-94e3236c7a5e req-f35b9568-e50e-4f70-a268-81a687cf2882 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:35:13 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-72842ccf-141f-45ff-aa32-94e3236c7a5e req-f35b9568-e50e-4f70-a268-81a687cf2882 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:35:13 user devstack@n-api.service[72090]: INFO nova.api.openstack.compute.server_external_events [req-72842ccf-141f-45ff-aa32-94e3236c7a5e req-f35b9568-e50e-4f70-a268-81a687cf2882 service nova] Creating event network-vif-plugged:ed9fd5c5-52fb-4d71-9ba0-911eaa1a92a2 for instance bd559e67-3c8f-42b4-b1d6-fd171c8850b8 on user Apr 11 19:35:13 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [req-72842ccf-141f-45ff-aa32-94e3236c7a5e req-f35b9568-e50e-4f70-a268-81a687cf2882 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049077 Apr 11 19:35:13 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 220/663] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:35:13 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:35:14 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [req-26da59a5-ada1-45b7-b9c2-7ebf527aeb85 req-70a89b86-2e09-4a7e-bf35-bac81376be9b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d000531-5884-405d-9e17-1dc5f39226d0", "name": "network-vif-plugged", "status": "completed", "tag": "0ff284fa-ebe1-4fe5-9942-7d57a7bb641a"}]} {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:35:14 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-26da59a5-ada1-45b7-b9c2-7ebf527aeb85 req-70a89b86-2e09-4a7e-bf35-bac81376be9b service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:35:14 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-26da59a5-ada1-45b7-b9c2-7ebf527aeb85 req-70a89b86-2e09-4a7e-bf35-bac81376be9b service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:35:14 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-26da59a5-ada1-45b7-b9c2-7ebf527aeb85 req-70a89b86-2e09-4a7e-bf35-bac81376be9b service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:35:14 user devstack@n-api.service[72089]: INFO nova.api.openstack.compute.server_external_events [req-26da59a5-ada1-45b7-b9c2-7ebf527aeb85 req-70a89b86-2e09-4a7e-bf35-bac81376be9b service nova] Creating event network-vif-plugged:0ff284fa-ebe1-4fe5-9942-7d57a7bb641a for instance 5d000531-5884-405d-9e17-1dc5f39226d0 on user Apr 11 19:35:14 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [req-26da59a5-ada1-45b7-b9c2-7ebf527aeb85 req-70a89b86-2e09-4a7e-bf35-bac81376be9b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057752 Apr 11 19:35:14 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 228/664] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:35:14 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:35:15 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [req-ead1efcc-92bc-47ca-a236-5facc4dfd527 req-79ae127b-13d5-41a9-9d0c-3ab6fa48bed3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd559e67-3c8f-42b4-b1d6-fd171c8850b8", "name": "network-vif-plugged", "status": "completed", "tag": "ed9fd5c5-52fb-4d71-9ba0-911eaa1a92a2"}]} {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:35:15 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-ead1efcc-92bc-47ca-a236-5facc4dfd527 req-79ae127b-13d5-41a9-9d0c-3ab6fa48bed3 service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:35:15 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-ead1efcc-92bc-47ca-a236-5facc4dfd527 req-79ae127b-13d5-41a9-9d0c-3ab6fa48bed3 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:35:15 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-ead1efcc-92bc-47ca-a236-5facc4dfd527 req-79ae127b-13d5-41a9-9d0c-3ab6fa48bed3 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:35:15 user devstack@n-api.service[72088]: INFO nova.api.openstack.compute.server_external_events [req-ead1efcc-92bc-47ca-a236-5facc4dfd527 req-79ae127b-13d5-41a9-9d0c-3ab6fa48bed3 service nova] Creating event network-vif-plugged:ed9fd5c5-52fb-4d71-9ba0-911eaa1a92a2 for instance bd559e67-3c8f-42b4-b1d6-fd171c8850b8 on user Apr 11 19:35:15 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [req-ead1efcc-92bc-47ca-a236-5facc4dfd527 req-79ae127b-13d5-41a9-9d0c-3ab6fa48bed3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036704 Apr 11 19:35:15 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 217/665] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:35:15 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:35:23 user devstack@n-api.service[72090]: DEBUG dbcounter [-] [72090] Writing DB stats nova_cell0:SELECT=2 {{(pid=72090) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:35:23 user devstack@n-api.service[72090]: DEBUG dbcounter [-] [72090] Writing DB stats nova_api:SELECT=26 {{(pid=72090) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:35:23 user devstack@n-api.service[72090]: DEBUG dbcounter [-] [72090] Writing DB stats nova_cell1:SELECT=24 {{(pid=72090) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:35:23 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [None req-048f4197-da02-49fd-81b4-e73abfbca548 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Calling method '>' {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:35:23 user devstack@n-api.service[72090]: DEBUG nova.compute.api [None req-048f4197-da02-49fd-81b4-e73abfbca548 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] [instance: 267c17c1-f0b6-4e18-8c18-5e5bbe8a2251] Fetching instance by UUID {{(pid=72090) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:35:23 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-048f4197-da02-49fd-81b4-e73abfbca548 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:35:23 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-048f4197-da02-49fd-81b4-e73abfbca548 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:35:23 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-048f4197-da02-49fd-81b4-e73abfbca548 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:35:23 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-048f4197-da02-49fd-81b4-e73abfbca548 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:35:23 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-048f4197-da02-49fd-81b4-e73abfbca548 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:35:23 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-048f4197-da02-49fd-81b4-e73abfbca548 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:35:24 user devstack@n-api.service[72090]: DEBUG nova.policy [None req-048f4197-da02-49fd-81b4-e73abfbca548 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba7f82b529e74d99838b6264b94d823b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e3a291c54b49db8e12a88ba41865e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72090) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:35:24 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [None req-048f4197-da02-49fd-81b4-e73abfbca548 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] 10.0.0.210 "GET /compute/v2.1/servers/267c17c1-f0b6-4e18-8c18-5e5bbe8a2251" status: 200 len: 1490 microversion: 2.1 time: 0.268814 Apr 11 19:35:24 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 221/666] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 19:35:23 2023] GET /compute/v2.1/servers/267c17c1-f0b6-4e18-8c18-5e5bbe8a2251 => generated 1490 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:35:27 user devstack@n-api.service[72089]: DEBUG dbcounter [-] [72089] Writing DB stats nova_cell0:SELECT=2 {{(pid=72089) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:35:27 user devstack@n-api.service[72089]: DEBUG dbcounter [-] [72089] Writing DB stats nova_cell0:SELECT=10 {{(pid=72089) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:35:27 user devstack@n-api.service[72089]: DEBUG dbcounter [-] [72089] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=4 {{(pid=72089) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:35:27 user devstack@n-api.service[72089]: DEBUG dbcounter [-] [72089] Writing DB stats nova_cell1:SELECT=22 {{(pid=72089) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:35:27 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [None req-1aa20065-a8fe-4e06-8ac1-d18e39d77820 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Calling method '>' {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:35:27 user devstack@n-api.service[72089]: DEBUG nova.compute.api [None req-1aa20065-a8fe-4e06-8ac1-d18e39d77820 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] [instance: 647674d8-af53-405a-8116-4b7a01549bdf] Fetching instance by UUID {{(pid=72089) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:35:27 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-1aa20065-a8fe-4e06-8ac1-d18e39d77820 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:35:27 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-1aa20065-a8fe-4e06-8ac1-d18e39d77820 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:35:27 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-1aa20065-a8fe-4e06-8ac1-d18e39d77820 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:35:27 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-1aa20065-a8fe-4e06-8ac1-d18e39d77820 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:35:27 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-1aa20065-a8fe-4e06-8ac1-d18e39d77820 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:35:27 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-1aa20065-a8fe-4e06-8ac1-d18e39d77820 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:35:27 user devstack@n-api.service[72089]: DEBUG nova.policy [None req-1aa20065-a8fe-4e06-8ac1-d18e39d77820 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05fb551c320a48f98a4ec00a7f7492d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60a7381a31b84e97a068528f90813773', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72089) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:35:27 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [None req-1aa20065-a8fe-4e06-8ac1-d18e39d77820 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] 10.0.0.210 "GET /compute/v2.1/servers/647674d8-af53-405a-8116-4b7a01549bdf" status: 200 len: 1677 microversion: 2.1 time: 0.164554 Apr 11 19:35:27 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 229/667] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 19:35:27 2023] GET /compute/v2.1/servers/647674d8-af53-405a-8116-4b7a01549bdf => generated 1677 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:35:27 user devstack@n-api.service[72088]: DEBUG dbcounter [-] [72088] Writing DB stats nova_cell0:SELECT=2 {{(pid=72088) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:35:27 user devstack@n-api.service[72088]: DEBUG dbcounter [-] [72088] Writing DB stats nova_cell0:SELECT=8 {{(pid=72088) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:35:27 user devstack@n-api.service[72088]: DEBUG dbcounter [-] [72088] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1,nova_api:INSERT=6,nova_api:DELETE=1 {{(pid=72088) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:35:27 user devstack@n-api.service[72088]: DEBUG dbcounter [-] [72088] Writing DB stats nova_cell1:SELECT=33,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=72088) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:35:27 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [None req-3dec674a-fb88-4332-a982-a0779ca9e195 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8f069dda-26af-4766-b53f-0a831de5011e"}} {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:35:27 user devstack@n-api.service[72088]: DEBUG nova.compute.api [None req-3dec674a-fb88-4332-a982-a0779ca9e195 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] [instance: 647674d8-af53-405a-8116-4b7a01549bdf] Fetching instance by UUID {{(pid=72088) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:35:27 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-3dec674a-fb88-4332-a982-a0779ca9e195 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:35:27 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-3dec674a-fb88-4332-a982-a0779ca9e195 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:35:27 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-3dec674a-fb88-4332-a982-a0779ca9e195 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:35:27 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-3dec674a-fb88-4332-a982-a0779ca9e195 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:35:27 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-3dec674a-fb88-4332-a982-a0779ca9e195 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:35:27 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-3dec674a-fb88-4332-a982-a0779ca9e195 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:35:27 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [None req-3dec674a-fb88-4332-a982-a0779ca9e195 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] 10.0.0.210 "POST /compute/v2.1/servers/647674d8-af53-405a-8116-4b7a01549bdf/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.286790 Apr 11 19:35:27 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 218/668] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Apr 11 19:35:27 2023] POST /compute/v2.1/servers/647674d8-af53-405a-8116-4b7a01549bdf/os-volume_attachments => generated 194 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:35:34 user devstack@n-api.service[72090]: DEBUG dbcounter [-] [72090] Writing DB stats nova_api:SELECT=2 {{(pid=72090) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:35:34 user devstack@n-api.service[72090]: DEBUG dbcounter [-] [72090] Writing DB stats nova_cell1:SELECT=6 {{(pid=72090) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:35:34 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [None req-3323a5ab-1b42-4f9d-b4e1-b4114ac5adc0 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "84"}} {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:35:34 user devstack@n-api.service[72090]: DEBUG nova.compute.api [None req-3323a5ab-1b42-4f9d-b4e1-b4114ac5adc0 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] [instance: 647674d8-af53-405a-8116-4b7a01549bdf] Fetching instance by UUID {{(pid=72090) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:35:34 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-3323a5ab-1b42-4f9d-b4e1-b4114ac5adc0 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:35:34 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-3323a5ab-1b42-4f9d-b4e1-b4114ac5adc0 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:35:34 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-3323a5ab-1b42-4f9d-b4e1-b4114ac5adc0 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:35:34 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-3323a5ab-1b42-4f9d-b4e1-b4114ac5adc0 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:35:34 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-3323a5ab-1b42-4f9d-b4e1-b4114ac5adc0 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:35:34 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-3323a5ab-1b42-4f9d-b4e1-b4114ac5adc0 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:35:34 user devstack@n-api.service[72090]: DEBUG nova.policy [None req-3323a5ab-1b42-4f9d-b4e1-b4114ac5adc0 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '05fb551c320a48f98a4ec00a7f7492d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60a7381a31b84e97a068528f90813773', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72090) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:35:34 user devstack@n-api.service[72090]: DEBUG nova.compute.api [None req-3323a5ab-1b42-4f9d-b4e1-b4114ac5adc0 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] [instance: 647674d8-af53-405a-8116-4b7a01549bdf] Old instance type m1.nano, new instance type m1.micro {{(pid=72090) resize /opt/stack/nova/nova/compute/api.py:4223}} Apr 11 19:35:34 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-3323a5ab-1b42-4f9d-b4e1-b4114ac5adc0 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:35:34 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-3323a5ab-1b42-4f9d-b4e1-b4114ac5adc0 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:35:34 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-3323a5ab-1b42-4f9d-b4e1-b4114ac5adc0 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:35:34 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-3323a5ab-1b42-4f9d-b4e1-b4114ac5adc0 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:35:34 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-3323a5ab-1b42-4f9d-b4e1-b4114ac5adc0 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:35:34 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-3323a5ab-1b42-4f9d-b4e1-b4114ac5adc0 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:35:34 user devstack@n-api.service[72090]: DEBUG nova.quota [None req-3323a5ab-1b42-4f9d-b4e1-b4114ac5adc0 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Getting quotas for project 60a7381a31b84e97a068528f90813773. Resources: {'ram', 'cores'} {{(pid=72090) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 19:35:34 user devstack@n-api.service[72090]: DEBUG nova.quota [None req-3323a5ab-1b42-4f9d-b4e1-b4114ac5adc0 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Getting quotas for user 05fb551c320a48f98a4ec00a7f7492d7 and project 60a7381a31b84e97a068528f90813773. Resources: {'ram', 'cores'} {{(pid=72090) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 19:35:34 user devstack@n-api.service[72090]: DEBUG nova.virt.hardware [None req-3323a5ab-1b42-4f9d-b4e1-b4114ac5adc0 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Flavor limits 0:0:0 {{(pid=72090) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 19:35:34 user devstack@n-api.service[72090]: DEBUG nova.virt.hardware [None req-3323a5ab-1b42-4f9d-b4e1-b4114ac5adc0 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Image limits 0:0:0 {{(pid=72090) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 19:35:34 user devstack@n-api.service[72090]: DEBUG nova.virt.hardware [None req-3323a5ab-1b42-4f9d-b4e1-b4114ac5adc0 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Flavor pref 0:0:0 {{(pid=72090) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 19:35:34 user devstack@n-api.service[72090]: DEBUG nova.virt.hardware [None req-3323a5ab-1b42-4f9d-b4e1-b4114ac5adc0 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Image pref 0:0:0 {{(pid=72090) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 19:35:34 user devstack@n-api.service[72090]: DEBUG nova.virt.hardware [None req-3323a5ab-1b42-4f9d-b4e1-b4114ac5adc0 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72090) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 19:35:34 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [None req-3323a5ab-1b42-4f9d-b4e1-b4114ac5adc0 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] 10.0.0.210 "POST /compute/v2.1/servers/647674d8-af53-405a-8116-4b7a01549bdf/action" status: 202 len: 0 microversion: 2.1 time: 0.384844 Apr 11 19:35:34 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 222/669] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Apr 11 19:35:34 2023] POST /compute/v2.1/servers/647674d8-af53-405a-8116-4b7a01549bdf/action => generated 0 bytes in 387 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 19:35:34 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [None req-adbe1f26-b7b8-4531-8500-dc71a319c637 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Calling method '>' {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:35:34 user devstack@n-api.service[72089]: DEBUG nova.compute.api [None req-adbe1f26-b7b8-4531-8500-dc71a319c637 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] [instance: 647674d8-af53-405a-8116-4b7a01549bdf] Fetching instance by UUID {{(pid=72089) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:35:34 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-adbe1f26-b7b8-4531-8500-dc71a319c637 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:35:34 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-adbe1f26-b7b8-4531-8500-dc71a319c637 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:35:34 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-adbe1f26-b7b8-4531-8500-dc71a319c637 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:35:34 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-adbe1f26-b7b8-4531-8500-dc71a319c637 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:35:34 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-adbe1f26-b7b8-4531-8500-dc71a319c637 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:35:34 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-adbe1f26-b7b8-4531-8500-dc71a319c637 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:35:34 user devstack@n-api.service[72089]: DEBUG nova.policy [None req-adbe1f26-b7b8-4531-8500-dc71a319c637 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05fb551c320a48f98a4ec00a7f7492d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60a7381a31b84e97a068528f90813773', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72089) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:35:34 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [None req-adbe1f26-b7b8-4531-8500-dc71a319c637 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] 10.0.0.210 "GET /compute/v2.1/servers/647674d8-af53-405a-8116-4b7a01549bdf" status: 200 len: 1732 microversion: 2.1 time: 0.158745 Apr 11 19:35:34 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 230/670] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 19:35:34 2023] GET /compute/v2.1/servers/647674d8-af53-405a-8116-4b7a01549bdf => generated 1732 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:35:37 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [req-40375c82-1cbb-49eb-a44d-b36c19dba8a8 req-5b323136-b6bc-4c89-b58b-657680d63aa2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "647674d8-af53-405a-8116-4b7a01549bdf", "name": "network-vif-unplugged", "status": "completed", "tag": "e4e4888a-168a-4fe8-a43e-ee683b50a39a"}]} {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:35:37 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-40375c82-1cbb-49eb-a44d-b36c19dba8a8 req-5b323136-b6bc-4c89-b58b-657680d63aa2 service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:35:37 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-40375c82-1cbb-49eb-a44d-b36c19dba8a8 req-5b323136-b6bc-4c89-b58b-657680d63aa2 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:35:37 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-40375c82-1cbb-49eb-a44d-b36c19dba8a8 req-5b323136-b6bc-4c89-b58b-657680d63aa2 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:35:37 user devstack@n-api.service[72088]: INFO nova.api.openstack.compute.server_external_events [req-40375c82-1cbb-49eb-a44d-b36c19dba8a8 req-5b323136-b6bc-4c89-b58b-657680d63aa2 service nova] Creating event network-vif-unplugged:e4e4888a-168a-4fe8-a43e-ee683b50a39a for instance 647674d8-af53-405a-8116-4b7a01549bdf on user Apr 11 19:35:37 user devstack@n-api.service[72088]: DEBUG nova.compute.api [req-40375c82-1cbb-49eb-a44d-b36c19dba8a8 req-5b323136-b6bc-4c89-b58b-657680d63aa2 service nova] Instance 647674d8-af53-405a-8116-4b7a01549bdf is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=72088) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 11 19:35:37 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [req-40375c82-1cbb-49eb-a44d-b36c19dba8a8 req-5b323136-b6bc-4c89-b58b-657680d63aa2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.053079 Apr 11 19:35:37 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 219/671] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:35:37 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:35:39 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [req-c14eb386-efc5-4c68-a558-a528dedf9f86 req-b9e6e570-b73d-4091-82a8-58f2f1db4a95 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "647674d8-af53-405a-8116-4b7a01549bdf", "name": "network-vif-plugged", "status": "completed", "tag": "e4e4888a-168a-4fe8-a43e-ee683b50a39a"}]} {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:35:39 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-c14eb386-efc5-4c68-a558-a528dedf9f86 req-b9e6e570-b73d-4091-82a8-58f2f1db4a95 service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:35:39 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-c14eb386-efc5-4c68-a558-a528dedf9f86 req-b9e6e570-b73d-4091-82a8-58f2f1db4a95 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:35:39 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-c14eb386-efc5-4c68-a558-a528dedf9f86 req-b9e6e570-b73d-4091-82a8-58f2f1db4a95 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:35:39 user devstack@n-api.service[72090]: INFO nova.api.openstack.compute.server_external_events [req-c14eb386-efc5-4c68-a558-a528dedf9f86 req-b9e6e570-b73d-4091-82a8-58f2f1db4a95 service nova] Creating event network-vif-plugged:e4e4888a-168a-4fe8-a43e-ee683b50a39a for instance 647674d8-af53-405a-8116-4b7a01549bdf on user Apr 11 19:35:39 user devstack@n-api.service[72090]: DEBUG nova.compute.api [req-c14eb386-efc5-4c68-a558-a528dedf9f86 req-b9e6e570-b73d-4091-82a8-58f2f1db4a95 service nova] Instance 647674d8-af53-405a-8116-4b7a01549bdf is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=72090) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 11 19:35:39 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [req-c14eb386-efc5-4c68-a558-a528dedf9f86 req-b9e6e570-b73d-4091-82a8-58f2f1db4a95 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047781 Apr 11 19:35:39 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 223/672] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:35:39 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 11 19:35:42 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [None req-a1062a06-271e-466f-bc56-585e7dde8e8b tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Calling method '>' {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:35:42 user devstack@n-api.service[72089]: DEBUG nova.compute.api [None req-a1062a06-271e-466f-bc56-585e7dde8e8b tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] [instance: e6e3640a-c262-4e2d-a994-2e4312f22871] Fetching instance by UUID {{(pid=72089) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:35:42 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-a1062a06-271e-466f-bc56-585e7dde8e8b tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:35:42 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-a1062a06-271e-466f-bc56-585e7dde8e8b tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:35:42 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-a1062a06-271e-466f-bc56-585e7dde8e8b tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:35:42 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-a1062a06-271e-466f-bc56-585e7dde8e8b tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:35:42 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-a1062a06-271e-466f-bc56-585e7dde8e8b tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:35:42 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-a1062a06-271e-466f-bc56-585e7dde8e8b tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:35:42 user devstack@n-api.service[72089]: INFO nova.api.openstack.wsgi [None req-a1062a06-271e-466f-bc56-585e7dde8e8b tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] HTTP exception thrown: Instance e6e3640a-c262-4e2d-a994-2e4312f22871 could not be found. Apr 11 19:35:42 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [None req-a1062a06-271e-466f-bc56-585e7dde8e8b tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Request method failure captured: Apr 11 19:35:42 user devstack@n-api.service[72089]: request: GET /compute/v2.1/servers/e6e3640a-c262-4e2d-a994-2e4312f22871 HTTP/1.1 Apr 11 19:35:42 user devstack@n-api.service[72089]: Accept: application/json Apr 11 19:35:42 user devstack@n-api.service[72089]: Accept-Encoding: identity Apr 11 19:35:42 user devstack@n-api.service[72089]: Connection: close Apr 11 19:35:42 user devstack@n-api.service[72089]: Content-Length: 0 Apr 11 19:35:42 user devstack@n-api.service[72089]: Content-Type: application/json Apr 11 19:35:42 user devstack@n-api.service[72089]: Host: 10.0.0.210 Apr 11 19:35:42 user devstack@n-api.service[72089]: Openstack-System-Scope: None Apr 11 19:35:42 user devstack@n-api.service[72089]: User-Agent: python-urllib3/1.26.15 Apr 11 19:35:42 user devstack@n-api.service[72089]: X-Auth-Token: gAAAAABkNbM9PPhjuxFro365bgGlzXmEeNXBFjH7B9DXRG846ZOMZNO8rjcHBUXZkmUpO9G06QygHvaEJVpRlrFcJIyDYtH16p4qIRFo8lVfjRkqkJh8soUAdF5jsPsH_hjCF2czbYEFIUpkQBo9PM7kG8byL_cnEa6VpD9RmxIaxcGcdobg_-U Apr 11 19:35:42 user devstack@n-api.service[72089]: X-Domain-Id: None Apr 11 19:35:42 user devstack@n-api.service[72089]: X-Domain-Name: None Apr 11 19:35:42 user devstack@n-api.service[72089]: X-Identity-Status: Confirmed Apr 11 19:35:42 user devstack@n-api.service[72089]: X-Is-Admin-Project: True Apr 11 19:35:42 user devstack@n-api.service[72089]: X-Project-Domain-Id: default Apr 11 19:35:42 user devstack@n-api.service[72089]: X-Project-Domain-Name: Default Apr 11 19:35:42 user devstack@n-api.service[72089]: X-Project-Id: 06966e2f4d3a4dec92282c7ad348635d Apr 11 19:35:42 user devstack@n-api.service[72089]: X-Project-Name: tempest-AttachVolumeNegativeTest-303418642 Apr 11 19:35:42 user devstack@n-api.service[72089]: X-Role: reader,member Apr 11 19:35:42 user devstack@n-api.service[72089]: X-Roles: reader,member Apr 11 19:35:42 user devstack@n-api.service[72089]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/06966e2f4d3a4dec92282c7ad348635d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/06966e2f4d3a4dec92282c7ad348635d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/06966e2f4d3a4dec92282c7ad348635d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 11 19:35:42 user devstack@n-api.service[72089]: X-Tenant: tempest-AttachVolumeNegativeTest-303418642 Apr 11 19:35:42 user devstack@n-api.service[72089]: X-Tenant-Id: 06966e2f4d3a4dec92282c7ad348635d Apr 11 19:35:42 user devstack@n-api.service[72089]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-303418642 Apr 11 19:35:42 user devstack@n-api.service[72089]: X-User: tempest-AttachVolumeNegativeTest-303418642-project-member Apr 11 19:35:42 user devstack@n-api.service[72089]: X-User-Domain-Id: default Apr 11 19:35:42 user devstack@n-api.service[72089]: X-User-Domain-Name: Default Apr 11 19:35:42 user devstack@n-api.service[72089]: X-User-Id: d5d405421ceb4d99967ef2e7f55e7809 Apr 11 19:35:42 user devstack@n-api.service[72089]: X-User-Name: tempest-AttachVolumeNegativeTest-303418642-project-member Apr 11 19:35:42 user devstack@n-api.service[72089]: method: > Apr 11 19:35:42 user devstack@n-api.service[72089]: exception: Instance e6e3640a-c262-4e2d-a994-2e4312f22871 could not be found. Apr 11 19:35:42 user devstack@n-api.service[72089]: action_args: {'id': 'e6e3640a-c262-4e2d-a994-2e4312f22871'} Apr 11 19:35:42 user devstack@n-api.service[72089]: {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 19:35:42 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:35:42 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 19:35:42 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 19:35:42 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 19:35:42 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 19:35:42 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 19:35:42 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 19:35:42 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 19:35:42 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 19:35:42 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e6e3640a-c262-4e2d-a994-2e4312f22871 could not be found. Apr 11 19:35:42 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi Apr 11 19:35:42 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 19:35:42 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi Apr 11 19:35:42 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:35:42 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 19:35:42 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 19:35:42 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 19:35:42 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 19:35:42 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 19:35:42 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 19:35:42 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 19:35:42 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 19:35:42 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 19:35:42 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 19:35:42 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 19:35:42 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 19:35:42 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e6e3640a-c262-4e2d-a994-2e4312f22871 could not be found. Apr 11 19:35:42 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi Apr 11 19:35:42 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 19:35:42 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi Apr 11 19:35:42 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:35:42 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 19:35:42 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 19:35:42 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 19:35:42 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 19:35:42 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e6e3640a-c262-4e2d-a994-2e4312f22871 could not be found. Apr 11 19:35:42 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi Apr 11 19:35:42 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [None req-a1062a06-271e-466f-bc56-585e7dde8e8b tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Returning 404 to user: Instance e6e3640a-c262-4e2d-a994-2e4312f22871 could not be found. {{(pid=72089) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 19:35:42 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [None req-a1062a06-271e-466f-bc56-585e7dde8e8b tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e6e3640a-c262-4e2d-a994-2e4312f22871" status: 404 len: 111 microversion: 2.1 time: 0.035768 Apr 11 19:35:42 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 231/673] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 19:35:42 2023] GET /compute/v2.1/servers/e6e3640a-c262-4e2d-a994-2e4312f22871 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 19:35:42 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [None req-09655dcb-a93d-4cff-8331-0983f2ff60b0 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Calling method '.version_select at 0x7f119d98d6c0>' {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:35:42 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [None req-09655dcb-a93d-4cff-8331-0983f2ff60b0 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2085079067" status: 202 len: 0 microversion: 2.1 time: 0.031357 Apr 11 19:35:42 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 220/674] 10.0.0.210 () {62 vars in 1298 bytes} [Tue Apr 11 19:35:42 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2085079067 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 19:35:44 user devstack@n-api.service[72090]: DEBUG dbcounter [-] [72090] Writing DB stats nova_cell0:SELECT=3 {{(pid=72090) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:35:44 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [None req-1fbf3497-8e1c-41b5-a933-6fcd7bae81a1 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Calling method '>' {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:35:44 user devstack@n-api.service[72090]: DEBUG nova.compute.api [None req-1fbf3497-8e1c-41b5-a933-6fcd7bae81a1 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] [instance: e6e3640a-c262-4e2d-a994-2e4312f22871] Fetching instance by UUID {{(pid=72090) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:35:44 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-1fbf3497-8e1c-41b5-a933-6fcd7bae81a1 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:35:44 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-1fbf3497-8e1c-41b5-a933-6fcd7bae81a1 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:35:44 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-1fbf3497-8e1c-41b5-a933-6fcd7bae81a1 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:35:44 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-1fbf3497-8e1c-41b5-a933-6fcd7bae81a1 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:35:44 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-1fbf3497-8e1c-41b5-a933-6fcd7bae81a1 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:35:44 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-1fbf3497-8e1c-41b5-a933-6fcd7bae81a1 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:35:45 user devstack@n-api.service[72090]: INFO nova.api.openstack.wsgi [None req-1fbf3497-8e1c-41b5-a933-6fcd7bae81a1 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] HTTP exception thrown: Instance e6e3640a-c262-4e2d-a994-2e4312f22871 could not be found. Apr 11 19:35:45 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [None req-1fbf3497-8e1c-41b5-a933-6fcd7bae81a1 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Request method failure captured: Apr 11 19:35:45 user devstack@n-api.service[72090]: request: DELETE /compute/v2.1/servers/e6e3640a-c262-4e2d-a994-2e4312f22871 HTTP/1.1 Apr 11 19:35:45 user devstack@n-api.service[72090]: Accept: application/json Apr 11 19:35:45 user devstack@n-api.service[72090]: Accept-Encoding: identity Apr 11 19:35:45 user devstack@n-api.service[72090]: Connection: close Apr 11 19:35:45 user devstack@n-api.service[72090]: Content-Length: 0 Apr 11 19:35:45 user devstack@n-api.service[72090]: Content-Type: application/json Apr 11 19:35:45 user devstack@n-api.service[72090]: Host: 10.0.0.210 Apr 11 19:35:45 user devstack@n-api.service[72090]: Openstack-System-Scope: None Apr 11 19:35:45 user devstack@n-api.service[72090]: User-Agent: python-urllib3/1.26.15 Apr 11 19:35:45 user devstack@n-api.service[72090]: X-Auth-Token: gAAAAABkNbM9PPhjuxFro365bgGlzXmEeNXBFjH7B9DXRG846ZOMZNO8rjcHBUXZkmUpO9G06QygHvaEJVpRlrFcJIyDYtH16p4qIRFo8lVfjRkqkJh8soUAdF5jsPsH_hjCF2czbYEFIUpkQBo9PM7kG8byL_cnEa6VpD9RmxIaxcGcdobg_-U Apr 11 19:35:45 user devstack@n-api.service[72090]: X-Domain-Id: None Apr 11 19:35:45 user devstack@n-api.service[72090]: X-Domain-Name: None Apr 11 19:35:45 user devstack@n-api.service[72090]: X-Identity-Status: Confirmed Apr 11 19:35:45 user devstack@n-api.service[72090]: X-Is-Admin-Project: True Apr 11 19:35:45 user devstack@n-api.service[72090]: X-Project-Domain-Id: default Apr 11 19:35:45 user devstack@n-api.service[72090]: X-Project-Domain-Name: Default Apr 11 19:35:45 user devstack@n-api.service[72090]: X-Project-Id: 06966e2f4d3a4dec92282c7ad348635d Apr 11 19:35:45 user devstack@n-api.service[72090]: X-Project-Name: tempest-AttachVolumeNegativeTest-303418642 Apr 11 19:35:45 user devstack@n-api.service[72090]: X-Role: reader,member Apr 11 19:35:45 user devstack@n-api.service[72090]: X-Roles: reader,member Apr 11 19:35:45 user devstack@n-api.service[72090]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/06966e2f4d3a4dec92282c7ad348635d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/06966e2f4d3a4dec92282c7ad348635d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/06966e2f4d3a4dec92282c7ad348635d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 11 19:35:45 user devstack@n-api.service[72090]: X-Tenant: tempest-AttachVolumeNegativeTest-303418642 Apr 11 19:35:45 user devstack@n-api.service[72090]: X-Tenant-Id: 06966e2f4d3a4dec92282c7ad348635d Apr 11 19:35:45 user devstack@n-api.service[72090]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-303418642 Apr 11 19:35:45 user devstack@n-api.service[72090]: X-User: tempest-AttachVolumeNegativeTest-303418642-project-member Apr 11 19:35:45 user devstack@n-api.service[72090]: X-User-Domain-Id: default Apr 11 19:35:45 user devstack@n-api.service[72090]: X-User-Domain-Name: Default Apr 11 19:35:45 user devstack@n-api.service[72090]: X-User-Id: d5d405421ceb4d99967ef2e7f55e7809 Apr 11 19:35:45 user devstack@n-api.service[72090]: X-User-Name: tempest-AttachVolumeNegativeTest-303418642-project-member Apr 11 19:35:45 user devstack@n-api.service[72090]: method: > Apr 11 19:35:45 user devstack@n-api.service[72090]: exception: Instance e6e3640a-c262-4e2d-a994-2e4312f22871 could not be found. Apr 11 19:35:45 user devstack@n-api.service[72090]: action_args: {'id': 'e6e3640a-c262-4e2d-a994-2e4312f22871'} Apr 11 19:35:45 user devstack@n-api.service[72090]: {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 19:35:45 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:35:45 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 19:35:45 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 19:35:45 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 19:35:45 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 19:35:45 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 19:35:45 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 19:35:45 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 19:35:45 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 19:35:45 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e6e3640a-c262-4e2d-a994-2e4312f22871 could not be found. Apr 11 19:35:45 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi Apr 11 19:35:45 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 19:35:45 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi Apr 11 19:35:45 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:35:45 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 19:35:45 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 19:35:45 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 19:35:45 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 19:35:45 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 19:35:45 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 19:35:45 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 11 19:35:45 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 11 19:35:45 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 11 19:35:45 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 11 19:35:45 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 19:35:45 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 19:35:45 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 19:35:45 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 19:35:45 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e6e3640a-c262-4e2d-a994-2e4312f22871 could not be found. Apr 11 19:35:45 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi Apr 11 19:35:45 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 19:35:45 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi Apr 11 19:35:45 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:35:45 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 19:35:45 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 19:35:45 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 19:35:45 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 19:35:45 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e6e3640a-c262-4e2d-a994-2e4312f22871 could not be found. Apr 11 19:35:45 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi Apr 11 19:35:45 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [None req-1fbf3497-8e1c-41b5-a933-6fcd7bae81a1 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Returning 404 to user: Instance e6e3640a-c262-4e2d-a994-2e4312f22871 could not be found. {{(pid=72090) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 19:35:45 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [None req-1fbf3497-8e1c-41b5-a933-6fcd7bae81a1 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/e6e3640a-c262-4e2d-a994-2e4312f22871" status: 404 len: 111 microversion: 2.1 time: 0.043766 Apr 11 19:35:45 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 224/675] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 19:35:44 2023] DELETE /compute/v2.1/servers/e6e3640a-c262-4e2d-a994-2e4312f22871 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 19:35:45 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [None req-f35f4558-335a-4297-9bb2-5153d6cff08c tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Calling method '>' {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:35:45 user devstack@n-api.service[72089]: DEBUG nova.compute.api [None req-f35f4558-335a-4297-9bb2-5153d6cff08c tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] [instance: e6e3640a-c262-4e2d-a994-2e4312f22871] Fetching instance by UUID {{(pid=72089) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:35:45 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-f35f4558-335a-4297-9bb2-5153d6cff08c tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:35:45 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-f35f4558-335a-4297-9bb2-5153d6cff08c tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:35:45 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-f35f4558-335a-4297-9bb2-5153d6cff08c tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:35:45 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-f35f4558-335a-4297-9bb2-5153d6cff08c tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:35:45 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-f35f4558-335a-4297-9bb2-5153d6cff08c tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:35:45 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-f35f4558-335a-4297-9bb2-5153d6cff08c tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:35:45 user devstack@n-api.service[72089]: INFO nova.api.openstack.wsgi [None req-f35f4558-335a-4297-9bb2-5153d6cff08c tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] HTTP exception thrown: Instance e6e3640a-c262-4e2d-a994-2e4312f22871 could not be found. Apr 11 19:35:45 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [None req-f35f4558-335a-4297-9bb2-5153d6cff08c tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Request method failure captured: Apr 11 19:35:45 user devstack@n-api.service[72089]: request: GET /compute/v2.1/servers/e6e3640a-c262-4e2d-a994-2e4312f22871 HTTP/1.1 Apr 11 19:35:45 user devstack@n-api.service[72089]: Accept: application/json Apr 11 19:35:45 user devstack@n-api.service[72089]: Accept-Encoding: identity Apr 11 19:35:45 user devstack@n-api.service[72089]: Connection: close Apr 11 19:35:45 user devstack@n-api.service[72089]: Content-Length: 0 Apr 11 19:35:45 user devstack@n-api.service[72089]: Content-Type: application/json Apr 11 19:35:45 user devstack@n-api.service[72089]: Host: 10.0.0.210 Apr 11 19:35:45 user devstack@n-api.service[72089]: Openstack-System-Scope: None Apr 11 19:35:45 user devstack@n-api.service[72089]: User-Agent: python-urllib3/1.26.15 Apr 11 19:35:45 user devstack@n-api.service[72089]: X-Auth-Token: gAAAAABkNbM9PPhjuxFro365bgGlzXmEeNXBFjH7B9DXRG846ZOMZNO8rjcHBUXZkmUpO9G06QygHvaEJVpRlrFcJIyDYtH16p4qIRFo8lVfjRkqkJh8soUAdF5jsPsH_hjCF2czbYEFIUpkQBo9PM7kG8byL_cnEa6VpD9RmxIaxcGcdobg_-U Apr 11 19:35:45 user devstack@n-api.service[72089]: X-Domain-Id: None Apr 11 19:35:45 user devstack@n-api.service[72089]: X-Domain-Name: None Apr 11 19:35:45 user devstack@n-api.service[72089]: X-Identity-Status: Confirmed Apr 11 19:35:45 user devstack@n-api.service[72089]: X-Is-Admin-Project: True Apr 11 19:35:45 user devstack@n-api.service[72089]: X-Project-Domain-Id: default Apr 11 19:35:45 user devstack@n-api.service[72089]: X-Project-Domain-Name: Default Apr 11 19:35:45 user devstack@n-api.service[72089]: X-Project-Id: 06966e2f4d3a4dec92282c7ad348635d Apr 11 19:35:45 user devstack@n-api.service[72089]: X-Project-Name: tempest-AttachVolumeNegativeTest-303418642 Apr 11 19:35:45 user devstack@n-api.service[72089]: X-Role: reader,member Apr 11 19:35:45 user devstack@n-api.service[72089]: X-Roles: reader,member Apr 11 19:35:45 user devstack@n-api.service[72089]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/06966e2f4d3a4dec92282c7ad348635d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/06966e2f4d3a4dec92282c7ad348635d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/06966e2f4d3a4dec92282c7ad348635d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 11 19:35:45 user devstack@n-api.service[72089]: X-Tenant: tempest-AttachVolumeNegativeTest-303418642 Apr 11 19:35:45 user devstack@n-api.service[72089]: X-Tenant-Id: 06966e2f4d3a4dec92282c7ad348635d Apr 11 19:35:45 user devstack@n-api.service[72089]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-303418642 Apr 11 19:35:45 user devstack@n-api.service[72089]: X-User: tempest-AttachVolumeNegativeTest-303418642-project-member Apr 11 19:35:45 user devstack@n-api.service[72089]: X-User-Domain-Id: default Apr 11 19:35:45 user devstack@n-api.service[72089]: X-User-Domain-Name: Default Apr 11 19:35:45 user devstack@n-api.service[72089]: X-User-Id: d5d405421ceb4d99967ef2e7f55e7809 Apr 11 19:35:45 user devstack@n-api.service[72089]: X-User-Name: tempest-AttachVolumeNegativeTest-303418642-project-member Apr 11 19:35:45 user devstack@n-api.service[72089]: method: > Apr 11 19:35:45 user devstack@n-api.service[72089]: exception: Instance e6e3640a-c262-4e2d-a994-2e4312f22871 could not be found. Apr 11 19:35:45 user devstack@n-api.service[72089]: action_args: {'id': 'e6e3640a-c262-4e2d-a994-2e4312f22871'} Apr 11 19:35:45 user devstack@n-api.service[72089]: {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 19:35:45 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:35:45 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 19:35:45 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 19:35:45 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 19:35:45 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 19:35:45 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 19:35:45 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 19:35:45 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 19:35:45 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 19:35:45 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e6e3640a-c262-4e2d-a994-2e4312f22871 could not be found. Apr 11 19:35:45 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi Apr 11 19:35:45 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 19:35:45 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi Apr 11 19:35:45 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:35:45 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 19:35:45 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 19:35:45 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 19:35:45 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 19:35:45 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 19:35:45 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 19:35:45 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 19:35:45 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 19:35:45 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 19:35:45 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 19:35:45 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 19:35:45 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 19:35:45 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e6e3640a-c262-4e2d-a994-2e4312f22871 could not be found. Apr 11 19:35:45 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi Apr 11 19:35:45 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 19:35:45 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi Apr 11 19:35:45 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:35:45 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 19:35:45 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 19:35:45 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 19:35:45 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 19:35:45 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e6e3640a-c262-4e2d-a994-2e4312f22871 could not be found. Apr 11 19:35:45 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi Apr 11 19:35:45 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [None req-f35f4558-335a-4297-9bb2-5153d6cff08c tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Returning 404 to user: Instance e6e3640a-c262-4e2d-a994-2e4312f22871 could not be found. {{(pid=72089) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 19:35:45 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [None req-f35f4558-335a-4297-9bb2-5153d6cff08c tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e6e3640a-c262-4e2d-a994-2e4312f22871" status: 404 len: 111 microversion: 2.1 time: 0.046582 Apr 11 19:35:45 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 232/676] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 19:35:45 2023] GET /compute/v2.1/servers/e6e3640a-c262-4e2d-a994-2e4312f22871 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 19:35:45 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [None req-cc250d74-3250-492b-b779-09d7f532a183 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Calling method '>' {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:35:45 user devstack@n-api.service[72088]: DEBUG nova.compute.api [None req-cc250d74-3250-492b-b779-09d7f532a183 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] [instance: afc22926-012a-43fe-99e6-063294c593a6] Fetching instance by UUID {{(pid=72088) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:35:45 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-cc250d74-3250-492b-b779-09d7f532a183 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:35:45 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-cc250d74-3250-492b-b779-09d7f532a183 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:35:45 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-cc250d74-3250-492b-b779-09d7f532a183 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:35:45 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-cc250d74-3250-492b-b779-09d7f532a183 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:35:45 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-cc250d74-3250-492b-b779-09d7f532a183 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:35:45 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-cc250d74-3250-492b-b779-09d7f532a183 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:35:45 user devstack@n-api.service[72088]: DEBUG nova.policy [None req-cc250d74-3250-492b-b779-09d7f532a183 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf262cd03f4a41c4956d8784cf37d86d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caba0618fc743e7bfb2dd866a511df9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72088) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:35:45 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [None req-cc250d74-3250-492b-b779-09d7f532a183 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] 10.0.0.210 "GET /compute/v2.1/servers/afc22926-012a-43fe-99e6-063294c593a6" status: 200 len: 1391 microversion: 2.1 time: 0.186053 Apr 11 19:35:45 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 221/677] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 19:35:45 2023] GET /compute/v2.1/servers/afc22926-012a-43fe-99e6-063294c593a6 => generated 1391 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 19:35:46 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [None req-588c849c-c7c8-4835-ba9b-9249a4d71e1e tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Calling method '>' {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:35:46 user devstack@n-api.service[72090]: DEBUG nova.compute.api [None req-588c849c-c7c8-4835-ba9b-9249a4d71e1e tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] [instance: fbfa0825-c7c2-4f04-8c9a-102e238c3816] Fetching instance by UUID {{(pid=72090) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:35:46 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-588c849c-c7c8-4835-ba9b-9249a4d71e1e tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:35:46 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-588c849c-c7c8-4835-ba9b-9249a4d71e1e tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:35:46 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-588c849c-c7c8-4835-ba9b-9249a4d71e1e tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:35:46 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-588c849c-c7c8-4835-ba9b-9249a4d71e1e tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:35:46 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-588c849c-c7c8-4835-ba9b-9249a4d71e1e tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:35:46 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-588c849c-c7c8-4835-ba9b-9249a4d71e1e tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:35:46 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [None req-588c849c-c7c8-4835-ba9b-9249a4d71e1e tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fbfa0825-c7c2-4f04-8c9a-102e238c3816/os-interface" status: 200 len: 283 microversion: 2.20 time: 0.091400 Apr 11 19:35:46 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 225/678] 10.0.0.210 () {64 vars in 1393 bytes} [Tue Apr 11 19:35:46 2023] GET /compute/v2.1/servers/fbfa0825-c7c2-4f04-8c9a-102e238c3816/os-interface => generated 283 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:35:46 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [req-63d1970e-c327-43d1-945f-8364967a2300 req-77d86d4c-0c20-4146-9779-9ee925a7258a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fbfa0825-c7c2-4f04-8c9a-102e238c3816", "tag": "0be0dfa4-d8ad-4d32-83ab-a090c0f77f34"}]} {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:35:46 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-63d1970e-c327-43d1-945f-8364967a2300 req-77d86d4c-0c20-4146-9779-9ee925a7258a service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:35:46 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-63d1970e-c327-43d1-945f-8364967a2300 req-77d86d4c-0c20-4146-9779-9ee925a7258a service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:35:46 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-63d1970e-c327-43d1-945f-8364967a2300 req-77d86d4c-0c20-4146-9779-9ee925a7258a service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:35:46 user devstack@n-api.service[72089]: INFO nova.api.openstack.compute.server_external_events [req-63d1970e-c327-43d1-945f-8364967a2300 req-77d86d4c-0c20-4146-9779-9ee925a7258a service nova] Creating event network-changed:0be0dfa4-d8ad-4d32-83ab-a090c0f77f34 for instance fbfa0825-c7c2-4f04-8c9a-102e238c3816 on user Apr 11 19:35:46 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [req-63d1970e-c327-43d1-945f-8364967a2300 req-77d86d4c-0c20-4146-9779-9ee925a7258a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032995 Apr 11 19:35:46 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 233/679] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:35:46 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:35:47 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [None req-ab71fa18-239c-4877-ae7b-15bd22b61d96 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Calling method '>' {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:35:47 user devstack@n-api.service[72088]: DEBUG nova.compute.api [None req-ab71fa18-239c-4877-ae7b-15bd22b61d96 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] [instance: fbfa0825-c7c2-4f04-8c9a-102e238c3816] Fetching instance by UUID {{(pid=72088) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:35:47 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-ab71fa18-239c-4877-ae7b-15bd22b61d96 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:35:47 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-ab71fa18-239c-4877-ae7b-15bd22b61d96 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:35:47 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-ab71fa18-239c-4877-ae7b-15bd22b61d96 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:35:47 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-ab71fa18-239c-4877-ae7b-15bd22b61d96 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:35:47 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-ab71fa18-239c-4877-ae7b-15bd22b61d96 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:35:47 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-ab71fa18-239c-4877-ae7b-15bd22b61d96 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:35:47 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [None req-ab71fa18-239c-4877-ae7b-15bd22b61d96 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fbfa0825-c7c2-4f04-8c9a-102e238c3816/ips" status: 200 len: 110 microversion: 2.20 time: 0.035867 Apr 11 19:35:47 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 222/680] 10.0.0.210 () {64 vars in 1366 bytes} [Tue Apr 11 19:35:47 2023] GET /compute/v2.1/servers/fbfa0825-c7c2-4f04-8c9a-102e238c3816/ips => generated 110 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:35:47 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [None req-69cbd806-aa54-416a-ba54-345d54273245 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Calling method '>' {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:35:47 user devstack@n-api.service[72090]: DEBUG nova.compute.api [None req-69cbd806-aa54-416a-ba54-345d54273245 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] [instance: 558100b9-f3ac-47c7-9260-b897b0cae55f] Fetching instance by UUID {{(pid=72090) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:35:47 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-69cbd806-aa54-416a-ba54-345d54273245 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:35:47 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-69cbd806-aa54-416a-ba54-345d54273245 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:35:47 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-69cbd806-aa54-416a-ba54-345d54273245 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:35:47 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-69cbd806-aa54-416a-ba54-345d54273245 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:35:47 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-69cbd806-aa54-416a-ba54-345d54273245 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:35:47 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-69cbd806-aa54-416a-ba54-345d54273245 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:35:47 user devstack@n-api.service[72090]: INFO nova.api.openstack.wsgi [None req-69cbd806-aa54-416a-ba54-345d54273245 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] HTTP exception thrown: Instance 558100b9-f3ac-47c7-9260-b897b0cae55f could not be found. Apr 11 19:35:47 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [None req-69cbd806-aa54-416a-ba54-345d54273245 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Request method failure captured: Apr 11 19:35:47 user devstack@n-api.service[72090]: request: DELETE /compute/v2.1/servers/558100b9-f3ac-47c7-9260-b897b0cae55f HTTP/1.1 Apr 11 19:35:47 user devstack@n-api.service[72090]: Accept: application/json Apr 11 19:35:47 user devstack@n-api.service[72090]: Accept-Encoding: identity Apr 11 19:35:47 user devstack@n-api.service[72090]: Connection: close Apr 11 19:35:47 user devstack@n-api.service[72090]: Content-Length: 0 Apr 11 19:35:47 user devstack@n-api.service[72090]: Content-Type: application/json Apr 11 19:35:47 user devstack@n-api.service[72090]: Host: 10.0.0.210 Apr 11 19:35:47 user devstack@n-api.service[72090]: Openstack-System-Scope: None Apr 11 19:35:47 user devstack@n-api.service[72090]: User-Agent: python-urllib3/1.26.15 Apr 11 19:35:47 user devstack@n-api.service[72090]: X-Auth-Token: gAAAAABkNbM9PPhjuxFro365bgGlzXmEeNXBFjH7B9DXRG846ZOMZNO8rjcHBUXZkmUpO9G06QygHvaEJVpRlrFcJIyDYtH16p4qIRFo8lVfjRkqkJh8soUAdF5jsPsH_hjCF2czbYEFIUpkQBo9PM7kG8byL_cnEa6VpD9RmxIaxcGcdobg_-U Apr 11 19:35:47 user devstack@n-api.service[72090]: X-Domain-Id: None Apr 11 19:35:47 user devstack@n-api.service[72090]: X-Domain-Name: None Apr 11 19:35:47 user devstack@n-api.service[72090]: X-Identity-Status: Confirmed Apr 11 19:35:47 user devstack@n-api.service[72090]: X-Is-Admin-Project: True Apr 11 19:35:47 user devstack@n-api.service[72090]: X-Project-Domain-Id: default Apr 11 19:35:47 user devstack@n-api.service[72090]: X-Project-Domain-Name: Default Apr 11 19:35:47 user devstack@n-api.service[72090]: X-Project-Id: 06966e2f4d3a4dec92282c7ad348635d Apr 11 19:35:47 user devstack@n-api.service[72090]: X-Project-Name: tempest-AttachVolumeNegativeTest-303418642 Apr 11 19:35:47 user devstack@n-api.service[72090]: X-Role: reader,member Apr 11 19:35:47 user devstack@n-api.service[72090]: X-Roles: reader,member Apr 11 19:35:47 user devstack@n-api.service[72090]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/06966e2f4d3a4dec92282c7ad348635d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/06966e2f4d3a4dec92282c7ad348635d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/06966e2f4d3a4dec92282c7ad348635d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 11 19:35:47 user devstack@n-api.service[72090]: X-Tenant: tempest-AttachVolumeNegativeTest-303418642 Apr 11 19:35:47 user devstack@n-api.service[72090]: X-Tenant-Id: 06966e2f4d3a4dec92282c7ad348635d Apr 11 19:35:47 user devstack@n-api.service[72090]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-303418642 Apr 11 19:35:47 user devstack@n-api.service[72090]: X-User: tempest-AttachVolumeNegativeTest-303418642-project-member Apr 11 19:35:47 user devstack@n-api.service[72090]: X-User-Domain-Id: default Apr 11 19:35:47 user devstack@n-api.service[72090]: X-User-Domain-Name: Default Apr 11 19:35:47 user devstack@n-api.service[72090]: X-User-Id: d5d405421ceb4d99967ef2e7f55e7809 Apr 11 19:35:47 user devstack@n-api.service[72090]: X-User-Name: tempest-AttachVolumeNegativeTest-303418642-project-member Apr 11 19:35:47 user devstack@n-api.service[72090]: method: > Apr 11 19:35:47 user devstack@n-api.service[72090]: exception: Instance 558100b9-f3ac-47c7-9260-b897b0cae55f could not be found. Apr 11 19:35:47 user devstack@n-api.service[72090]: action_args: {'id': '558100b9-f3ac-47c7-9260-b897b0cae55f'} Apr 11 19:35:47 user devstack@n-api.service[72090]: {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 19:35:47 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:35:47 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 19:35:47 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 19:35:47 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 19:35:47 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 19:35:47 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 19:35:47 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 19:35:47 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 19:35:47 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 19:35:47 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 558100b9-f3ac-47c7-9260-b897b0cae55f could not be found. Apr 11 19:35:47 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi Apr 11 19:35:47 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 19:35:47 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi Apr 11 19:35:47 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:35:47 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 19:35:47 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 19:35:47 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 19:35:47 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 19:35:47 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 19:35:47 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 19:35:47 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 11 19:35:47 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 11 19:35:47 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 11 19:35:47 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 11 19:35:47 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 19:35:47 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 19:35:47 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 19:35:47 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 19:35:47 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 558100b9-f3ac-47c7-9260-b897b0cae55f could not be found. Apr 11 19:35:47 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi Apr 11 19:35:47 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 19:35:47 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi Apr 11 19:35:47 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:35:47 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 19:35:47 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 19:35:47 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 19:35:47 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 19:35:47 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 558100b9-f3ac-47c7-9260-b897b0cae55f could not be found. Apr 11 19:35:47 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi Apr 11 19:35:47 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [None req-69cbd806-aa54-416a-ba54-345d54273245 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Returning 404 to user: Instance 558100b9-f3ac-47c7-9260-b897b0cae55f could not be found. {{(pid=72090) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 19:35:47 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [None req-69cbd806-aa54-416a-ba54-345d54273245 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/558100b9-f3ac-47c7-9260-b897b0cae55f" status: 404 len: 111 microversion: 2.1 time: 0.026535 Apr 11 19:35:47 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 226/681] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 19:35:47 2023] DELETE /compute/v2.1/servers/558100b9-f3ac-47c7-9260-b897b0cae55f => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 19:35:47 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [None req-36b9ef1a-5aa1-4504-93e5-e5b8d5ebbd49 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Calling method '>' {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:35:47 user devstack@n-api.service[72089]: DEBUG nova.compute.api [None req-36b9ef1a-5aa1-4504-93e5-e5b8d5ebbd49 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] [instance: 558100b9-f3ac-47c7-9260-b897b0cae55f] Fetching instance by UUID {{(pid=72089) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:35:47 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-36b9ef1a-5aa1-4504-93e5-e5b8d5ebbd49 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:35:47 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-36b9ef1a-5aa1-4504-93e5-e5b8d5ebbd49 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:35:47 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-36b9ef1a-5aa1-4504-93e5-e5b8d5ebbd49 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:35:47 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-36b9ef1a-5aa1-4504-93e5-e5b8d5ebbd49 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:35:47 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-36b9ef1a-5aa1-4504-93e5-e5b8d5ebbd49 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:35:47 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-36b9ef1a-5aa1-4504-93e5-e5b8d5ebbd49 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:35:47 user devstack@n-api.service[72089]: INFO nova.api.openstack.wsgi [None req-36b9ef1a-5aa1-4504-93e5-e5b8d5ebbd49 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] HTTP exception thrown: Instance 558100b9-f3ac-47c7-9260-b897b0cae55f could not be found. Apr 11 19:35:47 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [None req-36b9ef1a-5aa1-4504-93e5-e5b8d5ebbd49 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Request method failure captured: Apr 11 19:35:47 user devstack@n-api.service[72089]: request: GET /compute/v2.1/servers/558100b9-f3ac-47c7-9260-b897b0cae55f HTTP/1.1 Apr 11 19:35:47 user devstack@n-api.service[72089]: Accept: application/json Apr 11 19:35:47 user devstack@n-api.service[72089]: Accept-Encoding: identity Apr 11 19:35:47 user devstack@n-api.service[72089]: Connection: close Apr 11 19:35:47 user devstack@n-api.service[72089]: Content-Length: 0 Apr 11 19:35:47 user devstack@n-api.service[72089]: Content-Type: application/json Apr 11 19:35:47 user devstack@n-api.service[72089]: Host: 10.0.0.210 Apr 11 19:35:47 user devstack@n-api.service[72089]: Openstack-System-Scope: None Apr 11 19:35:47 user devstack@n-api.service[72089]: User-Agent: python-urllib3/1.26.15 Apr 11 19:35:47 user devstack@n-api.service[72089]: X-Auth-Token: gAAAAABkNbM9PPhjuxFro365bgGlzXmEeNXBFjH7B9DXRG846ZOMZNO8rjcHBUXZkmUpO9G06QygHvaEJVpRlrFcJIyDYtH16p4qIRFo8lVfjRkqkJh8soUAdF5jsPsH_hjCF2czbYEFIUpkQBo9PM7kG8byL_cnEa6VpD9RmxIaxcGcdobg_-U Apr 11 19:35:47 user devstack@n-api.service[72089]: X-Domain-Id: None Apr 11 19:35:47 user devstack@n-api.service[72089]: X-Domain-Name: None Apr 11 19:35:47 user devstack@n-api.service[72089]: X-Identity-Status: Confirmed Apr 11 19:35:47 user devstack@n-api.service[72089]: X-Is-Admin-Project: True Apr 11 19:35:47 user devstack@n-api.service[72089]: X-Project-Domain-Id: default Apr 11 19:35:47 user devstack@n-api.service[72089]: X-Project-Domain-Name: Default Apr 11 19:35:47 user devstack@n-api.service[72089]: X-Project-Id: 06966e2f4d3a4dec92282c7ad348635d Apr 11 19:35:47 user devstack@n-api.service[72089]: X-Project-Name: tempest-AttachVolumeNegativeTest-303418642 Apr 11 19:35:47 user devstack@n-api.service[72089]: X-Role: reader,member Apr 11 19:35:47 user devstack@n-api.service[72089]: X-Roles: reader,member Apr 11 19:35:47 user devstack@n-api.service[72089]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/06966e2f4d3a4dec92282c7ad348635d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/06966e2f4d3a4dec92282c7ad348635d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/06966e2f4d3a4dec92282c7ad348635d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 11 19:35:47 user devstack@n-api.service[72089]: X-Tenant: tempest-AttachVolumeNegativeTest-303418642 Apr 11 19:35:47 user devstack@n-api.service[72089]: X-Tenant-Id: 06966e2f4d3a4dec92282c7ad348635d Apr 11 19:35:47 user devstack@n-api.service[72089]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-303418642 Apr 11 19:35:47 user devstack@n-api.service[72089]: X-User: tempest-AttachVolumeNegativeTest-303418642-project-member Apr 11 19:35:47 user devstack@n-api.service[72089]: X-User-Domain-Id: default Apr 11 19:35:47 user devstack@n-api.service[72089]: X-User-Domain-Name: Default Apr 11 19:35:47 user devstack@n-api.service[72089]: X-User-Id: d5d405421ceb4d99967ef2e7f55e7809 Apr 11 19:35:47 user devstack@n-api.service[72089]: X-User-Name: tempest-AttachVolumeNegativeTest-303418642-project-member Apr 11 19:35:47 user devstack@n-api.service[72089]: method: > Apr 11 19:35:47 user devstack@n-api.service[72089]: exception: Instance 558100b9-f3ac-47c7-9260-b897b0cae55f could not be found. Apr 11 19:35:47 user devstack@n-api.service[72089]: action_args: {'id': '558100b9-f3ac-47c7-9260-b897b0cae55f'} Apr 11 19:35:47 user devstack@n-api.service[72089]: {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 19:35:47 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:35:47 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 19:35:47 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 19:35:47 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 19:35:47 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 19:35:47 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 19:35:47 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 19:35:47 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 19:35:47 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 19:35:47 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 558100b9-f3ac-47c7-9260-b897b0cae55f could not be found. Apr 11 19:35:47 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi Apr 11 19:35:47 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 19:35:47 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi Apr 11 19:35:47 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:35:47 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 19:35:47 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 19:35:47 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 19:35:47 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 19:35:47 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 19:35:47 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 19:35:47 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 19:35:47 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 19:35:47 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 19:35:47 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 19:35:47 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 19:35:47 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 19:35:47 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 558100b9-f3ac-47c7-9260-b897b0cae55f could not be found. Apr 11 19:35:47 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi Apr 11 19:35:47 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 19:35:47 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi Apr 11 19:35:47 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:35:47 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 19:35:47 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 19:35:47 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 19:35:47 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 19:35:47 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 558100b9-f3ac-47c7-9260-b897b0cae55f could not be found. Apr 11 19:35:47 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi Apr 11 19:35:47 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [None req-36b9ef1a-5aa1-4504-93e5-e5b8d5ebbd49 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Returning 404 to user: Instance 558100b9-f3ac-47c7-9260-b897b0cae55f could not be found. {{(pid=72089) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 19:35:47 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [None req-36b9ef1a-5aa1-4504-93e5-e5b8d5ebbd49 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] 10.0.0.210 "GET /compute/v2.1/servers/558100b9-f3ac-47c7-9260-b897b0cae55f" status: 404 len: 111 microversion: 2.1 time: 0.032415 Apr 11 19:35:47 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 234/682] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 19:35:47 2023] GET /compute/v2.1/servers/558100b9-f3ac-47c7-9260-b897b0cae55f => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 19:35:47 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [None req-371832ab-20af-43bb-854a-3da9bf855c3a tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Calling method '>' {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:35:47 user devstack@n-api.service[72088]: DEBUG nova.compute.api [None req-371832ab-20af-43bb-854a-3da9bf855c3a tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] [instance: 53ccc829-6323-48ec-b63f-9de9bc607456] Fetching instance by UUID {{(pid=72088) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:35:47 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-371832ab-20af-43bb-854a-3da9bf855c3a tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:35:47 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-371832ab-20af-43bb-854a-3da9bf855c3a tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:35:47 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-371832ab-20af-43bb-854a-3da9bf855c3a tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:35:47 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-371832ab-20af-43bb-854a-3da9bf855c3a tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:35:47 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-371832ab-20af-43bb-854a-3da9bf855c3a tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:35:47 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-371832ab-20af-43bb-854a-3da9bf855c3a tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:35:47 user devstack@n-api.service[72088]: INFO nova.api.openstack.wsgi [None req-371832ab-20af-43bb-854a-3da9bf855c3a tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] HTTP exception thrown: Instance 53ccc829-6323-48ec-b63f-9de9bc607456 could not be found. Apr 11 19:35:47 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [None req-371832ab-20af-43bb-854a-3da9bf855c3a tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Request method failure captured: Apr 11 19:35:47 user devstack@n-api.service[72088]: request: DELETE /compute/v2.1/servers/53ccc829-6323-48ec-b63f-9de9bc607456 HTTP/1.1 Apr 11 19:35:47 user devstack@n-api.service[72088]: Accept: application/json Apr 11 19:35:47 user devstack@n-api.service[72088]: Accept-Encoding: identity Apr 11 19:35:47 user devstack@n-api.service[72088]: Connection: close Apr 11 19:35:47 user devstack@n-api.service[72088]: Content-Length: 0 Apr 11 19:35:47 user devstack@n-api.service[72088]: Content-Type: application/json Apr 11 19:35:47 user devstack@n-api.service[72088]: Host: 10.0.0.210 Apr 11 19:35:47 user devstack@n-api.service[72088]: Openstack-System-Scope: None Apr 11 19:35:47 user devstack@n-api.service[72088]: User-Agent: python-urllib3/1.26.15 Apr 11 19:35:47 user devstack@n-api.service[72088]: X-Auth-Token: gAAAAABkNbM9PPhjuxFro365bgGlzXmEeNXBFjH7B9DXRG846ZOMZNO8rjcHBUXZkmUpO9G06QygHvaEJVpRlrFcJIyDYtH16p4qIRFo8lVfjRkqkJh8soUAdF5jsPsH_hjCF2czbYEFIUpkQBo9PM7kG8byL_cnEa6VpD9RmxIaxcGcdobg_-U Apr 11 19:35:47 user devstack@n-api.service[72088]: X-Domain-Id: None Apr 11 19:35:47 user devstack@n-api.service[72088]: X-Domain-Name: None Apr 11 19:35:47 user devstack@n-api.service[72088]: X-Identity-Status: Confirmed Apr 11 19:35:47 user devstack@n-api.service[72088]: X-Is-Admin-Project: True Apr 11 19:35:47 user devstack@n-api.service[72088]: X-Project-Domain-Id: default Apr 11 19:35:47 user devstack@n-api.service[72088]: X-Project-Domain-Name: Default Apr 11 19:35:47 user devstack@n-api.service[72088]: X-Project-Id: 06966e2f4d3a4dec92282c7ad348635d Apr 11 19:35:47 user devstack@n-api.service[72088]: X-Project-Name: tempest-AttachVolumeNegativeTest-303418642 Apr 11 19:35:47 user devstack@n-api.service[72088]: X-Role: reader,member Apr 11 19:35:47 user devstack@n-api.service[72088]: X-Roles: reader,member Apr 11 19:35:47 user devstack@n-api.service[72088]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/06966e2f4d3a4dec92282c7ad348635d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/06966e2f4d3a4dec92282c7ad348635d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/06966e2f4d3a4dec92282c7ad348635d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 11 19:35:47 user devstack@n-api.service[72088]: X-Tenant: tempest-AttachVolumeNegativeTest-303418642 Apr 11 19:35:47 user devstack@n-api.service[72088]: X-Tenant-Id: 06966e2f4d3a4dec92282c7ad348635d Apr 11 19:35:47 user devstack@n-api.service[72088]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-303418642 Apr 11 19:35:47 user devstack@n-api.service[72088]: X-User: tempest-AttachVolumeNegativeTest-303418642-project-member Apr 11 19:35:47 user devstack@n-api.service[72088]: X-User-Domain-Id: default Apr 11 19:35:47 user devstack@n-api.service[72088]: X-User-Domain-Name: Default Apr 11 19:35:47 user devstack@n-api.service[72088]: X-User-Id: d5d405421ceb4d99967ef2e7f55e7809 Apr 11 19:35:47 user devstack@n-api.service[72088]: X-User-Name: tempest-AttachVolumeNegativeTest-303418642-project-member Apr 11 19:35:47 user devstack@n-api.service[72088]: method: > Apr 11 19:35:47 user devstack@n-api.service[72088]: exception: Instance 53ccc829-6323-48ec-b63f-9de9bc607456 could not be found. Apr 11 19:35:47 user devstack@n-api.service[72088]: action_args: {'id': '53ccc829-6323-48ec-b63f-9de9bc607456'} Apr 11 19:35:47 user devstack@n-api.service[72088]: {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 19:35:47 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:35:47 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 19:35:47 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 19:35:47 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 19:35:47 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 19:35:47 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 19:35:47 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 19:35:47 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 19:35:47 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 19:35:47 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 53ccc829-6323-48ec-b63f-9de9bc607456 could not be found. Apr 11 19:35:47 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi Apr 11 19:35:47 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 19:35:47 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi Apr 11 19:35:47 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:35:47 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 19:35:47 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 19:35:47 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 19:35:47 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 19:35:47 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 19:35:47 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 19:35:47 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 11 19:35:47 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 11 19:35:47 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 11 19:35:47 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 11 19:35:47 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 19:35:47 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 19:35:47 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 19:35:47 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 19:35:47 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 53ccc829-6323-48ec-b63f-9de9bc607456 could not be found. Apr 11 19:35:47 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi Apr 11 19:35:47 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 19:35:47 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi Apr 11 19:35:47 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:35:47 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 19:35:47 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 19:35:47 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 19:35:47 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 19:35:47 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 53ccc829-6323-48ec-b63f-9de9bc607456 could not be found. Apr 11 19:35:47 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi Apr 11 19:35:47 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [None req-371832ab-20af-43bb-854a-3da9bf855c3a tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Returning 404 to user: Instance 53ccc829-6323-48ec-b63f-9de9bc607456 could not be found. {{(pid=72088) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 19:35:47 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [None req-371832ab-20af-43bb-854a-3da9bf855c3a tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/53ccc829-6323-48ec-b63f-9de9bc607456" status: 404 len: 111 microversion: 2.1 time: 0.028122 Apr 11 19:35:47 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 223/683] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 19:35:47 2023] DELETE /compute/v2.1/servers/53ccc829-6323-48ec-b63f-9de9bc607456 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 19:35:47 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [None req-ce6a6b40-8f95-4346-9196-42b64b68ad83 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Calling method '>' {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:35:47 user devstack@n-api.service[72090]: DEBUG nova.compute.api [None req-ce6a6b40-8f95-4346-9196-42b64b68ad83 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] [instance: 53ccc829-6323-48ec-b63f-9de9bc607456] Fetching instance by UUID {{(pid=72090) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:35:47 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-ce6a6b40-8f95-4346-9196-42b64b68ad83 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:35:47 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-ce6a6b40-8f95-4346-9196-42b64b68ad83 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:35:47 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-ce6a6b40-8f95-4346-9196-42b64b68ad83 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:35:47 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-ce6a6b40-8f95-4346-9196-42b64b68ad83 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:35:47 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-ce6a6b40-8f95-4346-9196-42b64b68ad83 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:35:47 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-ce6a6b40-8f95-4346-9196-42b64b68ad83 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:35:47 user devstack@n-api.service[72090]: INFO nova.api.openstack.wsgi [None req-ce6a6b40-8f95-4346-9196-42b64b68ad83 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] HTTP exception thrown: Instance 53ccc829-6323-48ec-b63f-9de9bc607456 could not be found. Apr 11 19:35:47 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [None req-ce6a6b40-8f95-4346-9196-42b64b68ad83 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Request method failure captured: Apr 11 19:35:47 user devstack@n-api.service[72090]: request: GET /compute/v2.1/servers/53ccc829-6323-48ec-b63f-9de9bc607456 HTTP/1.1 Apr 11 19:35:47 user devstack@n-api.service[72090]: Accept: application/json Apr 11 19:35:47 user devstack@n-api.service[72090]: Accept-Encoding: identity Apr 11 19:35:47 user devstack@n-api.service[72090]: Connection: close Apr 11 19:35:47 user devstack@n-api.service[72090]: Content-Length: 0 Apr 11 19:35:47 user devstack@n-api.service[72090]: Content-Type: application/json Apr 11 19:35:47 user devstack@n-api.service[72090]: Host: 10.0.0.210 Apr 11 19:35:47 user devstack@n-api.service[72090]: Openstack-System-Scope: None Apr 11 19:35:47 user devstack@n-api.service[72090]: User-Agent: python-urllib3/1.26.15 Apr 11 19:35:47 user devstack@n-api.service[72090]: X-Auth-Token: gAAAAABkNbM9PPhjuxFro365bgGlzXmEeNXBFjH7B9DXRG846ZOMZNO8rjcHBUXZkmUpO9G06QygHvaEJVpRlrFcJIyDYtH16p4qIRFo8lVfjRkqkJh8soUAdF5jsPsH_hjCF2czbYEFIUpkQBo9PM7kG8byL_cnEa6VpD9RmxIaxcGcdobg_-U Apr 11 19:35:47 user devstack@n-api.service[72090]: X-Domain-Id: None Apr 11 19:35:47 user devstack@n-api.service[72090]: X-Domain-Name: None Apr 11 19:35:47 user devstack@n-api.service[72090]: X-Identity-Status: Confirmed Apr 11 19:35:47 user devstack@n-api.service[72090]: X-Is-Admin-Project: True Apr 11 19:35:47 user devstack@n-api.service[72090]: X-Project-Domain-Id: default Apr 11 19:35:47 user devstack@n-api.service[72090]: X-Project-Domain-Name: Default Apr 11 19:35:47 user devstack@n-api.service[72090]: X-Project-Id: 06966e2f4d3a4dec92282c7ad348635d Apr 11 19:35:47 user devstack@n-api.service[72090]: X-Project-Name: tempest-AttachVolumeNegativeTest-303418642 Apr 11 19:35:47 user devstack@n-api.service[72090]: X-Role: reader,member Apr 11 19:35:47 user devstack@n-api.service[72090]: X-Roles: reader,member Apr 11 19:35:47 user devstack@n-api.service[72090]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/06966e2f4d3a4dec92282c7ad348635d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/06966e2f4d3a4dec92282c7ad348635d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/06966e2f4d3a4dec92282c7ad348635d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 11 19:35:47 user devstack@n-api.service[72090]: X-Tenant: tempest-AttachVolumeNegativeTest-303418642 Apr 11 19:35:47 user devstack@n-api.service[72090]: X-Tenant-Id: 06966e2f4d3a4dec92282c7ad348635d Apr 11 19:35:47 user devstack@n-api.service[72090]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-303418642 Apr 11 19:35:47 user devstack@n-api.service[72090]: X-User: tempest-AttachVolumeNegativeTest-303418642-project-member Apr 11 19:35:47 user devstack@n-api.service[72090]: X-User-Domain-Id: default Apr 11 19:35:47 user devstack@n-api.service[72090]: X-User-Domain-Name: Default Apr 11 19:35:47 user devstack@n-api.service[72090]: X-User-Id: d5d405421ceb4d99967ef2e7f55e7809 Apr 11 19:35:47 user devstack@n-api.service[72090]: X-User-Name: tempest-AttachVolumeNegativeTest-303418642-project-member Apr 11 19:35:47 user devstack@n-api.service[72090]: method: > Apr 11 19:35:47 user devstack@n-api.service[72090]: exception: Instance 53ccc829-6323-48ec-b63f-9de9bc607456 could not be found. Apr 11 19:35:47 user devstack@n-api.service[72090]: action_args: {'id': '53ccc829-6323-48ec-b63f-9de9bc607456'} Apr 11 19:35:47 user devstack@n-api.service[72090]: {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 19:35:47 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:35:47 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 19:35:47 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 19:35:47 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 19:35:47 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 19:35:47 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 19:35:47 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 19:35:47 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 19:35:47 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 19:35:47 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 53ccc829-6323-48ec-b63f-9de9bc607456 could not be found. Apr 11 19:35:47 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi Apr 11 19:35:47 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 19:35:47 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi Apr 11 19:35:47 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:35:47 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 19:35:47 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 19:35:47 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 19:35:47 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 19:35:47 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 19:35:47 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 19:35:47 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 19:35:47 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 19:35:47 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 19:35:47 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 19:35:47 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 19:35:47 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 19:35:47 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 53ccc829-6323-48ec-b63f-9de9bc607456 could not be found. Apr 11 19:35:47 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi Apr 11 19:35:47 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 19:35:47 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi Apr 11 19:35:47 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:35:47 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 19:35:47 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 19:35:47 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 19:35:47 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 19:35:47 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 53ccc829-6323-48ec-b63f-9de9bc607456 could not be found. Apr 11 19:35:47 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi Apr 11 19:35:47 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [None req-ce6a6b40-8f95-4346-9196-42b64b68ad83 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Returning 404 to user: Instance 53ccc829-6323-48ec-b63f-9de9bc607456 could not be found. {{(pid=72090) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 19:35:47 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [None req-ce6a6b40-8f95-4346-9196-42b64b68ad83 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] 10.0.0.210 "GET /compute/v2.1/servers/53ccc829-6323-48ec-b63f-9de9bc607456" status: 404 len: 111 microversion: 2.1 time: 0.026719 Apr 11 19:35:47 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 227/684] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 19:35:47 2023] GET /compute/v2.1/servers/53ccc829-6323-48ec-b63f-9de9bc607456 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 19:35:48 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [req-b7d4318c-e773-4937-8be7-54d01923bb46 req-d322b8ff-0c59-412d-86d4-6c379f038c80 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "647674d8-af53-405a-8116-4b7a01549bdf", "name": "network-vif-plugged", "status": "completed", "tag": "e4e4888a-168a-4fe8-a43e-ee683b50a39a"}]} {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:35:48 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-b7d4318c-e773-4937-8be7-54d01923bb46 req-d322b8ff-0c59-412d-86d4-6c379f038c80 service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:35:48 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-b7d4318c-e773-4937-8be7-54d01923bb46 req-d322b8ff-0c59-412d-86d4-6c379f038c80 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:35:48 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-b7d4318c-e773-4937-8be7-54d01923bb46 req-d322b8ff-0c59-412d-86d4-6c379f038c80 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:35:48 user devstack@n-api.service[72089]: INFO nova.api.openstack.compute.server_external_events [req-b7d4318c-e773-4937-8be7-54d01923bb46 req-d322b8ff-0c59-412d-86d4-6c379f038c80 service nova] Creating event network-vif-plugged:e4e4888a-168a-4fe8-a43e-ee683b50a39a for instance 647674d8-af53-405a-8116-4b7a01549bdf on user Apr 11 19:35:48 user devstack@n-api.service[72089]: DEBUG nova.compute.api [req-b7d4318c-e773-4937-8be7-54d01923bb46 req-d322b8ff-0c59-412d-86d4-6c379f038c80 service nova] Instance 647674d8-af53-405a-8116-4b7a01549bdf is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=72089) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 11 19:35:48 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [req-b7d4318c-e773-4937-8be7-54d01923bb46 req-d322b8ff-0c59-412d-86d4-6c379f038c80 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061356 Apr 11 19:35:48 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 235/685] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:35:48 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:35:48 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [None req-a6364f93-8059-4d07-8491-c0f2e12b5840 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:35:48 user devstack@n-api.service[72088]: DEBUG nova.compute.api [None req-a6364f93-8059-4d07-8491-c0f2e12b5840 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] [instance: fbfa0825-c7c2-4f04-8c9a-102e238c3816] Fetching instance by UUID {{(pid=72088) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:35:48 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-a6364f93-8059-4d07-8491-c0f2e12b5840 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:35:48 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-a6364f93-8059-4d07-8491-c0f2e12b5840 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:35:48 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-a6364f93-8059-4d07-8491-c0f2e12b5840 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:35:48 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-a6364f93-8059-4d07-8491-c0f2e12b5840 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:35:48 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-a6364f93-8059-4d07-8491-c0f2e12b5840 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:35:48 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-a6364f93-8059-4d07-8491-c0f2e12b5840 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:35:48 user devstack@n-api.service[72088]: DEBUG nova.objects.instance [None req-a6364f93-8059-4d07-8491-c0f2e12b5840 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Lazy-loading 'flavor' on Instance uuid fbfa0825-c7c2-4f04-8c9a-102e238c3816 {{(pid=72088) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 11 19:35:49 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [None req-a6364f93-8059-4d07-8491-c0f2e12b5840 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] 10.0.0.210 "POST /compute/v2.1/servers/fbfa0825-c7c2-4f04-8c9a-102e238c3816/action" status: 202 len: 0 microversion: 2.20 time: 0.941074 Apr 11 19:35:49 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 224/686] 10.0.0.210 () {66 vars in 1396 bytes} [Tue Apr 11 19:35:48 2023] POST /compute/v2.1/servers/fbfa0825-c7c2-4f04-8c9a-102e238c3816/action => generated 0 bytes in 943 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 11 19:35:49 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [None req-043b89df-c92c-43ff-b936-cd7bdfc3ab69 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Calling method '>' {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:35:49 user devstack@n-api.service[72090]: DEBUG nova.compute.api [None req-043b89df-c92c-43ff-b936-cd7bdfc3ab69 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] [instance: fbfa0825-c7c2-4f04-8c9a-102e238c3816] Fetching instance by UUID {{(pid=72090) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:35:49 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-043b89df-c92c-43ff-b936-cd7bdfc3ab69 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:35:49 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-043b89df-c92c-43ff-b936-cd7bdfc3ab69 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:35:49 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-043b89df-c92c-43ff-b936-cd7bdfc3ab69 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:35:49 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-043b89df-c92c-43ff-b936-cd7bdfc3ab69 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:35:49 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-043b89df-c92c-43ff-b936-cd7bdfc3ab69 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:35:49 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-043b89df-c92c-43ff-b936-cd7bdfc3ab69 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:35:49 user devstack@n-api.service[72090]: DEBUG nova.policy [None req-043b89df-c92c-43ff-b936-cd7bdfc3ab69 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0558ba5a2b04d36ba2f2411090cc4e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d8b189667e34931aa36149620a036e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72090) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:35:49 user devstack@n-api.service[72090]: DEBUG nova.policy [None req-043b89df-c92c-43ff-b936-cd7bdfc3ab69 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0558ba5a2b04d36ba2f2411090cc4e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d8b189667e34931aa36149620a036e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72090) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:35:49 user devstack@n-api.service[72090]: DEBUG nova.policy [None req-043b89df-c92c-43ff-b936-cd7bdfc3ab69 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0558ba5a2b04d36ba2f2411090cc4e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d8b189667e34931aa36149620a036e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72090) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:35:49 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [None req-043b89df-c92c-43ff-b936-cd7bdfc3ab69 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fbfa0825-c7c2-4f04-8c9a-102e238c3816" status: 200 len: 1712 microversion: 2.20 time: 0.158189 Apr 11 19:35:49 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 228/687] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 19:35:49 2023] GET /compute/v2.1/servers/fbfa0825-c7c2-4f04-8c9a-102e238c3816 => generated 1712 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 19:35:49 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [None req-a0d9a80a-3b56-47a1-a92f-ccd07db1d4f6 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Calling method '>' {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:35:49 user devstack@n-api.service[72089]: DEBUG nova.compute.api [None req-a0d9a80a-3b56-47a1-a92f-ccd07db1d4f6 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] [instance: bed4001c-02c2-4c6b-84c8-61654df66d8b] Fetching instance by UUID {{(pid=72089) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:35:49 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-a0d9a80a-3b56-47a1-a92f-ccd07db1d4f6 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:35:49 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-a0d9a80a-3b56-47a1-a92f-ccd07db1d4f6 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:35:49 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-a0d9a80a-3b56-47a1-a92f-ccd07db1d4f6 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:35:49 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-a0d9a80a-3b56-47a1-a92f-ccd07db1d4f6 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:35:49 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-a0d9a80a-3b56-47a1-a92f-ccd07db1d4f6 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:35:49 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-a0d9a80a-3b56-47a1-a92f-ccd07db1d4f6 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:35:49 user devstack@n-api.service[72089]: INFO nova.api.openstack.wsgi [None req-a0d9a80a-3b56-47a1-a92f-ccd07db1d4f6 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] HTTP exception thrown: Instance bed4001c-02c2-4c6b-84c8-61654df66d8b could not be found. Apr 11 19:35:49 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [None req-a0d9a80a-3b56-47a1-a92f-ccd07db1d4f6 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Request method failure captured: Apr 11 19:35:49 user devstack@n-api.service[72089]: request: DELETE /compute/v2.1/servers/bed4001c-02c2-4c6b-84c8-61654df66d8b HTTP/1.1 Apr 11 19:35:49 user devstack@n-api.service[72089]: Accept: application/json Apr 11 19:35:49 user devstack@n-api.service[72089]: Accept-Encoding: identity Apr 11 19:35:49 user devstack@n-api.service[72089]: Connection: close Apr 11 19:35:49 user devstack@n-api.service[72089]: Content-Length: 0 Apr 11 19:35:49 user devstack@n-api.service[72089]: Content-Type: application/json Apr 11 19:35:49 user devstack@n-api.service[72089]: Host: 10.0.0.210 Apr 11 19:35:49 user devstack@n-api.service[72089]: Openstack-System-Scope: None Apr 11 19:35:49 user devstack@n-api.service[72089]: User-Agent: python-urllib3/1.26.15 Apr 11 19:35:49 user devstack@n-api.service[72089]: X-Auth-Token: gAAAAABkNbM9PPhjuxFro365bgGlzXmEeNXBFjH7B9DXRG846ZOMZNO8rjcHBUXZkmUpO9G06QygHvaEJVpRlrFcJIyDYtH16p4qIRFo8lVfjRkqkJh8soUAdF5jsPsH_hjCF2czbYEFIUpkQBo9PM7kG8byL_cnEa6VpD9RmxIaxcGcdobg_-U Apr 11 19:35:49 user devstack@n-api.service[72089]: X-Domain-Id: None Apr 11 19:35:49 user devstack@n-api.service[72089]: X-Domain-Name: None Apr 11 19:35:49 user devstack@n-api.service[72089]: X-Identity-Status: Confirmed Apr 11 19:35:49 user devstack@n-api.service[72089]: X-Is-Admin-Project: True Apr 11 19:35:49 user devstack@n-api.service[72089]: X-Project-Domain-Id: default Apr 11 19:35:49 user devstack@n-api.service[72089]: X-Project-Domain-Name: Default Apr 11 19:35:49 user devstack@n-api.service[72089]: X-Project-Id: 06966e2f4d3a4dec92282c7ad348635d Apr 11 19:35:49 user devstack@n-api.service[72089]: X-Project-Name: tempest-AttachVolumeNegativeTest-303418642 Apr 11 19:35:49 user devstack@n-api.service[72089]: X-Role: reader,member Apr 11 19:35:49 user devstack@n-api.service[72089]: X-Roles: reader,member Apr 11 19:35:49 user devstack@n-api.service[72089]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/06966e2f4d3a4dec92282c7ad348635d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/06966e2f4d3a4dec92282c7ad348635d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/06966e2f4d3a4dec92282c7ad348635d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 11 19:35:49 user devstack@n-api.service[72089]: X-Tenant: tempest-AttachVolumeNegativeTest-303418642 Apr 11 19:35:49 user devstack@n-api.service[72089]: X-Tenant-Id: 06966e2f4d3a4dec92282c7ad348635d Apr 11 19:35:49 user devstack@n-api.service[72089]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-303418642 Apr 11 19:35:49 user devstack@n-api.service[72089]: X-User: tempest-AttachVolumeNegativeTest-303418642-project-member Apr 11 19:35:49 user devstack@n-api.service[72089]: X-User-Domain-Id: default Apr 11 19:35:49 user devstack@n-api.service[72089]: X-User-Domain-Name: Default Apr 11 19:35:49 user devstack@n-api.service[72089]: X-User-Id: d5d405421ceb4d99967ef2e7f55e7809 Apr 11 19:35:49 user devstack@n-api.service[72089]: X-User-Name: tempest-AttachVolumeNegativeTest-303418642-project-member Apr 11 19:35:49 user devstack@n-api.service[72089]: method: > Apr 11 19:35:49 user devstack@n-api.service[72089]: exception: Instance bed4001c-02c2-4c6b-84c8-61654df66d8b could not be found. Apr 11 19:35:49 user devstack@n-api.service[72089]: action_args: {'id': 'bed4001c-02c2-4c6b-84c8-61654df66d8b'} Apr 11 19:35:49 user devstack@n-api.service[72089]: {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 19:35:49 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:35:49 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 19:35:49 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 19:35:49 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 19:35:49 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 19:35:49 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 19:35:49 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 19:35:49 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 19:35:49 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 19:35:49 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bed4001c-02c2-4c6b-84c8-61654df66d8b could not be found. Apr 11 19:35:49 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi Apr 11 19:35:49 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 19:35:49 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi Apr 11 19:35:49 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:35:49 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 19:35:49 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 19:35:49 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 19:35:49 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 19:35:49 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 19:35:49 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 19:35:49 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 11 19:35:49 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 11 19:35:49 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 11 19:35:49 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 11 19:35:49 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 19:35:49 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 19:35:49 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 19:35:49 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 19:35:49 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bed4001c-02c2-4c6b-84c8-61654df66d8b could not be found. Apr 11 19:35:49 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi Apr 11 19:35:49 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 19:35:49 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi Apr 11 19:35:49 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:35:49 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 19:35:49 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 19:35:49 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 19:35:49 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 19:35:49 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bed4001c-02c2-4c6b-84c8-61654df66d8b could not be found. Apr 11 19:35:49 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi Apr 11 19:35:49 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [None req-a0d9a80a-3b56-47a1-a92f-ccd07db1d4f6 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Returning 404 to user: Instance bed4001c-02c2-4c6b-84c8-61654df66d8b could not be found. {{(pid=72089) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 19:35:49 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [None req-a0d9a80a-3b56-47a1-a92f-ccd07db1d4f6 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/bed4001c-02c2-4c6b-84c8-61654df66d8b" status: 404 len: 111 microversion: 2.1 time: 0.040361 Apr 11 19:35:49 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 236/688] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 19:35:49 2023] DELETE /compute/v2.1/servers/bed4001c-02c2-4c6b-84c8-61654df66d8b => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 19:35:49 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [None req-9085bb1d-dc06-4621-bb93-f6aab9a04a73 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Calling method '>' {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:35:49 user devstack@n-api.service[72088]: DEBUG nova.compute.api [None req-9085bb1d-dc06-4621-bb93-f6aab9a04a73 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] [instance: bed4001c-02c2-4c6b-84c8-61654df66d8b] Fetching instance by UUID {{(pid=72088) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:35:49 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-9085bb1d-dc06-4621-bb93-f6aab9a04a73 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:35:49 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-9085bb1d-dc06-4621-bb93-f6aab9a04a73 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:35:49 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-9085bb1d-dc06-4621-bb93-f6aab9a04a73 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:35:49 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-9085bb1d-dc06-4621-bb93-f6aab9a04a73 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:35:49 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-9085bb1d-dc06-4621-bb93-f6aab9a04a73 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:35:49 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-9085bb1d-dc06-4621-bb93-f6aab9a04a73 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:35:49 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [req-3424712a-e7cd-4d99-8a98-885ad9b89b05 req-ab44d826-0be7-4464-974f-39c0ec9f82e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fbfa0825-c7c2-4f04-8c9a-102e238c3816", "name": "network-vif-unplugged", "status": "completed", "tag": "0be0dfa4-d8ad-4d32-83ab-a090c0f77f34"}]} {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:35:49 user devstack@n-api.service[72088]: INFO nova.api.openstack.wsgi [None req-9085bb1d-dc06-4621-bb93-f6aab9a04a73 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] HTTP exception thrown: Instance bed4001c-02c2-4c6b-84c8-61654df66d8b could not be found. Apr 11 19:35:49 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [None req-9085bb1d-dc06-4621-bb93-f6aab9a04a73 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Request method failure captured: Apr 11 19:35:49 user devstack@n-api.service[72088]: request: GET /compute/v2.1/servers/bed4001c-02c2-4c6b-84c8-61654df66d8b HTTP/1.1 Apr 11 19:35:49 user devstack@n-api.service[72088]: Accept: application/json Apr 11 19:35:49 user devstack@n-api.service[72088]: Accept-Encoding: identity Apr 11 19:35:49 user devstack@n-api.service[72088]: Connection: close Apr 11 19:35:49 user devstack@n-api.service[72088]: Content-Length: 0 Apr 11 19:35:49 user devstack@n-api.service[72088]: Content-Type: application/json Apr 11 19:35:49 user devstack@n-api.service[72088]: Host: 10.0.0.210 Apr 11 19:35:49 user devstack@n-api.service[72088]: Openstack-System-Scope: None Apr 11 19:35:49 user devstack@n-api.service[72088]: User-Agent: python-urllib3/1.26.15 Apr 11 19:35:49 user devstack@n-api.service[72088]: X-Auth-Token: gAAAAABkNbM9PPhjuxFro365bgGlzXmEeNXBFjH7B9DXRG846ZOMZNO8rjcHBUXZkmUpO9G06QygHvaEJVpRlrFcJIyDYtH16p4qIRFo8lVfjRkqkJh8soUAdF5jsPsH_hjCF2czbYEFIUpkQBo9PM7kG8byL_cnEa6VpD9RmxIaxcGcdobg_-U Apr 11 19:35:49 user devstack@n-api.service[72088]: X-Domain-Id: None Apr 11 19:35:49 user devstack@n-api.service[72088]: X-Domain-Name: None Apr 11 19:35:49 user devstack@n-api.service[72088]: X-Identity-Status: Confirmed Apr 11 19:35:49 user devstack@n-api.service[72088]: X-Is-Admin-Project: True Apr 11 19:35:49 user devstack@n-api.service[72088]: X-Project-Domain-Id: default Apr 11 19:35:49 user devstack@n-api.service[72088]: X-Project-Domain-Name: Default Apr 11 19:35:49 user devstack@n-api.service[72088]: X-Project-Id: 06966e2f4d3a4dec92282c7ad348635d Apr 11 19:35:49 user devstack@n-api.service[72088]: X-Project-Name: tempest-AttachVolumeNegativeTest-303418642 Apr 11 19:35:49 user devstack@n-api.service[72088]: X-Role: reader,member Apr 11 19:35:49 user devstack@n-api.service[72088]: X-Roles: reader,member Apr 11 19:35:49 user devstack@n-api.service[72088]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/06966e2f4d3a4dec92282c7ad348635d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/06966e2f4d3a4dec92282c7ad348635d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/06966e2f4d3a4dec92282c7ad348635d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 11 19:35:49 user devstack@n-api.service[72088]: X-Tenant: tempest-AttachVolumeNegativeTest-303418642 Apr 11 19:35:49 user devstack@n-api.service[72088]: X-Tenant-Id: 06966e2f4d3a4dec92282c7ad348635d Apr 11 19:35:49 user devstack@n-api.service[72088]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-303418642 Apr 11 19:35:49 user devstack@n-api.service[72088]: X-User: tempest-AttachVolumeNegativeTest-303418642-project-member Apr 11 19:35:49 user devstack@n-api.service[72088]: X-User-Domain-Id: default Apr 11 19:35:49 user devstack@n-api.service[72088]: X-User-Domain-Name: Default Apr 11 19:35:49 user devstack@n-api.service[72088]: X-User-Id: d5d405421ceb4d99967ef2e7f55e7809 Apr 11 19:35:49 user devstack@n-api.service[72088]: X-User-Name: tempest-AttachVolumeNegativeTest-303418642-project-member Apr 11 19:35:49 user devstack@n-api.service[72088]: method: > Apr 11 19:35:49 user devstack@n-api.service[72088]: exception: Instance bed4001c-02c2-4c6b-84c8-61654df66d8b could not be found. Apr 11 19:35:49 user devstack@n-api.service[72088]: action_args: {'id': 'bed4001c-02c2-4c6b-84c8-61654df66d8b'} Apr 11 19:35:49 user devstack@n-api.service[72088]: {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 19:35:49 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:35:49 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 19:35:49 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 19:35:49 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 19:35:49 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 19:35:49 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 19:35:49 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 19:35:49 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 19:35:49 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 19:35:49 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bed4001c-02c2-4c6b-84c8-61654df66d8b could not be found. Apr 11 19:35:49 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi Apr 11 19:35:49 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 19:35:49 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi Apr 11 19:35:49 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:35:49 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 19:35:49 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 19:35:49 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 19:35:49 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 19:35:49 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 19:35:49 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 19:35:49 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 19:35:49 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 19:35:49 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 19:35:49 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 19:35:49 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 19:35:49 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 19:35:49 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bed4001c-02c2-4c6b-84c8-61654df66d8b could not be found. Apr 11 19:35:49 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi Apr 11 19:35:49 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 19:35:49 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi Apr 11 19:35:49 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:35:49 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 19:35:49 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 19:35:49 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 19:35:49 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 19:35:49 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bed4001c-02c2-4c6b-84c8-61654df66d8b could not be found. Apr 11 19:35:49 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi Apr 11 19:35:49 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [None req-9085bb1d-dc06-4621-bb93-f6aab9a04a73 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Returning 404 to user: Instance bed4001c-02c2-4c6b-84c8-61654df66d8b could not be found. {{(pid=72088) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 19:35:49 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [None req-9085bb1d-dc06-4621-bb93-f6aab9a04a73 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bed4001c-02c2-4c6b-84c8-61654df66d8b" status: 404 len: 111 microversion: 2.1 time: 0.030283 Apr 11 19:35:49 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 225/689] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 19:35:49 2023] GET /compute/v2.1/servers/bed4001c-02c2-4c6b-84c8-61654df66d8b => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 19:35:49 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-3424712a-e7cd-4d99-8a98-885ad9b89b05 req-ab44d826-0be7-4464-974f-39c0ec9f82e3 service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:35:49 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-3424712a-e7cd-4d99-8a98-885ad9b89b05 req-ab44d826-0be7-4464-974f-39c0ec9f82e3 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:35:49 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-3424712a-e7cd-4d99-8a98-885ad9b89b05 req-ab44d826-0be7-4464-974f-39c0ec9f82e3 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:35:49 user devstack@n-api.service[72090]: INFO nova.api.openstack.compute.server_external_events [req-3424712a-e7cd-4d99-8a98-885ad9b89b05 req-ab44d826-0be7-4464-974f-39c0ec9f82e3 service nova] Creating event network-vif-unplugged:0be0dfa4-d8ad-4d32-83ab-a090c0f77f34 for instance fbfa0825-c7c2-4f04-8c9a-102e238c3816 on user Apr 11 19:35:49 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [req-3424712a-e7cd-4d99-8a98-885ad9b89b05 req-ab44d826-0be7-4464-974f-39c0ec9f82e3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.039182 Apr 11 19:35:49 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 229/690] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:35:49 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:35:50 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [req-278d9aaf-4fec-4047-a76d-306eae2c5614 req-e947e901-8789-49b1-8bba-3a8b5e997352 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "647674d8-af53-405a-8116-4b7a01549bdf", "name": "network-vif-plugged", "status": "completed", "tag": "e4e4888a-168a-4fe8-a43e-ee683b50a39a"}]} {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:35:50 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-278d9aaf-4fec-4047-a76d-306eae2c5614 req-e947e901-8789-49b1-8bba-3a8b5e997352 service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:35:50 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-278d9aaf-4fec-4047-a76d-306eae2c5614 req-e947e901-8789-49b1-8bba-3a8b5e997352 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:35:50 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-278d9aaf-4fec-4047-a76d-306eae2c5614 req-e947e901-8789-49b1-8bba-3a8b5e997352 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:35:50 user devstack@n-api.service[72089]: INFO nova.api.openstack.compute.server_external_events [req-278d9aaf-4fec-4047-a76d-306eae2c5614 req-e947e901-8789-49b1-8bba-3a8b5e997352 service nova] Creating event network-vif-plugged:e4e4888a-168a-4fe8-a43e-ee683b50a39a for instance 647674d8-af53-405a-8116-4b7a01549bdf on user Apr 11 19:35:50 user devstack@n-api.service[72089]: DEBUG nova.compute.api [req-278d9aaf-4fec-4047-a76d-306eae2c5614 req-e947e901-8789-49b1-8bba-3a8b5e997352 service nova] Instance 647674d8-af53-405a-8116-4b7a01549bdf is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=72089) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 11 19:35:50 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [req-278d9aaf-4fec-4047-a76d-306eae2c5614 req-e947e901-8789-49b1-8bba-3a8b5e997352 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045810 Apr 11 19:35:50 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 237/691] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:35:50 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 11 19:35:50 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [None req-194005b3-79df-4c8d-bc29-35e92cee9f2d tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ServerBootFromVolumeStableRescueTest-image-738001171"}} {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:35:50 user devstack@n-api.service[72088]: DEBUG nova.compute.api [None req-194005b3-79df-4c8d-bc29-35e92cee9f2d tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] [instance: b079367a-558e-4920-ad8d-972a8065260c] Fetching instance by UUID {{(pid=72088) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:35:50 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-194005b3-79df-4c8d-bc29-35e92cee9f2d tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:35:50 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-194005b3-79df-4c8d-bc29-35e92cee9f2d tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:35:50 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-194005b3-79df-4c8d-bc29-35e92cee9f2d tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:35:50 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-194005b3-79df-4c8d-bc29-35e92cee9f2d tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:35:50 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-194005b3-79df-4c8d-bc29-35e92cee9f2d tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:35:50 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-194005b3-79df-4c8d-bc29-35e92cee9f2d tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:35:51 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [None req-194005b3-79df-4c8d-bc29-35e92cee9f2d tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] 10.0.0.210 "POST /compute/v2.1/servers/b079367a-558e-4920-ad8d-972a8065260c/action" status: 202 len: 52 microversion: 2.87 time: 0.998837 Apr 11 19:35:51 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 226/692] 10.0.0.210 () {66 vars in 1396 bytes} [Tue Apr 11 19:35:50 2023] POST /compute/v2.1/servers/b079367a-558e-4920-ad8d-972a8065260c/action => generated 52 bytes in 1000 msecs (HTTP/1.1 202) 9 headers in 364 bytes (1 switches on core 0) Apr 11 19:35:51 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [req-8c17f1a4-3744-464c-9ccf-a85ebbf7d576 req-2f8d77fd-33c5-4270-b21c-d85b7beb2bdd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fbfa0825-c7c2-4f04-8c9a-102e238c3816", "name": "network-vif-plugged", "status": "completed", "tag": "0be0dfa4-d8ad-4d32-83ab-a090c0f77f34"}]} {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:35:51 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-8c17f1a4-3744-464c-9ccf-a85ebbf7d576 req-2f8d77fd-33c5-4270-b21c-d85b7beb2bdd service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:35:51 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-8c17f1a4-3744-464c-9ccf-a85ebbf7d576 req-2f8d77fd-33c5-4270-b21c-d85b7beb2bdd service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:35:51 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-8c17f1a4-3744-464c-9ccf-a85ebbf7d576 req-2f8d77fd-33c5-4270-b21c-d85b7beb2bdd service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:35:51 user devstack@n-api.service[72090]: INFO nova.api.openstack.compute.server_external_events [req-8c17f1a4-3744-464c-9ccf-a85ebbf7d576 req-2f8d77fd-33c5-4270-b21c-d85b7beb2bdd service nova] Creating event network-vif-plugged:0be0dfa4-d8ad-4d32-83ab-a090c0f77f34 for instance fbfa0825-c7c2-4f04-8c9a-102e238c3816 on user Apr 11 19:35:51 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [req-8c17f1a4-3744-464c-9ccf-a85ebbf7d576 req-2f8d77fd-33c5-4270-b21c-d85b7beb2bdd service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032323 Apr 11 19:35:51 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 230/693] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:35:51 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:35:55 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [req-e641982c-f245-465f-b3d2-a0f72802ce3e req-a059d6f2-02ba-428c-9f44-6352add8c85c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fbfa0825-c7c2-4f04-8c9a-102e238c3816", "tag": "0be0dfa4-d8ad-4d32-83ab-a090c0f77f34"}]} {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:35:55 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-e641982c-f245-465f-b3d2-a0f72802ce3e req-a059d6f2-02ba-428c-9f44-6352add8c85c service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:35:55 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-e641982c-f245-465f-b3d2-a0f72802ce3e req-a059d6f2-02ba-428c-9f44-6352add8c85c service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:35:55 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-e641982c-f245-465f-b3d2-a0f72802ce3e req-a059d6f2-02ba-428c-9f44-6352add8c85c service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:35:55 user devstack@n-api.service[72089]: INFO nova.api.openstack.compute.server_external_events [req-e641982c-f245-465f-b3d2-a0f72802ce3e req-a059d6f2-02ba-428c-9f44-6352add8c85c service nova] Creating event network-changed:0be0dfa4-d8ad-4d32-83ab-a090c0f77f34 for instance fbfa0825-c7c2-4f04-8c9a-102e238c3816 on user Apr 11 19:35:55 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [req-e641982c-f245-465f-b3d2-a0f72802ce3e req-a059d6f2-02ba-428c-9f44-6352add8c85c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.113000 Apr 11 19:35:55 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 238/694] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:35:55 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:35:57 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [None req-c9df9ac1-075b-44bb-941a-a31dd0cd20a3 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Calling method '>' {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:35:57 user devstack@n-api.service[72088]: DEBUG nova.compute.api [None req-c9df9ac1-075b-44bb-941a-a31dd0cd20a3 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] [instance: 5d000531-5884-405d-9e17-1dc5f39226d0] Fetching instance by UUID {{(pid=72088) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:35:57 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-c9df9ac1-075b-44bb-941a-a31dd0cd20a3 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:35:57 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-c9df9ac1-075b-44bb-941a-a31dd0cd20a3 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:35:57 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-c9df9ac1-075b-44bb-941a-a31dd0cd20a3 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:35:57 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-c9df9ac1-075b-44bb-941a-a31dd0cd20a3 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:35:57 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-c9df9ac1-075b-44bb-941a-a31dd0cd20a3 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:35:57 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-c9df9ac1-075b-44bb-941a-a31dd0cd20a3 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:35:57 user devstack@n-api.service[72088]: DEBUG nova.policy [None req-c9df9ac1-075b-44bb-941a-a31dd0cd20a3 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20f337feb0ed4653976ace530bfdd877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d5246cf04a7401388cba38d16e298ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72088) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:35:57 user devstack@n-api.service[72088]: DEBUG dbcounter [-] [72088] Writing DB stats nova_cell1:SELECT=62,nova_cell1:UPDATE=6,nova_cell1:INSERT=3 {{(pid=72088) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:35:57 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [None req-c9df9ac1-075b-44bb-941a-a31dd0cd20a3 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5d000531-5884-405d-9e17-1dc5f39226d0" status: 200 len: 1494 microversion: 2.1 time: 0.155107 Apr 11 19:35:57 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 227/695] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 19:35:57 2023] GET /compute/v2.1/servers/5d000531-5884-405d-9e17-1dc5f39226d0 => generated 1494 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:35:58 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [None req-30605147-0715-495b-bb45-85abb0437de5 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Calling method '>' {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:35:58 user devstack@n-api.service[72090]: DEBUG nova.compute.api [None req-30605147-0715-495b-bb45-85abb0437de5 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] [instance: b079367a-558e-4920-ad8d-972a8065260c] Fetching instance by UUID {{(pid=72090) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:35:58 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-30605147-0715-495b-bb45-85abb0437de5 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:35:58 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-30605147-0715-495b-bb45-85abb0437de5 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:35:58 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-30605147-0715-495b-bb45-85abb0437de5 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:35:58 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-30605147-0715-495b-bb45-85abb0437de5 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:35:58 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-30605147-0715-495b-bb45-85abb0437de5 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:35:58 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-30605147-0715-495b-bb45-85abb0437de5 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:35:58 user devstack@n-api.service[72090]: DEBUG nova.policy [None req-30605147-0715-495b-bb45-85abb0437de5 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b3adca432b04d70818a51d1366f5c6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb91586feb3f4a4c84fa8c2183baaf8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72090) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:35:58 user devstack@n-api.service[72090]: DEBUG nova.policy [None req-30605147-0715-495b-bb45-85abb0437de5 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b3adca432b04d70818a51d1366f5c6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb91586feb3f4a4c84fa8c2183baaf8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72090) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:35:58 user devstack@n-api.service[72090]: DEBUG nova.policy [None req-30605147-0715-495b-bb45-85abb0437de5 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b3adca432b04d70818a51d1366f5c6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb91586feb3f4a4c84fa8c2183baaf8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72090) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:35:58 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [None req-30605147-0715-495b-bb45-85abb0437de5 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b079367a-558e-4920-ad8d-972a8065260c" status: 200 len: 1690 microversion: 2.87 time: 0.233578 Apr 11 19:35:58 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 231/696] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 19:35:58 2023] GET /compute/v2.1/servers/b079367a-558e-4920-ad8d-972a8065260c => generated 1690 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 19:35:59 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [None req-fce20231-30a3-4168-aefa-f76a92c78262 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Calling method '>' {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:35:59 user devstack@n-api.service[72089]: DEBUG nova.compute.api [None req-fce20231-30a3-4168-aefa-f76a92c78262 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] [instance: bd559e67-3c8f-42b4-b1d6-fd171c8850b8] Fetching instance by UUID {{(pid=72089) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:35:59 user devstack@n-api.service[72089]: DEBUG dbcounter [-] [72089] Writing DB stats nova_api:SELECT=21 {{(pid=72089) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:35:59 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-fce20231-30a3-4168-aefa-f76a92c78262 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:35:59 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-fce20231-30a3-4168-aefa-f76a92c78262 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:35:59 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-fce20231-30a3-4168-aefa-f76a92c78262 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:35:59 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-fce20231-30a3-4168-aefa-f76a92c78262 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:35:59 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-fce20231-30a3-4168-aefa-f76a92c78262 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:35:59 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-fce20231-30a3-4168-aefa-f76a92c78262 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:35:59 user devstack@n-api.service[72089]: DEBUG dbcounter [-] [72089] Writing DB stats nova_cell1:SELECT=33 {{(pid=72089) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:35:59 user devstack@n-api.service[72089]: DEBUG nova.policy [None req-fce20231-30a3-4168-aefa-f76a92c78262 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31c237e142784bd6aa460d6f1bf33400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd886d2ec5fc946b49af3c8ca7c8556c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72089) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:35:59 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [None req-fce20231-30a3-4168-aefa-f76a92c78262 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bd559e67-3c8f-42b4-b1d6-fd171c8850b8" status: 200 len: 1538 microversion: 2.1 time: 0.358464 Apr 11 19:35:59 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 239/697] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 19:35:59 2023] GET /compute/v2.1/servers/bd559e67-3c8f-42b4-b1d6-fd171c8850b8 => generated 1538 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:36:13 user devstack@n-api.service[72088]: DEBUG dbcounter [-] [72088] Writing DB stats nova_api:SELECT=21,nova_api:DELETE=1 {{(pid=72088) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:36:13 user devstack@n-api.service[72088]: DEBUG dbcounter [-] [72088] Writing DB stats nova_cell1:SELECT=1 {{(pid=72088) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:36:13 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [None req-09792a05-7242-4712-bfce-70804339904d tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] Action: 'create', calling method: .version_select at 0x7f119dbc6320>, body: {"keypair": {"name": "tempest-TestShelveInstance-1765937682", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOWOJEcAet7cYNYxgnjtKjY7EQdZEK+sNwCTk8xWL8WixGkKk2vUONnTt9oMkdV+yembu+c8rHexAl3dfd0YzfkTAZ1D5FG2Y66/ZHnUkpqMPcyP8plrDur+CPwxyvFqNQ=="}} {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:36:13 user devstack@n-api.service[72088]: DEBUG nova.quota [None req-09792a05-7242-4712-bfce-70804339904d tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] Getting quotas for project c7b9baa081ca455ea6931b7801c805b8. Resources: {'key_pairs'} {{(pid=72088) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 19:36:13 user devstack@n-api.service[72088]: DEBUG nova.quota [None req-09792a05-7242-4712-bfce-70804339904d tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] Getting quotas for user 68fcdcd3af164195bf0c7da3b8dfecb7 and project c7b9baa081ca455ea6931b7801c805b8. Resources: {'key_pairs'} {{(pid=72088) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 19:36:13 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [None req-09792a05-7242-4712-bfce-70804339904d tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.260730 Apr 11 19:36:13 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 228/698] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Apr 11 19:36:13 2023] POST /compute/v2.1/os-keypairs => generated 397 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:36:17 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [None req-45ed5149-6938-4e29-91d9-f3b5351c8d6e tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-63091414", "imageRef": "", "flavorRef": "42", "key_name": "tempest-TestShelveInstance-1765937682", "security_groups": [{"name": "tempest-secgroup-smoke-477435793"}], "networks": [{"uuid": "696f6da7-67cb-471b-b825-32cd2415de26"}], "block_device_mapping_v2": [{"uuid": "199762db-3930-4f05-a4da-15dee19e5418", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:36:17 user devstack@n-api.service[72090]: DEBUG dbcounter [-] [72090] Writing DB stats nova_cell1:SELECT=50,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=72090) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:36:17 user devstack@n-api.service[72090]: DEBUG dbcounter [-] [72090] Writing DB stats nova_api:SELECT=34 {{(pid=72090) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:36:17 user devstack@n-api.service[72090]: DEBUG nova.network.neutron [None req-45ed5149-6938-4e29-91d9-f3b5351c8d6e tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] validate_networks() for [('696f6da7-67cb-471b-b825-32cd2415de26', None, None, None, None, None)] {{(pid=72090) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 11 19:36:17 user devstack@n-api.service[72090]: DEBUG nova.virt.hardware [None req-45ed5149-6938-4e29-91d9-f3b5351c8d6e tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] Flavor limits 0:0:0 {{(pid=72090) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 19:36:17 user devstack@n-api.service[72090]: DEBUG nova.virt.hardware [None req-45ed5149-6938-4e29-91d9-f3b5351c8d6e tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] Image limits 0:0:0 {{(pid=72090) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 19:36:17 user devstack@n-api.service[72090]: DEBUG nova.virt.hardware [None req-45ed5149-6938-4e29-91d9-f3b5351c8d6e tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] Flavor pref 0:0:0 {{(pid=72090) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 19:36:17 user devstack@n-api.service[72090]: DEBUG nova.virt.hardware [None req-45ed5149-6938-4e29-91d9-f3b5351c8d6e tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] Image pref 0:0:0 {{(pid=72090) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 19:36:17 user devstack@n-api.service[72090]: DEBUG nova.virt.hardware [None req-45ed5149-6938-4e29-91d9-f3b5351c8d6e tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72090) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 19:36:17 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-45ed5149-6938-4e29-91d9-f3b5351c8d6e tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:36:17 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-45ed5149-6938-4e29-91d9-f3b5351c8d6e tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:36:17 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-45ed5149-6938-4e29-91d9-f3b5351c8d6e tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:36:17 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-45ed5149-6938-4e29-91d9-f3b5351c8d6e tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:36:17 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-45ed5149-6938-4e29-91d9-f3b5351c8d6e tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:36:17 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-45ed5149-6938-4e29-91d9-f3b5351c8d6e tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:36:17 user devstack@n-api.service[72090]: DEBUG nova.quota [None req-45ed5149-6938-4e29-91d9-f3b5351c8d6e tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] Getting quotas for project c7b9baa081ca455ea6931b7801c805b8. Resources: {'ram', 'instances', 'cores'} {{(pid=72090) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 19:36:17 user devstack@n-api.service[72090]: DEBUG nova.quota [None req-45ed5149-6938-4e29-91d9-f3b5351c8d6e tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] Getting quotas for user 68fcdcd3af164195bf0c7da3b8dfecb7 and project c7b9baa081ca455ea6931b7801c805b8. Resources: {'ram', 'instances', 'cores'} {{(pid=72090) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 19:36:17 user devstack@n-api.service[72090]: DEBUG nova.compute.api [None req-45ed5149-6938-4e29-91d9-f3b5351c8d6e tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] Going to run 1 instances... {{(pid=72090) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 11 19:36:17 user devstack@n-api.service[72090]: DEBUG nova.compute.api [None req-45ed5149-6938-4e29-91d9-f3b5351c8d6e tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] [instance: d42dc0ea-4631-44be-8b58-09877280ba2e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='199762db-3930-4f05-a4da-15dee19e5418',volume_size=None,volume_type=None)] {{(pid=72090) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 11 19:36:18 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [None req-45ed5149-6938-4e29-91d9-f3b5351c8d6e tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 0.739734 Apr 11 19:36:18 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 232/699] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 11 19:36:17 2023] POST /compute/v2.1/servers => generated 403 bytes in 749 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 11 19:36:18 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [None req-8718546a-905d-49cb-85c2-2b3f29c74d40 tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] Calling method '>' {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:36:18 user devstack@n-api.service[72089]: DEBUG nova.compute.api [None req-8718546a-905d-49cb-85c2-2b3f29c74d40 tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] [instance: d42dc0ea-4631-44be-8b58-09877280ba2e] Fetching instance by UUID {{(pid=72089) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:36:18 user devstack@n-api.service[72089]: DEBUG dbcounter [-] [72089] Writing DB stats nova_api:SELECT=1 {{(pid=72089) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:36:18 user devstack@n-api.service[72089]: DEBUG dbcounter [-] [72089] Writing DB stats nova_cell1:SELECT=5 {{(pid=72089) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:36:18 user devstack@n-api.service[72089]: DEBUG nova.policy [None req-8718546a-905d-49cb-85c2-2b3f29c74d40 tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68fcdcd3af164195bf0c7da3b8dfecb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7b9baa081ca455ea6931b7801c805b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72089) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:36:18 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [None req-8718546a-905d-49cb-85c2-2b3f29c74d40 tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d42dc0ea-4631-44be-8b58-09877280ba2e" status: 200 len: 1082 microversion: 2.1 time: 0.072970 Apr 11 19:36:18 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 240/700] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 19:36:18 2023] GET /compute/v2.1/servers/d42dc0ea-4631-44be-8b58-09877280ba2e => generated 1082 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:36:20 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [req-ca693ff8-6a26-43c9-aa92-bb490dc2502c req-65cc561c-2854-46fe-a3ac-c45035101093 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d42dc0ea-4631-44be-8b58-09877280ba2e", "tag": "fd43e974-64b6-4605-83cb-11b9cfe58341"}]} {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:36:20 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-ca693ff8-6a26-43c9-aa92-bb490dc2502c req-65cc561c-2854-46fe-a3ac-c45035101093 service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:36:20 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-ca693ff8-6a26-43c9-aa92-bb490dc2502c req-65cc561c-2854-46fe-a3ac-c45035101093 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:36:20 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-ca693ff8-6a26-43c9-aa92-bb490dc2502c req-65cc561c-2854-46fe-a3ac-c45035101093 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:36:20 user devstack@n-api.service[72088]: INFO nova.api.openstack.compute.server_external_events [req-ca693ff8-6a26-43c9-aa92-bb490dc2502c req-65cc561c-2854-46fe-a3ac-c45035101093 service nova] Creating event network-changed:fd43e974-64b6-4605-83cb-11b9cfe58341 for instance d42dc0ea-4631-44be-8b58-09877280ba2e on user Apr 11 19:36:20 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [req-ca693ff8-6a26-43c9-aa92-bb490dc2502c req-65cc561c-2854-46fe-a3ac-c45035101093 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041134 Apr 11 19:36:20 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 229/701] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:36:20 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:36:24 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [None req-185e1a18-5359-494a-b2ef-214fa45702fd tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "43a14b90-14ea-49ce-9e73-1c66a9cd8060"}} {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:36:24 user devstack@n-api.service[72090]: DEBUG nova.compute.api [None req-185e1a18-5359-494a-b2ef-214fa45702fd tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] [instance: 267c17c1-f0b6-4e18-8c18-5e5bbe8a2251] Fetching instance by UUID {{(pid=72090) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:36:24 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-185e1a18-5359-494a-b2ef-214fa45702fd tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:36:24 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-185e1a18-5359-494a-b2ef-214fa45702fd tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:36:24 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-185e1a18-5359-494a-b2ef-214fa45702fd tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:36:24 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-185e1a18-5359-494a-b2ef-214fa45702fd tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:36:24 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-185e1a18-5359-494a-b2ef-214fa45702fd tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:36:24 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-185e1a18-5359-494a-b2ef-214fa45702fd tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:36:24 user devstack@n-api.service[72090]: INFO nova.api.openstack.wsgi [None req-185e1a18-5359-494a-b2ef-214fa45702fd tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] HTTP exception thrown: Cannot 'attach_volume' instance 267c17c1-f0b6-4e18-8c18-5e5bbe8a2251 while it is in vm_state rescued Apr 11 19:36:24 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [None req-185e1a18-5359-494a-b2ef-214fa45702fd tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Request method failure captured: Apr 11 19:36:24 user devstack@n-api.service[72090]: request: POST /compute/v2.1/servers/267c17c1-f0b6-4e18-8c18-5e5bbe8a2251/os-volume_attachments HTTP/1.1 Apr 11 19:36:24 user devstack@n-api.service[72090]: Accept: application/json Apr 11 19:36:24 user devstack@n-api.service[72090]: Accept-Encoding: identity Apr 11 19:36:24 user devstack@n-api.service[72090]: Connection: close Apr 11 19:36:24 user devstack@n-api.service[72090]: Content-Length: 74 Apr 11 19:36:24 user devstack@n-api.service[72090]: Content-Type: application/json Apr 11 19:36:24 user devstack@n-api.service[72090]: Host: 10.0.0.210 Apr 11 19:36:24 user devstack@n-api.service[72090]: Openstack-System-Scope: None Apr 11 19:36:24 user devstack@n-api.service[72090]: User-Agent: python-urllib3/1.26.15 Apr 11 19:36:24 user devstack@n-api.service[72090]: X-Auth-Token: gAAAAABkNbUs3sGO0rC9Wf1HLL6y1zTXQ2xF2dMBaRGrgCkjSdBXMgDkz15sqaczXa_JcLLMjTSvFMatkt2Ta8S0VFlkGMqdbOYT7FNOzdcAgJLJI5j09-UAdp8WgiUM6SYPHBZLPS_ENQDMUXHUhrQJgHrsBuBOiq0wzxzQWDwcJRw-4wyoV9E Apr 11 19:36:24 user devstack@n-api.service[72090]: X-Domain-Id: None Apr 11 19:36:24 user devstack@n-api.service[72090]: X-Domain-Name: None Apr 11 19:36:24 user devstack@n-api.service[72090]: X-Identity-Status: Confirmed Apr 11 19:36:24 user devstack@n-api.service[72090]: X-Is-Admin-Project: True Apr 11 19:36:24 user devstack@n-api.service[72090]: X-Project-Domain-Id: default Apr 11 19:36:24 user devstack@n-api.service[72090]: X-Project-Domain-Name: Default Apr 11 19:36:24 user devstack@n-api.service[72090]: X-Project-Id: b8e3a291c54b49db8e12a88ba41865e3 Apr 11 19:36:24 user devstack@n-api.service[72090]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1429831687 Apr 11 19:36:24 user devstack@n-api.service[72090]: X-Role: reader,member Apr 11 19:36:24 user devstack@n-api.service[72090]: X-Roles: reader,member Apr 11 19:36:24 user devstack@n-api.service[72090]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b8e3a291c54b49db8e12a88ba41865e3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/b8e3a291c54b49db8e12a88ba41865e3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b8e3a291c54b49db8e12a88ba41865e3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 11 19:36:24 user devstack@n-api.service[72090]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1429831687 Apr 11 19:36:24 user devstack@n-api.service[72090]: X-Tenant-Id: b8e3a291c54b49db8e12a88ba41865e3 Apr 11 19:36:24 user devstack@n-api.service[72090]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1429831687 Apr 11 19:36:24 user devstack@n-api.service[72090]: X-User: tempest-ServerRescueNegativeTestJSON-1429831687-project-member Apr 11 19:36:24 user devstack@n-api.service[72090]: X-User-Domain-Id: default Apr 11 19:36:24 user devstack@n-api.service[72090]: X-User-Domain-Name: Default Apr 11 19:36:24 user devstack@n-api.service[72090]: X-User-Id: ba7f82b529e74d99838b6264b94d823b Apr 11 19:36:24 user devstack@n-api.service[72090]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1429831687-project-member Apr 11 19:36:24 user devstack@n-api.service[72090]: Apr 11 19:36:24 user devstack@n-api.service[72090]: {"volumeAttachment": {"volumeId": "43a14b90-14ea-49ce-9e73-1c66a9cd8060"}} Apr 11 19:36:24 user devstack@n-api.service[72090]: method: > Apr 11 19:36:24 user devstack@n-api.service[72090]: exception: Cannot 'attach_volume' instance 267c17c1-f0b6-4e18-8c18-5e5bbe8a2251 while it is in vm_state rescued Apr 11 19:36:24 user devstack@n-api.service[72090]: action_args: {'server_id': '267c17c1-f0b6-4e18-8c18-5e5bbe8a2251', 'body': {'volumeAttachment': {'volumeId': '43a14b90-14ea-49ce-9e73-1c66a9cd8060'}}} Apr 11 19:36:24 user devstack@n-api.service[72090]: {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 19:36:24 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:36:24 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Apr 11 19:36:24 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Apr 11 19:36:24 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Apr 11 19:36:24 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Apr 11 19:36:24 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Apr 11 19:36:24 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Apr 11 19:36:24 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 267c17c1-f0b6-4e18-8c18-5e5bbe8a2251 in vm_state rescued. Cannot attach_volume while the instance is in this state. Apr 11 19:36:24 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi Apr 11 19:36:24 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 19:36:24 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi Apr 11 19:36:24 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:36:24 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 19:36:24 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 19:36:24 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 19:36:24 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 19:36:24 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 19:36:24 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 19:36:24 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 11 19:36:24 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 11 19:36:24 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 11 19:36:24 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 11 19:36:24 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 11 19:36:24 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 11 19:36:24 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Apr 11 19:36:24 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Apr 11 19:36:24 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Apr 11 19:36:24 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Apr 11 19:36:24 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 267c17c1-f0b6-4e18-8c18-5e5bbe8a2251 while it is in vm_state rescued Apr 11 19:36:24 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi Apr 11 19:36:24 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 19:36:24 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi Apr 11 19:36:24 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:36:24 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 19:36:24 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 19:36:24 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 19:36:24 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 19:36:24 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 267c17c1-f0b6-4e18-8c18-5e5bbe8a2251 while it is in vm_state rescued Apr 11 19:36:24 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi Apr 11 19:36:24 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [None req-185e1a18-5359-494a-b2ef-214fa45702fd tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Returning 409 to user: Cannot 'attach_volume' instance 267c17c1-f0b6-4e18-8c18-5e5bbe8a2251 while it is in vm_state rescued {{(pid=72090) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 19:36:24 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [None req-185e1a18-5359-494a-b2ef-214fa45702fd tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] 10.0.0.210 "POST /compute/v2.1/servers/267c17c1-f0b6-4e18-8c18-5e5bbe8a2251/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.072867 Apr 11 19:36:24 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 233/702] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Apr 11 19:36:24 2023] POST /compute/v2.1/servers/267c17c1-f0b6-4e18-8c18-5e5bbe8a2251/os-volume_attachments => generated 152 bytes in 76 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Apr 11 19:36:24 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [None req-d75d7aa7-7bfb-4891-b2c2-226422bc7c06 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:36:24 user devstack@n-api.service[72089]: DEBUG nova.compute.api [None req-d75d7aa7-7bfb-4891-b2c2-226422bc7c06 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] [instance: 267c17c1-f0b6-4e18-8c18-5e5bbe8a2251] Fetching instance by UUID {{(pid=72089) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:36:24 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-d75d7aa7-7bfb-4891-b2c2-226422bc7c06 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:36:24 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-d75d7aa7-7bfb-4891-b2c2-226422bc7c06 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:36:24 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-d75d7aa7-7bfb-4891-b2c2-226422bc7c06 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:36:24 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-d75d7aa7-7bfb-4891-b2c2-226422bc7c06 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:36:24 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-d75d7aa7-7bfb-4891-b2c2-226422bc7c06 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:36:24 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-d75d7aa7-7bfb-4891-b2c2-226422bc7c06 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:36:24 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [None req-d75d7aa7-7bfb-4891-b2c2-226422bc7c06 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] 10.0.0.210 "POST /compute/v2.1/servers/267c17c1-f0b6-4e18-8c18-5e5bbe8a2251/action" status: 202 len: 0 microversion: 2.1 time: 0.083988 Apr 11 19:36:24 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 241/703] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Apr 11 19:36:24 2023] POST /compute/v2.1/servers/267c17c1-f0b6-4e18-8c18-5e5bbe8a2251/action => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 19:36:24 user devstack@n-api.service[72088]: DEBUG dbcounter [-] [72088] Writing DB stats nova_cell0:SELECT=4 {{(pid=72088) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:36:24 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [None req-fba36a3f-a4ff-4cfa-9f92-383658da9716 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Calling method '>' {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:36:24 user devstack@n-api.service[72088]: DEBUG nova.compute.api [None req-fba36a3f-a4ff-4cfa-9f92-383658da9716 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] [instance: 267c17c1-f0b6-4e18-8c18-5e5bbe8a2251] Fetching instance by UUID {{(pid=72088) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:36:24 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-fba36a3f-a4ff-4cfa-9f92-383658da9716 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:36:24 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-fba36a3f-a4ff-4cfa-9f92-383658da9716 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:36:24 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-fba36a3f-a4ff-4cfa-9f92-383658da9716 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:36:24 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-fba36a3f-a4ff-4cfa-9f92-383658da9716 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:36:24 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-fba36a3f-a4ff-4cfa-9f92-383658da9716 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:36:24 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-fba36a3f-a4ff-4cfa-9f92-383658da9716 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:36:24 user devstack@n-api.service[72088]: DEBUG nova.policy [None req-fba36a3f-a4ff-4cfa-9f92-383658da9716 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba7f82b529e74d99838b6264b94d823b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e3a291c54b49db8e12a88ba41865e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72088) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:36:24 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [None req-fba36a3f-a4ff-4cfa-9f92-383658da9716 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] 10.0.0.210 "GET /compute/v2.1/servers/267c17c1-f0b6-4e18-8c18-5e5bbe8a2251" status: 200 len: 1498 microversion: 2.1 time: 0.186531 Apr 11 19:36:24 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 230/704] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 19:36:24 2023] GET /compute/v2.1/servers/267c17c1-f0b6-4e18-8c18-5e5bbe8a2251 => generated 1498 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:36:24 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [None req-2614a1ea-f4e0-4aa5-9fa8-a8b4c5ee88ac tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Calling method '>' {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:36:24 user devstack@n-api.service[72090]: DEBUG nova.compute.api [None req-2614a1ea-f4e0-4aa5-9fa8-a8b4c5ee88ac tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] [instance: 647674d8-af53-405a-8116-4b7a01549bdf] Fetching instance by UUID {{(pid=72090) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:36:24 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-2614a1ea-f4e0-4aa5-9fa8-a8b4c5ee88ac tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:36:24 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-2614a1ea-f4e0-4aa5-9fa8-a8b4c5ee88ac tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:36:24 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-2614a1ea-f4e0-4aa5-9fa8-a8b4c5ee88ac tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:36:24 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-2614a1ea-f4e0-4aa5-9fa8-a8b4c5ee88ac tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:36:24 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-2614a1ea-f4e0-4aa5-9fa8-a8b4c5ee88ac tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:36:24 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-2614a1ea-f4e0-4aa5-9fa8-a8b4c5ee88ac tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:36:25 user devstack@n-api.service[72090]: DEBUG nova.policy [None req-2614a1ea-f4e0-4aa5-9fa8-a8b4c5ee88ac tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05fb551c320a48f98a4ec00a7f7492d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60a7381a31b84e97a068528f90813773', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72090) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:36:25 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [None req-2614a1ea-f4e0-4aa5-9fa8-a8b4c5ee88ac tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] 10.0.0.210 "GET /compute/v2.1/servers/647674d8-af53-405a-8116-4b7a01549bdf" status: 200 len: 1731 microversion: 2.1 time: 0.199254 Apr 11 19:36:25 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 234/705] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 19:36:24 2023] GET /compute/v2.1/servers/647674d8-af53-405a-8116-4b7a01549bdf => generated 1731 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:36:25 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [req-1e09c8f1-7fee-4e2c-a494-57b1497f2daf req-15e15403-6486-4aef-ad10-0db4944d0c20 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "267c17c1-f0b6-4e18-8c18-5e5bbe8a2251", "name": "network-vif-unplugged", "status": "completed", "tag": "06fea704-e356-4605-811e-aac91617290e"}]} {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:36:25 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-1e09c8f1-7fee-4e2c-a494-57b1497f2daf req-15e15403-6486-4aef-ad10-0db4944d0c20 service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:36:25 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-1e09c8f1-7fee-4e2c-a494-57b1497f2daf req-15e15403-6486-4aef-ad10-0db4944d0c20 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:36:25 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-1e09c8f1-7fee-4e2c-a494-57b1497f2daf req-15e15403-6486-4aef-ad10-0db4944d0c20 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:36:25 user devstack@n-api.service[72089]: INFO nova.api.openstack.compute.server_external_events [req-1e09c8f1-7fee-4e2c-a494-57b1497f2daf req-15e15403-6486-4aef-ad10-0db4944d0c20 service nova] Creating event network-vif-unplugged:06fea704-e356-4605-811e-aac91617290e for instance 267c17c1-f0b6-4e18-8c18-5e5bbe8a2251 on user Apr 11 19:36:25 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [req-1e09c8f1-7fee-4e2c-a494-57b1497f2daf req-15e15403-6486-4aef-ad10-0db4944d0c20 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.039164 Apr 11 19:36:25 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 242/706] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:36:25 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:36:27 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [req-42cfa043-3fbd-4382-891f-4535b3536797 req-13d8f5dd-3c6b-4917-975b-4be437bdddd4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "267c17c1-f0b6-4e18-8c18-5e5bbe8a2251", "name": "network-vif-plugged", "status": "completed", "tag": "06fea704-e356-4605-811e-aac91617290e"}]} {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:36:27 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-42cfa043-3fbd-4382-891f-4535b3536797 req-13d8f5dd-3c6b-4917-975b-4be437bdddd4 service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:36:27 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-42cfa043-3fbd-4382-891f-4535b3536797 req-13d8f5dd-3c6b-4917-975b-4be437bdddd4 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:36:27 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-42cfa043-3fbd-4382-891f-4535b3536797 req-13d8f5dd-3c6b-4917-975b-4be437bdddd4 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:36:27 user devstack@n-api.service[72088]: INFO nova.api.openstack.compute.server_external_events [req-42cfa043-3fbd-4382-891f-4535b3536797 req-13d8f5dd-3c6b-4917-975b-4be437bdddd4 service nova] Creating event network-vif-plugged:06fea704-e356-4605-811e-aac91617290e for instance 267c17c1-f0b6-4e18-8c18-5e5bbe8a2251 on user Apr 11 19:36:27 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [req-42cfa043-3fbd-4382-891f-4535b3536797 req-13d8f5dd-3c6b-4917-975b-4be437bdddd4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035052 Apr 11 19:36:27 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 231/707] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:36:27 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:36:28 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [req-ded759d4-c5ed-41a0-a9d2-842004beee63 req-b8946762-0852-4ded-a2f7-f7e7294c20fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d42dc0ea-4631-44be-8b58-09877280ba2e", "name": "network-vif-plugged", "status": "completed", "tag": "fd43e974-64b6-4605-83cb-11b9cfe58341"}]} {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:36:28 user devstack@n-api.service[72090]: DEBUG dbcounter [-] [72090] Writing DB stats nova_cell0:SELECT=2 {{(pid=72090) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:36:28 user devstack@n-api.service[72090]: DEBUG dbcounter [-] [72090] Writing DB stats nova_cell0:SELECT=6 {{(pid=72090) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:36:28 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-ded759d4-c5ed-41a0-a9d2-842004beee63 req-b8946762-0852-4ded-a2f7-f7e7294c20fb service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:36:28 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-ded759d4-c5ed-41a0-a9d2-842004beee63 req-b8946762-0852-4ded-a2f7-f7e7294c20fb service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:36:28 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-ded759d4-c5ed-41a0-a9d2-842004beee63 req-b8946762-0852-4ded-a2f7-f7e7294c20fb service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:36:28 user devstack@n-api.service[72090]: INFO nova.api.openstack.compute.server_external_events [req-ded759d4-c5ed-41a0-a9d2-842004beee63 req-b8946762-0852-4ded-a2f7-f7e7294c20fb service nova] Creating event network-vif-plugged:fd43e974-64b6-4605-83cb-11b9cfe58341 for instance d42dc0ea-4631-44be-8b58-09877280ba2e on user Apr 11 19:36:28 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [req-ded759d4-c5ed-41a0-a9d2-842004beee63 req-b8946762-0852-4ded-a2f7-f7e7294c20fb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040915 Apr 11 19:36:28 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 235/708] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:36:28 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:36:29 user devstack@n-api.service[72089]: DEBUG dbcounter [-] [72089] Writing DB stats nova_cell0:SELECT=2 {{(pid=72089) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:36:29 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [req-fd2427cc-9396-4636-9aa0-0aee3ecec588 req-b691f770-1c99-4d91-ad14-7c188673df0e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "267c17c1-f0b6-4e18-8c18-5e5bbe8a2251", "name": "network-vif-plugged", "status": "completed", "tag": "06fea704-e356-4605-811e-aac91617290e"}, {"server_uuid": "267c17c1-f0b6-4e18-8c18-5e5bbe8a2251", "name": "network-vif-plugged", "status": "completed", "tag": "06fea704-e356-4605-811e-aac91617290e"}]} {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:36:29 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-fd2427cc-9396-4636-9aa0-0aee3ecec588 req-b691f770-1c99-4d91-ad14-7c188673df0e service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:36:29 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-fd2427cc-9396-4636-9aa0-0aee3ecec588 req-b691f770-1c99-4d91-ad14-7c188673df0e service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:36:29 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-fd2427cc-9396-4636-9aa0-0aee3ecec588 req-b691f770-1c99-4d91-ad14-7c188673df0e service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:36:29 user devstack@n-api.service[72089]: INFO nova.api.openstack.compute.server_external_events [req-fd2427cc-9396-4636-9aa0-0aee3ecec588 req-b691f770-1c99-4d91-ad14-7c188673df0e service nova] Creating event network-vif-plugged:06fea704-e356-4605-811e-aac91617290e for instance 267c17c1-f0b6-4e18-8c18-5e5bbe8a2251 on user Apr 11 19:36:29 user devstack@n-api.service[72089]: INFO nova.api.openstack.compute.server_external_events [req-fd2427cc-9396-4636-9aa0-0aee3ecec588 req-b691f770-1c99-4d91-ad14-7c188673df0e service nova] Creating event network-vif-plugged:06fea704-e356-4605-811e-aac91617290e for instance 267c17c1-f0b6-4e18-8c18-5e5bbe8a2251 on user Apr 11 19:36:29 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [req-fd2427cc-9396-4636-9aa0-0aee3ecec588 req-b691f770-1c99-4d91-ad14-7c188673df0e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.036443 Apr 11 19:36:29 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 243/709] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:36:29 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:36:30 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [req-113eb924-c488-4b37-8100-ff90349059bf req-7c8e1cfd-7492-4133-922b-dd9a93e9a6ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d42dc0ea-4631-44be-8b58-09877280ba2e", "name": "network-vif-plugged", "status": "completed", "tag": "fd43e974-64b6-4605-83cb-11b9cfe58341"}]} {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:36:30 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-113eb924-c488-4b37-8100-ff90349059bf req-7c8e1cfd-7492-4133-922b-dd9a93e9a6ec service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:36:30 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-113eb924-c488-4b37-8100-ff90349059bf req-7c8e1cfd-7492-4133-922b-dd9a93e9a6ec service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:36:30 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-113eb924-c488-4b37-8100-ff90349059bf req-7c8e1cfd-7492-4133-922b-dd9a93e9a6ec service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:36:30 user devstack@n-api.service[72088]: INFO nova.api.openstack.compute.server_external_events [req-113eb924-c488-4b37-8100-ff90349059bf req-7c8e1cfd-7492-4133-922b-dd9a93e9a6ec service nova] Creating event network-vif-plugged:fd43e974-64b6-4605-83cb-11b9cfe58341 for instance d42dc0ea-4631-44be-8b58-09877280ba2e on user Apr 11 19:36:30 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [req-113eb924-c488-4b37-8100-ff90349059bf req-7c8e1cfd-7492-4133-922b-dd9a93e9a6ec service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038065 Apr 11 19:36:30 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 232/710] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:36:30 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:36:39 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [None req-2f577878-605b-450a-b8fd-94dd374d6217 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Calling method '>' {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:36:39 user devstack@n-api.service[72090]: DEBUG nova.compute.api [None req-2f577878-605b-450a-b8fd-94dd374d6217 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] [instance: fbfa0825-c7c2-4f04-8c9a-102e238c3816] Fetching instance by UUID {{(pid=72090) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:36:39 user devstack@n-api.service[72090]: DEBUG dbcounter [-] [72090] Writing DB stats nova_api:SELECT=21,nova_api:INSERT=3 {{(pid=72090) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:36:39 user devstack@n-api.service[72090]: DEBUG dbcounter [-] [72090] Writing DB stats nova_cell1:SELECT=14 {{(pid=72090) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:36:39 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-2f577878-605b-450a-b8fd-94dd374d6217 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:36:39 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-2f577878-605b-450a-b8fd-94dd374d6217 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:36:39 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-2f577878-605b-450a-b8fd-94dd374d6217 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:36:39 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-2f577878-605b-450a-b8fd-94dd374d6217 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:36:39 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-2f577878-605b-450a-b8fd-94dd374d6217 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:36:39 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-2f577878-605b-450a-b8fd-94dd374d6217 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:36:39 user devstack@n-api.service[72090]: DEBUG nova.policy [None req-2f577878-605b-450a-b8fd-94dd374d6217 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0558ba5a2b04d36ba2f2411090cc4e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d8b189667e34931aa36149620a036e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72090) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:36:39 user devstack@n-api.service[72090]: DEBUG nova.policy [None req-2f577878-605b-450a-b8fd-94dd374d6217 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0558ba5a2b04d36ba2f2411090cc4e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d8b189667e34931aa36149620a036e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72090) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:36:39 user devstack@n-api.service[72090]: DEBUG nova.policy [None req-2f577878-605b-450a-b8fd-94dd374d6217 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0558ba5a2b04d36ba2f2411090cc4e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d8b189667e34931aa36149620a036e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72090) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:36:39 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [None req-2f577878-605b-450a-b8fd-94dd374d6217 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fbfa0825-c7c2-4f04-8c9a-102e238c3816" status: 200 len: 1653 microversion: 2.20 time: 0.147532 Apr 11 19:36:39 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 236/711] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 19:36:39 2023] GET /compute/v2.1/servers/fbfa0825-c7c2-4f04-8c9a-102e238c3816 => generated 1653 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 19:36:45 user devstack@n-api.service[72089]: DEBUG dbcounter [-] [72089] Writing DB stats nova_api:SELECT=10 {{(pid=72089) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:36:45 user devstack@n-api.service[72089]: DEBUG dbcounter [-] [72089] Writing DB stats nova_cell1:SELECT=14,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=72089) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:36:45 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [None req-86c95be2-6458-486e-888b-7e9fe6a4fe91 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Calling method '>' {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:36:45 user devstack@n-api.service[72089]: DEBUG nova.compute.api [None req-86c95be2-6458-486e-888b-7e9fe6a4fe91 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] [instance: afc22926-012a-43fe-99e6-063294c593a6] Fetching instance by UUID {{(pid=72089) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:36:45 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-86c95be2-6458-486e-888b-7e9fe6a4fe91 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:36:45 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-86c95be2-6458-486e-888b-7e9fe6a4fe91 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:36:45 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-86c95be2-6458-486e-888b-7e9fe6a4fe91 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:36:45 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-86c95be2-6458-486e-888b-7e9fe6a4fe91 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:36:45 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-86c95be2-6458-486e-888b-7e9fe6a4fe91 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:36:45 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-86c95be2-6458-486e-888b-7e9fe6a4fe91 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:36:46 user devstack@n-api.service[72089]: DEBUG nova.policy [None req-86c95be2-6458-486e-888b-7e9fe6a4fe91 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf262cd03f4a41c4956d8784cf37d86d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caba0618fc743e7bfb2dd866a511df9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72089) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:36:46 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [None req-86c95be2-6458-486e-888b-7e9fe6a4fe91 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] 10.0.0.210 "GET /compute/v2.1/servers/afc22926-012a-43fe-99e6-063294c593a6" status: 200 len: 1391 microversion: 2.1 time: 0.235236 Apr 11 19:36:46 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 244/712] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 19:36:45 2023] GET /compute/v2.1/servers/afc22926-012a-43fe-99e6-063294c593a6 => generated 1391 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:36:46 user devstack@n-api.service[72088]: DEBUG dbcounter [-] [72088] Writing DB stats nova_api:SELECT=19,nova_api:INSERT=1 {{(pid=72088) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:36:46 user devstack@n-api.service[72088]: DEBUG dbcounter [-] [72088] Writing DB stats nova_cell1:SELECT=12 {{(pid=72088) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:36:46 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [None req-2cb1f87c-4d22-481f-ab25-f1600315cd76 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestVolumeBootPatternsnapshot-812039379"}} {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:36:46 user devstack@n-api.service[72088]: DEBUG nova.compute.api [None req-2cb1f87c-4d22-481f-ab25-f1600315cd76 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] [instance: afc22926-012a-43fe-99e6-063294c593a6] Fetching instance by UUID {{(pid=72088) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:36:46 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-2cb1f87c-4d22-481f-ab25-f1600315cd76 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:36:46 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-2cb1f87c-4d22-481f-ab25-f1600315cd76 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:36:46 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-2cb1f87c-4d22-481f-ab25-f1600315cd76 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:36:46 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-2cb1f87c-4d22-481f-ab25-f1600315cd76 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:36:46 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-2cb1f87c-4d22-481f-ab25-f1600315cd76 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:36:46 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-2cb1f87c-4d22-481f-ab25-f1600315cd76 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:36:46 user devstack@n-api.service[72088]: INFO nova.compute.api [None req-2cb1f87c-4d22-481f-ab25-f1600315cd76 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] [instance: afc22926-012a-43fe-99e6-063294c593a6] Attempting to quiesce instance before volume snapshot. Apr 11 19:36:46 user devstack@n-api.service[72088]: INFO nova.compute.api [None req-2cb1f87c-4d22-481f-ab25-f1600315cd76 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] [instance: afc22926-012a-43fe-99e6-063294c593a6] Skipping quiescing instance: QEMU guest agent is not enabled. Apr 11 19:36:46 user devstack@n-api.service[72088]: DEBUG nova.compute.api [None req-2cb1f87c-4d22-481f-ab25-f1600315cd76 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] [instance: afc22926-012a-43fe-99e6-063294c593a6] Creating snapshot from volume cfa96911-0869-4a41-97fe-ebf8f5bf1574. {{(pid=72088) snapshot_instance /opt/stack/nova/nova/compute/api.py:3511}} Apr 11 19:36:48 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [None req-2cb1f87c-4d22-481f-ab25-f1600315cd76 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] 10.0.0.210 "POST /compute/v2.1/servers/afc22926-012a-43fe-99e6-063294c593a6/action" status: 202 len: 0 microversion: 2.1 time: 2.705683 Apr 11 19:36:48 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 233/713] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Apr 11 19:36:46 2023] POST /compute/v2.1/servers/afc22926-012a-43fe-99e6-063294c593a6/action => generated 0 bytes in 2708 msecs (HTTP/1.1 202) 10 headers in 449 bytes (1 switches on core 0) Apr 11 19:36:49 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [None req-dadf7f3d-9500-4c57-b083-3d044c789acd tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-image-snapshot-server-783988854", "imageRef": "24fc25bd-3ef8-478b-87dc-434d48415b06", "flavorRef": "42", "networks": [{"uuid": "f22e45e9-cc15-401e-aed7-3506278d3d0d"}]}} {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:36:49 user devstack@n-api.service[72090]: DEBUG nova.network.neutron [None req-dadf7f3d-9500-4c57-b083-3d044c789acd tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] validate_networks() for [('f22e45e9-cc15-401e-aed7-3506278d3d0d', None, None, None, None, None)] {{(pid=72090) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 11 19:36:49 user devstack@n-api.service[72090]: DEBUG nova.virt.hardware [None req-dadf7f3d-9500-4c57-b083-3d044c789acd tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Flavor limits 0:0:0 {{(pid=72090) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 19:36:49 user devstack@n-api.service[72090]: DEBUG nova.virt.hardware [None req-dadf7f3d-9500-4c57-b083-3d044c789acd tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Image limits 0:0:0 {{(pid=72090) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 19:36:49 user devstack@n-api.service[72090]: DEBUG nova.virt.hardware [None req-dadf7f3d-9500-4c57-b083-3d044c789acd tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Flavor pref 0:0:0 {{(pid=72090) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 19:36:49 user devstack@n-api.service[72090]: DEBUG nova.virt.hardware [None req-dadf7f3d-9500-4c57-b083-3d044c789acd tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Image pref 0:0:0 {{(pid=72090) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 19:36:49 user devstack@n-api.service[72090]: DEBUG nova.virt.hardware [None req-dadf7f3d-9500-4c57-b083-3d044c789acd tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72090) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 19:36:49 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-dadf7f3d-9500-4c57-b083-3d044c789acd tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:36:49 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-dadf7f3d-9500-4c57-b083-3d044c789acd tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:36:49 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-dadf7f3d-9500-4c57-b083-3d044c789acd tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:36:49 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-dadf7f3d-9500-4c57-b083-3d044c789acd tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:36:49 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-dadf7f3d-9500-4c57-b083-3d044c789acd tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:36:49 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-dadf7f3d-9500-4c57-b083-3d044c789acd tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:36:49 user devstack@n-api.service[72090]: DEBUG nova.quota [None req-dadf7f3d-9500-4c57-b083-3d044c789acd tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Getting quotas for project 2caba0618fc743e7bfb2dd866a511df9. Resources: {'ram', 'instances', 'cores'} {{(pid=72090) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 19:36:49 user devstack@n-api.service[72090]: DEBUG nova.quota [None req-dadf7f3d-9500-4c57-b083-3d044c789acd tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Getting quotas for user cf262cd03f4a41c4956d8784cf37d86d and project 2caba0618fc743e7bfb2dd866a511df9. Resources: {'ram', 'instances', 'cores'} {{(pid=72090) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 19:36:49 user devstack@n-api.service[72090]: DEBUG nova.compute.api [None req-dadf7f3d-9500-4c57-b083-3d044c789acd tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Going to run 1 instances... {{(pid=72090) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 11 19:36:49 user devstack@n-api.service[72090]: DEBUG nova.compute.api [None req-dadf7f3d-9500-4c57-b083-3d044c789acd tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] [instance: 781f3398-3d54-49a4-a751-60f4fbc5e49a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name='/dev/vda',device_type='disk',disk_bus='virtio',encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='d2b5adf4-495d-4b98-b1eb-159c596e88b3',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=72090) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 11 19:36:49 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [None req-dadf7f3d-9500-4c57-b083-3d044c789acd tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.530354 Apr 11 19:36:49 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 237/714] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 11 19:36:49 2023] POST /compute/v2.1/servers => generated 378 bytes in 532 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 11 19:36:49 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [None req-3c30095d-89e5-4584-a93f-e1fa333e02bd tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Calling method '>' {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:36:49 user devstack@n-api.service[72089]: DEBUG nova.compute.api [None req-3c30095d-89e5-4584-a93f-e1fa333e02bd tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] [instance: 781f3398-3d54-49a4-a751-60f4fbc5e49a] Fetching instance by UUID {{(pid=72089) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:36:49 user devstack@n-api.service[72089]: DEBUG nova.policy [None req-3c30095d-89e5-4584-a93f-e1fa333e02bd tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf262cd03f4a41c4956d8784cf37d86d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caba0618fc743e7bfb2dd866a511df9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72089) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:36:49 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [None req-3c30095d-89e5-4584-a93f-e1fa333e02bd tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] 10.0.0.210 "GET /compute/v2.1/servers/781f3398-3d54-49a4-a751-60f4fbc5e49a" status: 200 len: 1223 microversion: 2.1 time: 0.060447 Apr 11 19:36:49 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 245/715] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 19:36:49 2023] GET /compute/v2.1/servers/781f3398-3d54-49a4-a751-60f4fbc5e49a => generated 1223 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:36:53 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [req-b3f93cd6-f08d-4ae5-82d6-963e5230c7ac req-ec3be134-9776-40e7-8091-032a58b23488 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "781f3398-3d54-49a4-a751-60f4fbc5e49a", "tag": "eb83845b-f94f-422d-9970-c00e62a4b142"}]} {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:36:53 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-b3f93cd6-f08d-4ae5-82d6-963e5230c7ac req-ec3be134-9776-40e7-8091-032a58b23488 service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:36:53 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-b3f93cd6-f08d-4ae5-82d6-963e5230c7ac req-ec3be134-9776-40e7-8091-032a58b23488 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:36:53 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-b3f93cd6-f08d-4ae5-82d6-963e5230c7ac req-ec3be134-9776-40e7-8091-032a58b23488 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:36:53 user devstack@n-api.service[72088]: INFO nova.api.openstack.compute.server_external_events [req-b3f93cd6-f08d-4ae5-82d6-963e5230c7ac req-ec3be134-9776-40e7-8091-032a58b23488 service nova] Creating event network-changed:eb83845b-f94f-422d-9970-c00e62a4b142 for instance 781f3398-3d54-49a4-a751-60f4fbc5e49a on user Apr 11 19:36:53 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [req-b3f93cd6-f08d-4ae5-82d6-963e5230c7ac req-ec3be134-9776-40e7-8091-032a58b23488 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039603 Apr 11 19:36:53 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 234/716] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:36:53 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:36:57 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [None req-7003a6b4-04d6-4ec6-ba6e-c1967c5f3bb5 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2af66735-f8a4-4b22-83ed-fc2180654d38", "device": "/dev/vdb"}} {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:36:57 user devstack@n-api.service[72090]: DEBUG nova.compute.api [None req-7003a6b4-04d6-4ec6-ba6e-c1967c5f3bb5 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] [instance: 5d000531-5884-405d-9e17-1dc5f39226d0] Fetching instance by UUID {{(pid=72090) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:36:57 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-7003a6b4-04d6-4ec6-ba6e-c1967c5f3bb5 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:36:57 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-7003a6b4-04d6-4ec6-ba6e-c1967c5f3bb5 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:36:57 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-7003a6b4-04d6-4ec6-ba6e-c1967c5f3bb5 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:36:57 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-7003a6b4-04d6-4ec6-ba6e-c1967c5f3bb5 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:36:57 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-7003a6b4-04d6-4ec6-ba6e-c1967c5f3bb5 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:36:57 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-7003a6b4-04d6-4ec6-ba6e-c1967c5f3bb5 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:36:58 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [None req-7003a6b4-04d6-4ec6-ba6e-c1967c5f3bb5 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] 10.0.0.210 "POST /compute/v2.1/servers/5d000531-5884-405d-9e17-1dc5f39226d0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.830125 Apr 11 19:36:58 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 238/717] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Apr 11 19:36:57 2023] POST /compute/v2.1/servers/5d000531-5884-405d-9e17-1dc5f39226d0/os-volume_attachments => generated 194 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 11 19:36:58 user devstack@n-api.service[72089]: DEBUG dbcounter [-] [72089] Writing DB stats nova_cell1:SELECT=6 {{(pid=72089) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:36:58 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [None req-f19b3d4c-453d-4471-90bf-19c983e4e608 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerBootFromVolumeStableRescueTest-server-2051818305", "imageRef": "4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b", "flavorRef": "42", "block_device_mapping_v2": [{"boot_index": "0", "source_type": "image", "volume_size": 1, "uuid": "4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b", "destination_type": "volume"}], "networks": [{"uuid": "eeacad54-05f6-4aba-aed7-13baddfb50e2"}]}} {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:36:58 user devstack@n-api.service[72089]: DEBUG nova.network.neutron [None req-f19b3d4c-453d-4471-90bf-19c983e4e608 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] validate_networks() for [('eeacad54-05f6-4aba-aed7-13baddfb50e2', None, None, None, None, None)] {{(pid=72089) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 11 19:36:59 user devstack@n-api.service[72089]: DEBUG nova.virt.hardware [None req-f19b3d4c-453d-4471-90bf-19c983e4e608 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Flavor limits 0:0:0 {{(pid=72089) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 19:36:59 user devstack@n-api.service[72089]: DEBUG nova.virt.hardware [None req-f19b3d4c-453d-4471-90bf-19c983e4e608 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Image limits 0:0:0 {{(pid=72089) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 19:36:59 user devstack@n-api.service[72089]: DEBUG nova.virt.hardware [None req-f19b3d4c-453d-4471-90bf-19c983e4e608 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Flavor pref 0:0:0 {{(pid=72089) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 19:36:59 user devstack@n-api.service[72089]: DEBUG nova.virt.hardware [None req-f19b3d4c-453d-4471-90bf-19c983e4e608 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Image pref 0:0:0 {{(pid=72089) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 19:36:59 user devstack@n-api.service[72089]: DEBUG nova.virt.hardware [None req-f19b3d4c-453d-4471-90bf-19c983e4e608 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72089) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 19:36:59 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-f19b3d4c-453d-4471-90bf-19c983e4e608 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:36:59 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-f19b3d4c-453d-4471-90bf-19c983e4e608 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:36:59 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-f19b3d4c-453d-4471-90bf-19c983e4e608 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:36:59 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-f19b3d4c-453d-4471-90bf-19c983e4e608 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:36:59 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-f19b3d4c-453d-4471-90bf-19c983e4e608 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:36:59 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-f19b3d4c-453d-4471-90bf-19c983e4e608 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:36:59 user devstack@n-api.service[72089]: DEBUG nova.quota [None req-f19b3d4c-453d-4471-90bf-19c983e4e608 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Getting quotas for project eb91586feb3f4a4c84fa8c2183baaf8c. Resources: {'ram', 'instances', 'cores'} {{(pid=72089) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 19:36:59 user devstack@n-api.service[72089]: DEBUG nova.quota [None req-f19b3d4c-453d-4471-90bf-19c983e4e608 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Getting quotas for user 1b3adca432b04d70818a51d1366f5c6d and project eb91586feb3f4a4c84fa8c2183baaf8c. Resources: {'ram', 'instances', 'cores'} {{(pid=72089) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 19:36:59 user devstack@n-api.service[72089]: DEBUG nova.compute.api [None req-f19b3d4c-453d-4471-90bf-19c983e4e608 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Going to run 1 instances... {{(pid=72089) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 11 19:36:59 user devstack@n-api.service[72089]: DEBUG nova.compute.api [None req-f19b3d4c-453d-4471-90bf-19c983e4e608 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] [instance: 8c45de50-92bc-467c-9f3d-7e667e1d0bb3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=72089) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 11 19:36:59 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [None req-f19b3d4c-453d-4471-90bf-19c983e4e608 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.87 time: 0.603248 Apr 11 19:36:59 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 246/718] 10.0.0.210 () {66 vars in 1265 bytes} [Tue Apr 11 19:36:58 2023] POST /compute/v2.1/servers => generated 378 bytes in 606 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 11 19:36:59 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [None req-7c2a12a8-17a7-4fd3-8339-6e2aa777f0b6 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Calling method '>' {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:36:59 user devstack@n-api.service[72088]: DEBUG nova.compute.api [None req-7c2a12a8-17a7-4fd3-8339-6e2aa777f0b6 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] [instance: 8c45de50-92bc-467c-9f3d-7e667e1d0bb3] Fetching instance by UUID {{(pid=72088) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:36:59 user devstack@n-api.service[72088]: DEBUG nova.policy [None req-7c2a12a8-17a7-4fd3-8339-6e2aa777f0b6 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b3adca432b04d70818a51d1366f5c6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb91586feb3f4a4c84fa8c2183baaf8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72088) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:36:59 user devstack@n-api.service[72088]: DEBUG nova.policy [None req-7c2a12a8-17a7-4fd3-8339-6e2aa777f0b6 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b3adca432b04d70818a51d1366f5c6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb91586feb3f4a4c84fa8c2183baaf8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72088) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:36:59 user devstack@n-api.service[72088]: DEBUG nova.policy [None req-7c2a12a8-17a7-4fd3-8339-6e2aa777f0b6 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b3adca432b04d70818a51d1366f5c6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb91586feb3f4a4c84fa8c2183baaf8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72088) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:36:59 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [None req-7c2a12a8-17a7-4fd3-8339-6e2aa777f0b6 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8c45de50-92bc-467c-9f3d-7e667e1d0bb3" status: 200 len: 1395 microversion: 2.87 time: 0.105501 Apr 11 19:36:59 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 235/719] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 19:36:59 2023] GET /compute/v2.1/servers/8c45de50-92bc-467c-9f3d-7e667e1d0bb3 => generated 1395 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 19:36:59 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [None req-8a855d7f-79c5-4b2c-8ae2-8b1564b9282a tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Calling method '>' {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:36:59 user devstack@n-api.service[72090]: DEBUG nova.compute.api [None req-8a855d7f-79c5-4b2c-8ae2-8b1564b9282a tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] [instance: bd559e67-3c8f-42b4-b1d6-fd171c8850b8] Fetching instance by UUID {{(pid=72090) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:36:59 user devstack@n-api.service[72090]: DEBUG dbcounter [-] [72090] Writing DB stats nova_cell0:SELECT=2 {{(pid=72090) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:36:59 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-8a855d7f-79c5-4b2c-8ae2-8b1564b9282a tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:36:59 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-8a855d7f-79c5-4b2c-8ae2-8b1564b9282a tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:36:59 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-8a855d7f-79c5-4b2c-8ae2-8b1564b9282a tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:36:59 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-8a855d7f-79c5-4b2c-8ae2-8b1564b9282a tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:36:59 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-8a855d7f-79c5-4b2c-8ae2-8b1564b9282a tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:36:59 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-8a855d7f-79c5-4b2c-8ae2-8b1564b9282a tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:36:59 user devstack@n-api.service[72090]: DEBUG dbcounter [-] [72090] Writing DB stats nova_cell0:SELECT=6 {{(pid=72090) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:36:59 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [None req-8a855d7f-79c5-4b2c-8ae2-8b1564b9282a tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bd559e67-3c8f-42b4-b1d6-fd171c8850b8/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.107408 Apr 11 19:36:59 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 239/720] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Apr 11 19:36:59 2023] GET /compute/v2.1/servers/bd559e67-3c8f-42b4-b1d6-fd171c8850b8/os-interface => generated 283 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 11 19:37:00 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [req-f6cd2c13-2a12-44bd-b083-8c85f25808c9 req-ddc7b39e-069b-4408-8861-6a595335672a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bd559e67-3c8f-42b4-b1d6-fd171c8850b8", "tag": "ed9fd5c5-52fb-4d71-9ba0-911eaa1a92a2"}]} {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:37:00 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-f6cd2c13-2a12-44bd-b083-8c85f25808c9 req-ddc7b39e-069b-4408-8861-6a595335672a service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:37:00 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-f6cd2c13-2a12-44bd-b083-8c85f25808c9 req-ddc7b39e-069b-4408-8861-6a595335672a service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:37:00 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-f6cd2c13-2a12-44bd-b083-8c85f25808c9 req-ddc7b39e-069b-4408-8861-6a595335672a service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:37:00 user devstack@n-api.service[72089]: INFO nova.api.openstack.compute.server_external_events [req-f6cd2c13-2a12-44bd-b083-8c85f25808c9 req-ddc7b39e-069b-4408-8861-6a595335672a service nova] Creating event network-changed:ed9fd5c5-52fb-4d71-9ba0-911eaa1a92a2 for instance bd559e67-3c8f-42b4-b1d6-fd171c8850b8 on user Apr 11 19:37:00 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [req-f6cd2c13-2a12-44bd-b083-8c85f25808c9 req-ddc7b39e-069b-4408-8861-6a595335672a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044209 Apr 11 19:37:00 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 247/721] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:37:00 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:37:00 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [None req-11711c57-7fea-46b0-a0e5-8951b1302458 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Calling method '>' {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:37:00 user devstack@n-api.service[72088]: DEBUG nova.compute.api [None req-11711c57-7fea-46b0-a0e5-8951b1302458 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] [instance: bd559e67-3c8f-42b4-b1d6-fd171c8850b8] Fetching instance by UUID {{(pid=72088) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:37:00 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-11711c57-7fea-46b0-a0e5-8951b1302458 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:37:00 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-11711c57-7fea-46b0-a0e5-8951b1302458 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:37:00 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-11711c57-7fea-46b0-a0e5-8951b1302458 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:37:00 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-11711c57-7fea-46b0-a0e5-8951b1302458 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:37:00 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-11711c57-7fea-46b0-a0e5-8951b1302458 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:37:00 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-11711c57-7fea-46b0-a0e5-8951b1302458 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:37:00 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [None req-11711c57-7fea-46b0-a0e5-8951b1302458 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bd559e67-3c8f-42b4-b1d6-fd171c8850b8/ips" status: 200 len: 105 microversion: 2.1 time: 0.036786 Apr 11 19:37:00 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 236/722] 10.0.0.210 () {62 vars in 1325 bytes} [Tue Apr 11 19:37:00 2023] GET /compute/v2.1/servers/bd559e67-3c8f-42b4-b1d6-fd171c8850b8/ips => generated 105 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:37:02 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [req-224ece6b-d6e2-4a86-84fd-4449a1cf9cbc req-e63c0700-11ad-45b5-8150-e31be7126e15 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8c45de50-92bc-467c-9f3d-7e667e1d0bb3", "tag": "82ee2878-c477-419c-97ba-9ac4b36dacab"}]} {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:37:02 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-224ece6b-d6e2-4a86-84fd-4449a1cf9cbc req-e63c0700-11ad-45b5-8150-e31be7126e15 service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:37:02 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-224ece6b-d6e2-4a86-84fd-4449a1cf9cbc req-e63c0700-11ad-45b5-8150-e31be7126e15 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:37:02 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-224ece6b-d6e2-4a86-84fd-4449a1cf9cbc req-e63c0700-11ad-45b5-8150-e31be7126e15 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:37:02 user devstack@n-api.service[72090]: INFO nova.api.openstack.compute.server_external_events [req-224ece6b-d6e2-4a86-84fd-4449a1cf9cbc req-e63c0700-11ad-45b5-8150-e31be7126e15 service nova] Creating event network-changed:82ee2878-c477-419c-97ba-9ac4b36dacab for instance 8c45de50-92bc-467c-9f3d-7e667e1d0bb3 on user Apr 11 19:37:02 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [req-224ece6b-d6e2-4a86-84fd-4449a1cf9cbc req-e63c0700-11ad-45b5-8150-e31be7126e15 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057261 Apr 11 19:37:02 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 240/723] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:37:02 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 11 19:37:02 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [None req-a8fcba03-4178-4eff-978d-71bcf69ba87d tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cb101440-f092-4818-b8ef-1e2da8c26cfa"}} {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:37:02 user devstack@n-api.service[72089]: DEBUG nova.compute.api [None req-a8fcba03-4178-4eff-978d-71bcf69ba87d tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] [instance: bd559e67-3c8f-42b4-b1d6-fd171c8850b8] Fetching instance by UUID {{(pid=72089) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:37:02 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-a8fcba03-4178-4eff-978d-71bcf69ba87d tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:37:02 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-a8fcba03-4178-4eff-978d-71bcf69ba87d tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:37:02 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-a8fcba03-4178-4eff-978d-71bcf69ba87d tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:37:02 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-a8fcba03-4178-4eff-978d-71bcf69ba87d tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:37:02 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-a8fcba03-4178-4eff-978d-71bcf69ba87d tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:37:02 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-a8fcba03-4178-4eff-978d-71bcf69ba87d tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:37:02 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [None req-a8fcba03-4178-4eff-978d-71bcf69ba87d tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] 10.0.0.210 "POST /compute/v2.1/servers/bd559e67-3c8f-42b4-b1d6-fd171c8850b8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.422800 Apr 11 19:37:02 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 248/724] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Apr 11 19:37:02 2023] POST /compute/v2.1/servers/bd559e67-3c8f-42b4-b1d6-fd171c8850b8/os-volume_attachments => generated 194 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:37:05 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [req-34a3c057-1b4c-47bc-afcb-68816d0820c7 req-632ae860-8f38-41ac-9e5b-e1256541df21 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "781f3398-3d54-49a4-a751-60f4fbc5e49a", "name": "network-vif-plugged", "status": "completed", "tag": "eb83845b-f94f-422d-9970-c00e62a4b142"}]} {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:37:05 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-34a3c057-1b4c-47bc-afcb-68816d0820c7 req-632ae860-8f38-41ac-9e5b-e1256541df21 service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:37:05 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-34a3c057-1b4c-47bc-afcb-68816d0820c7 req-632ae860-8f38-41ac-9e5b-e1256541df21 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:37:05 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-34a3c057-1b4c-47bc-afcb-68816d0820c7 req-632ae860-8f38-41ac-9e5b-e1256541df21 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:37:05 user devstack@n-api.service[72088]: INFO nova.api.openstack.compute.server_external_events [req-34a3c057-1b4c-47bc-afcb-68816d0820c7 req-632ae860-8f38-41ac-9e5b-e1256541df21 service nova] Creating event network-vif-plugged:eb83845b-f94f-422d-9970-c00e62a4b142 for instance 781f3398-3d54-49a4-a751-60f4fbc5e49a on user Apr 11 19:37:05 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [req-34a3c057-1b4c-47bc-afcb-68816d0820c7 req-632ae860-8f38-41ac-9e5b-e1256541df21 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048294 Apr 11 19:37:05 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 237/725] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:37:05 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:37:07 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [req-67c179b7-5729-4595-9cb0-3b1ff2099077 req-db3fb144-8229-47e0-bfc5-5292c5f4e866 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "781f3398-3d54-49a4-a751-60f4fbc5e49a", "name": "network-vif-plugged", "status": "completed", "tag": "eb83845b-f94f-422d-9970-c00e62a4b142"}]} {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:37:07 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-67c179b7-5729-4595-9cb0-3b1ff2099077 req-db3fb144-8229-47e0-bfc5-5292c5f4e866 service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:37:07 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-67c179b7-5729-4595-9cb0-3b1ff2099077 req-db3fb144-8229-47e0-bfc5-5292c5f4e866 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:37:07 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-67c179b7-5729-4595-9cb0-3b1ff2099077 req-db3fb144-8229-47e0-bfc5-5292c5f4e866 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:37:07 user devstack@n-api.service[72090]: INFO nova.api.openstack.compute.server_external_events [req-67c179b7-5729-4595-9cb0-3b1ff2099077 req-db3fb144-8229-47e0-bfc5-5292c5f4e866 service nova] Creating event network-vif-plugged:eb83845b-f94f-422d-9970-c00e62a4b142 for instance 781f3398-3d54-49a4-a751-60f4fbc5e49a on user Apr 11 19:37:07 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [req-67c179b7-5729-4595-9cb0-3b1ff2099077 req-db3fb144-8229-47e0-bfc5-5292c5f4e866 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031646 Apr 11 19:37:07 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 241/726] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:37:07 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:37:08 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [None req-2fce5384-1e13-46dd-9d50-ee61aeaeafe2 tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] Calling method '>' {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:37:08 user devstack@n-api.service[72089]: DEBUG nova.compute.api [None req-2fce5384-1e13-46dd-9d50-ee61aeaeafe2 tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] [instance: d42dc0ea-4631-44be-8b58-09877280ba2e] Fetching instance by UUID {{(pid=72089) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:37:08 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-2fce5384-1e13-46dd-9d50-ee61aeaeafe2 tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:37:08 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-2fce5384-1e13-46dd-9d50-ee61aeaeafe2 tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:37:08 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-2fce5384-1e13-46dd-9d50-ee61aeaeafe2 tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:37:08 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-2fce5384-1e13-46dd-9d50-ee61aeaeafe2 tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:37:08 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-2fce5384-1e13-46dd-9d50-ee61aeaeafe2 tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:37:08 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-2fce5384-1e13-46dd-9d50-ee61aeaeafe2 tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:37:08 user devstack@n-api.service[72089]: DEBUG nova.policy [None req-2fce5384-1e13-46dd-9d50-ee61aeaeafe2 tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68fcdcd3af164195bf0c7da3b8dfecb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7b9baa081ca455ea6931b7801c805b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72089) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:37:08 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [None req-2fce5384-1e13-46dd-9d50-ee61aeaeafe2 tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d42dc0ea-4631-44be-8b58-09877280ba2e" status: 200 len: 1431 microversion: 2.1 time: 0.197501 Apr 11 19:37:08 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 249/727] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 19:37:08 2023] GET /compute/v2.1/servers/d42dc0ea-4631-44be-8b58-09877280ba2e => generated 1431 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:37:10 user devstack@n-api.service[72088]: DEBUG dbcounter [-] [72088] Writing DB stats nova_cell0:SELECT=2 {{(pid=72088) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:37:10 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [None req-225c7fa5-d20b-47e7-a694-9f3b7a582b1d tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Calling method '>' {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:37:10 user devstack@n-api.service[72088]: DEBUG nova.compute.api [None req-225c7fa5-d20b-47e7-a694-9f3b7a582b1d tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] [instance: bd559e67-3c8f-42b4-b1d6-fd171c8850b8] Fetching instance by UUID {{(pid=72088) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:37:10 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-225c7fa5-d20b-47e7-a694-9f3b7a582b1d tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:37:10 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-225c7fa5-d20b-47e7-a694-9f3b7a582b1d tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:37:10 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-225c7fa5-d20b-47e7-a694-9f3b7a582b1d tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:37:10 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-225c7fa5-d20b-47e7-a694-9f3b7a582b1d tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:37:10 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-225c7fa5-d20b-47e7-a694-9f3b7a582b1d tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:37:10 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-225c7fa5-d20b-47e7-a694-9f3b7a582b1d tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:37:10 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [None req-225c7fa5-d20b-47e7-a694-9f3b7a582b1d tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bd559e67-3c8f-42b4-b1d6-fd171c8850b8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057869 Apr 11 19:37:10 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 238/728] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Apr 11 19:37:10 2023] GET /compute/v2.1/servers/bd559e67-3c8f-42b4-b1d6-fd171c8850b8/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:37:10 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [None req-1cc222b0-8586-41d4-ac97-0c4b0d5368b0 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Calling method '>' {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:37:10 user devstack@n-api.service[72090]: DEBUG nova.compute.api [None req-1cc222b0-8586-41d4-ac97-0c4b0d5368b0 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] [instance: bd559e67-3c8f-42b4-b1d6-fd171c8850b8] Fetching instance by UUID {{(pid=72090) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:37:10 user devstack@n-api.service[72090]: DEBUG dbcounter [-] [72090] Writing DB stats nova_api:SELECT=24,nova_api:INSERT=3 {{(pid=72090) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:37:10 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-1cc222b0-8586-41d4-ac97-0c4b0d5368b0 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:37:10 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-1cc222b0-8586-41d4-ac97-0c4b0d5368b0 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:37:10 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-1cc222b0-8586-41d4-ac97-0c4b0d5368b0 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:37:10 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-1cc222b0-8586-41d4-ac97-0c4b0d5368b0 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:37:10 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-1cc222b0-8586-41d4-ac97-0c4b0d5368b0 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:37:10 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-1cc222b0-8586-41d4-ac97-0c4b0d5368b0 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:37:10 user devstack@n-api.service[72090]: DEBUG dbcounter [-] [72090] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=72090) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:37:10 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [None req-1cc222b0-8586-41d4-ac97-0c4b0d5368b0 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bd559e67-3c8f-42b4-b1d6-fd171c8850b8/os-volume_attachments/cb101440-f092-4818-b8ef-1e2da8c26cfa" status: 200 len: 194 microversion: 2.1 time: 0.094997 Apr 11 19:37:10 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 242/729] 10.0.0.210 () {62 vars in 1490 bytes} [Tue Apr 11 19:37:10 2023] GET /compute/v2.1/servers/bd559e67-3c8f-42b4-b1d6-fd171c8850b8/os-volume_attachments/cb101440-f092-4818-b8ef-1e2da8c26cfa => generated 194 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 11 19:37:12 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [None req-bd441262-8ff7-405c-b75b-5a7da5f1f22a tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fe7d53f9-3e55-493f-937b-b8bb59c63939"}} {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:37:12 user devstack@n-api.service[72089]: DEBUG nova.compute.api [None req-bd441262-8ff7-405c-b75b-5a7da5f1f22a tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] [instance: bd559e67-3c8f-42b4-b1d6-fd171c8850b8] Fetching instance by UUID {{(pid=72089) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:37:12 user devstack@n-api.service[72089]: DEBUG dbcounter [-] [72089] Writing DB stats nova_cell0:SELECT=2 {{(pid=72089) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:37:12 user devstack@n-api.service[72089]: DEBUG dbcounter [-] [72089] Writing DB stats nova_cell0:SELECT=8 {{(pid=72089) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:37:12 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-bd441262-8ff7-405c-b75b-5a7da5f1f22a tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:37:12 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-bd441262-8ff7-405c-b75b-5a7da5f1f22a tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:37:12 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-bd441262-8ff7-405c-b75b-5a7da5f1f22a tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:37:12 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-bd441262-8ff7-405c-b75b-5a7da5f1f22a tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:37:12 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-bd441262-8ff7-405c-b75b-5a7da5f1f22a tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:37:12 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-bd441262-8ff7-405c-b75b-5a7da5f1f22a tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:37:12 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [None req-bd441262-8ff7-405c-b75b-5a7da5f1f22a tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] 10.0.0.210 "POST /compute/v2.1/servers/bd559e67-3c8f-42b4-b1d6-fd171c8850b8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.334858 Apr 11 19:37:12 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 250/730] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Apr 11 19:37:12 2023] POST /compute/v2.1/servers/bd559e67-3c8f-42b4-b1d6-fd171c8850b8/os-volume_attachments => generated 194 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:37:14 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [None req-49b7ec38-70ac-4fba-879d-0f056b3bd7be tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Calling method '>' {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:37:14 user devstack@n-api.service[72088]: DEBUG nova.compute.api [None req-49b7ec38-70ac-4fba-879d-0f056b3bd7be tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] [instance: 267c17c1-f0b6-4e18-8c18-5e5bbe8a2251] Fetching instance by UUID {{(pid=72088) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:37:14 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-49b7ec38-70ac-4fba-879d-0f056b3bd7be tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:37:14 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-49b7ec38-70ac-4fba-879d-0f056b3bd7be tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:37:14 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-49b7ec38-70ac-4fba-879d-0f056b3bd7be tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:37:14 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-49b7ec38-70ac-4fba-879d-0f056b3bd7be tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:37:14 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-49b7ec38-70ac-4fba-879d-0f056b3bd7be tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:37:14 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-49b7ec38-70ac-4fba-879d-0f056b3bd7be tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:37:14 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [req-3edf95c9-8f83-49c5-8198-171d040e8546 req-afbc0929-0d1d-42d2-aad8-a790a40dcf46 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c45de50-92bc-467c-9f3d-7e667e1d0bb3", "name": "network-vif-plugged", "status": "completed", "tag": "82ee2878-c477-419c-97ba-9ac4b36dacab"}]} {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:37:14 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-3edf95c9-8f83-49c5-8198-171d040e8546 req-afbc0929-0d1d-42d2-aad8-a790a40dcf46 service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:37:14 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-3edf95c9-8f83-49c5-8198-171d040e8546 req-afbc0929-0d1d-42d2-aad8-a790a40dcf46 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:37:14 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-3edf95c9-8f83-49c5-8198-171d040e8546 req-afbc0929-0d1d-42d2-aad8-a790a40dcf46 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:37:14 user devstack@n-api.service[72088]: DEBUG nova.policy [None req-49b7ec38-70ac-4fba-879d-0f056b3bd7be tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba7f82b529e74d99838b6264b94d823b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e3a291c54b49db8e12a88ba41865e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72088) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:37:14 user devstack@n-api.service[72090]: INFO nova.api.openstack.compute.server_external_events [req-3edf95c9-8f83-49c5-8198-171d040e8546 req-afbc0929-0d1d-42d2-aad8-a790a40dcf46 service nova] Creating event network-vif-plugged:82ee2878-c477-419c-97ba-9ac4b36dacab for instance 8c45de50-92bc-467c-9f3d-7e667e1d0bb3 on user Apr 11 19:37:14 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [req-3edf95c9-8f83-49c5-8198-171d040e8546 req-afbc0929-0d1d-42d2-aad8-a790a40dcf46 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095962 Apr 11 19:37:14 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [None req-49b7ec38-70ac-4fba-879d-0f056b3bd7be tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] 10.0.0.210 "GET /compute/v2.1/servers/267c17c1-f0b6-4e18-8c18-5e5bbe8a2251" status: 200 len: 1504 microversion: 2.1 time: 0.182008 Apr 11 19:37:14 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 243/731] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:37:14 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:37:14 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 239/732] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 19:37:14 2023] GET /compute/v2.1/servers/267c17c1-f0b6-4e18-8c18-5e5bbe8a2251 => generated 1504 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:37:16 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [req-30f81514-8b83-40b3-aa33-39cb3a5f064b req-3b67193a-b48c-473f-bc41-b87476acd1f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c45de50-92bc-467c-9f3d-7e667e1d0bb3", "name": "network-vif-plugged", "status": "completed", "tag": "82ee2878-c477-419c-97ba-9ac4b36dacab"}]} {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:37:16 user devstack@n-api.service[72089]: DEBUG dbcounter [-] [72089] Writing DB stats nova_api:SELECT=28,nova_api:INSERT=3 {{(pid=72089) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:37:16 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-30f81514-8b83-40b3-aa33-39cb3a5f064b req-3b67193a-b48c-473f-bc41-b87476acd1f3 service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:37:16 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-30f81514-8b83-40b3-aa33-39cb3a5f064b req-3b67193a-b48c-473f-bc41-b87476acd1f3 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:37:16 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-30f81514-8b83-40b3-aa33-39cb3a5f064b req-3b67193a-b48c-473f-bc41-b87476acd1f3 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:37:16 user devstack@n-api.service[72089]: INFO nova.api.openstack.compute.server_external_events [req-30f81514-8b83-40b3-aa33-39cb3a5f064b req-3b67193a-b48c-473f-bc41-b87476acd1f3 service nova] Creating event network-vif-plugged:82ee2878-c477-419c-97ba-9ac4b36dacab for instance 8c45de50-92bc-467c-9f3d-7e667e1d0bb3 on user Apr 11 19:37:16 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [req-30f81514-8b83-40b3-aa33-39cb3a5f064b req-3b67193a-b48c-473f-bc41-b87476acd1f3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037670 Apr 11 19:37:16 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 251/733] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:37:16 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:37:18 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [None req-b185af67-f8d1-4011-bcc9-1db324631473 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Calling method '>' {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:37:18 user devstack@n-api.service[72090]: DEBUG nova.compute.api [None req-b185af67-f8d1-4011-bcc9-1db324631473 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] [instance: 5d000531-5884-405d-9e17-1dc5f39226d0] Fetching instance by UUID {{(pid=72090) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:37:18 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-b185af67-f8d1-4011-bcc9-1db324631473 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:37:18 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-b185af67-f8d1-4011-bcc9-1db324631473 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:37:18 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-b185af67-f8d1-4011-bcc9-1db324631473 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:37:18 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-b185af67-f8d1-4011-bcc9-1db324631473 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:37:18 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-b185af67-f8d1-4011-bcc9-1db324631473 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:37:18 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-b185af67-f8d1-4011-bcc9-1db324631473 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:37:18 user devstack@n-api.service[72090]: DEBUG nova.objects.instance [None req-b185af67-f8d1-4011-bcc9-1db324631473 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Lazy-loading 'services' on Instance uuid 5d000531-5884-405d-9e17-1dc5f39226d0 {{(pid=72090) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 11 19:37:18 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [None req-b185af67-f8d1-4011-bcc9-1db324631473 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/5d000531-5884-405d-9e17-1dc5f39226d0/os-volume_attachments/2af66735-f8a4-4b22-83ed-fc2180654d38" status: 202 len: 0 microversion: 2.1 time: 0.230516 Apr 11 19:37:18 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 244/734] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Apr 11 19:37:18 2023] DELETE /compute/v2.1/servers/5d000531-5884-405d-9e17-1dc5f39226d0/os-volume_attachments/2af66735-f8a4-4b22-83ed-fc2180654d38 => generated 0 bytes in 233 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 11 19:37:18 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [None req-8d705088-6ab9-42b3-a1d0-20157a0dff1c tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Calling method '>' {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:37:18 user devstack@n-api.service[72088]: DEBUG nova.compute.api [None req-8d705088-6ab9-42b3-a1d0-20157a0dff1c tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] [instance: 5d000531-5884-405d-9e17-1dc5f39226d0] Fetching instance by UUID {{(pid=72088) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:37:18 user devstack@n-api.service[72088]: DEBUG dbcounter [-] [72088] Writing DB stats nova_api:SELECT=19 {{(pid=72088) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:37:18 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-8d705088-6ab9-42b3-a1d0-20157a0dff1c tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:37:18 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-8d705088-6ab9-42b3-a1d0-20157a0dff1c tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:37:18 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-8d705088-6ab9-42b3-a1d0-20157a0dff1c tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:37:18 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-8d705088-6ab9-42b3-a1d0-20157a0dff1c tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:37:18 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-8d705088-6ab9-42b3-a1d0-20157a0dff1c tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:37:18 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-8d705088-6ab9-42b3-a1d0-20157a0dff1c tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:37:18 user devstack@n-api.service[72088]: DEBUG dbcounter [-] [72088] Writing DB stats nova_cell1:SELECT=35,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=72088) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:37:18 user devstack@n-api.service[72088]: DEBUG nova.compute.api [None req-8d705088-6ab9-42b3-a1d0-20157a0dff1c tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] [instance: 5d000531-5884-405d-9e17-1dc5f39226d0] Going to try to terminate instance {{(pid=72088) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 11 19:37:18 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [None req-8d705088-6ab9-42b3-a1d0-20157a0dff1c tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/5d000531-5884-405d-9e17-1dc5f39226d0" status: 204 len: 0 microversion: 2.1 time: 0.134984 Apr 11 19:37:18 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 240/735] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 19:37:18 2023] DELETE /compute/v2.1/servers/5d000531-5884-405d-9e17-1dc5f39226d0 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 11 19:37:18 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [None req-a945ba44-fc12-4eec-a46f-dfbaaa9f80ca tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Calling method '>' {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:37:18 user devstack@n-api.service[72089]: DEBUG nova.compute.api [None req-a945ba44-fc12-4eec-a46f-dfbaaa9f80ca tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] [instance: 5d000531-5884-405d-9e17-1dc5f39226d0] Fetching instance by UUID {{(pid=72089) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:37:18 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-a945ba44-fc12-4eec-a46f-dfbaaa9f80ca tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:37:18 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-a945ba44-fc12-4eec-a46f-dfbaaa9f80ca tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:37:18 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-a945ba44-fc12-4eec-a46f-dfbaaa9f80ca tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:37:18 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-a945ba44-fc12-4eec-a46f-dfbaaa9f80ca tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:37:18 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-a945ba44-fc12-4eec-a46f-dfbaaa9f80ca tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:37:18 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-a945ba44-fc12-4eec-a46f-dfbaaa9f80ca tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:37:19 user devstack@n-api.service[72089]: DEBUG nova.policy [None req-a945ba44-fc12-4eec-a46f-dfbaaa9f80ca tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20f337feb0ed4653976ace530bfdd877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d5246cf04a7401388cba38d16e298ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72089) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:37:19 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [None req-a945ba44-fc12-4eec-a46f-dfbaaa9f80ca tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5d000531-5884-405d-9e17-1dc5f39226d0" status: 200 len: 1546 microversion: 2.1 time: 0.169470 Apr 11 19:37:19 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 252/736] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 19:37:18 2023] GET /compute/v2.1/servers/5d000531-5884-405d-9e17-1dc5f39226d0 => generated 1546 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:37:20 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [None req-ab82dbe3-199b-4144-87f1-915ad9ad5e9d tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Calling method '>' {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:37:20 user devstack@n-api.service[72090]: DEBUG nova.compute.api [None req-ab82dbe3-199b-4144-87f1-915ad9ad5e9d tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] [instance: bd559e67-3c8f-42b4-b1d6-fd171c8850b8] Fetching instance by UUID {{(pid=72090) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:37:20 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-ab82dbe3-199b-4144-87f1-915ad9ad5e9d tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:37:20 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-ab82dbe3-199b-4144-87f1-915ad9ad5e9d tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:37:20 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-ab82dbe3-199b-4144-87f1-915ad9ad5e9d tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:37:20 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-ab82dbe3-199b-4144-87f1-915ad9ad5e9d tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:37:20 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-ab82dbe3-199b-4144-87f1-915ad9ad5e9d tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:37:20 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-ab82dbe3-199b-4144-87f1-915ad9ad5e9d tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:37:20 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [None req-ab82dbe3-199b-4144-87f1-915ad9ad5e9d tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bd559e67-3c8f-42b4-b1d6-fd171c8850b8/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.080696 Apr 11 19:37:20 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 245/737] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Apr 11 19:37:20 2023] GET /compute/v2.1/servers/bd559e67-3c8f-42b4-b1d6-fd171c8850b8/os-volume_attachments => generated 371 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:37:20 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [None req-07f987e5-8873-4f7a-821e-46b690bc41ab tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Calling method '>' {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:37:20 user devstack@n-api.service[72088]: DEBUG nova.compute.api [None req-07f987e5-8873-4f7a-821e-46b690bc41ab tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] [instance: bd559e67-3c8f-42b4-b1d6-fd171c8850b8] Fetching instance by UUID {{(pid=72088) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:37:20 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-07f987e5-8873-4f7a-821e-46b690bc41ab tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:37:20 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-07f987e5-8873-4f7a-821e-46b690bc41ab tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:37:20 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-07f987e5-8873-4f7a-821e-46b690bc41ab tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:37:20 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-07f987e5-8873-4f7a-821e-46b690bc41ab tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:37:20 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-07f987e5-8873-4f7a-821e-46b690bc41ab tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:37:20 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-07f987e5-8873-4f7a-821e-46b690bc41ab tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:37:20 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [None req-07f987e5-8873-4f7a-821e-46b690bc41ab tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bd559e67-3c8f-42b4-b1d6-fd171c8850b8/os-volume_attachments/cb101440-f092-4818-b8ef-1e2da8c26cfa" status: 200 len: 194 microversion: 2.1 time: 0.050836 Apr 11 19:37:20 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 241/738] 10.0.0.210 () {62 vars in 1490 bytes} [Tue Apr 11 19:37:20 2023] GET /compute/v2.1/servers/bd559e67-3c8f-42b4-b1d6-fd171c8850b8/os-volume_attachments/cb101440-f092-4818-b8ef-1e2da8c26cfa => generated 194 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 11 19:37:20 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [None req-0b2668a8-2b98-4881-8c78-2c77522cc4a0 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Calling method '>' {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:37:20 user devstack@n-api.service[72089]: DEBUG nova.compute.api [None req-0b2668a8-2b98-4881-8c78-2c77522cc4a0 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] [instance: bd559e67-3c8f-42b4-b1d6-fd171c8850b8] Fetching instance by UUID {{(pid=72089) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:37:20 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-0b2668a8-2b98-4881-8c78-2c77522cc4a0 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:37:20 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-0b2668a8-2b98-4881-8c78-2c77522cc4a0 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:37:20 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-0b2668a8-2b98-4881-8c78-2c77522cc4a0 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:37:20 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-0b2668a8-2b98-4881-8c78-2c77522cc4a0 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:37:20 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-0b2668a8-2b98-4881-8c78-2c77522cc4a0 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:37:20 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-0b2668a8-2b98-4881-8c78-2c77522cc4a0 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:37:20 user devstack@n-api.service[72089]: DEBUG nova.objects.instance [None req-0b2668a8-2b98-4881-8c78-2c77522cc4a0 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Lazy-loading 'services' on Instance uuid bd559e67-3c8f-42b4-b1d6-fd171c8850b8 {{(pid=72089) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 11 19:37:20 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [None req-0b2668a8-2b98-4881-8c78-2c77522cc4a0 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/bd559e67-3c8f-42b4-b1d6-fd171c8850b8/os-volume_attachments/cb101440-f092-4818-b8ef-1e2da8c26cfa" status: 202 len: 0 microversion: 2.1 time: 0.194957 Apr 11 19:37:20 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 253/739] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Apr 11 19:37:20 2023] DELETE /compute/v2.1/servers/bd559e67-3c8f-42b4-b1d6-fd171c8850b8/os-volume_attachments/cb101440-f092-4818-b8ef-1e2da8c26cfa => generated 0 bytes in 198 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 19:37:20 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [req-602017ff-bc12-4525-b739-c28552d0ebb0 req-725c113e-3a69-4723-80fd-3d50bcca0407 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d000531-5884-405d-9e17-1dc5f39226d0", "name": "network-vif-unplugged", "status": "completed", "tag": "0ff284fa-ebe1-4fe5-9942-7d57a7bb641a"}]} {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:37:20 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-602017ff-bc12-4525-b739-c28552d0ebb0 req-725c113e-3a69-4723-80fd-3d50bcca0407 service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:37:20 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-602017ff-bc12-4525-b739-c28552d0ebb0 req-725c113e-3a69-4723-80fd-3d50bcca0407 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:37:20 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-602017ff-bc12-4525-b739-c28552d0ebb0 req-725c113e-3a69-4723-80fd-3d50bcca0407 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:37:20 user devstack@n-api.service[72090]: INFO nova.api.openstack.compute.server_external_events [req-602017ff-bc12-4525-b739-c28552d0ebb0 req-725c113e-3a69-4723-80fd-3d50bcca0407 service nova] Creating event network-vif-unplugged:0ff284fa-ebe1-4fe5-9942-7d57a7bb641a for instance 5d000531-5884-405d-9e17-1dc5f39226d0 on user Apr 11 19:37:20 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [req-602017ff-bc12-4525-b739-c28552d0ebb0 req-725c113e-3a69-4723-80fd-3d50bcca0407 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.146707 Apr 11 19:37:20 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 246/740] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:37:20 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 11 19:37:22 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [req-e43106ab-26c3-434f-a1a0-7de06a74c985 req-4d70123e-dc01-425f-94bf-cf7981943704 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d000531-5884-405d-9e17-1dc5f39226d0", "name": "network-vif-deleted", "tag": "0ff284fa-ebe1-4fe5-9942-7d57a7bb641a"}]} {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:37:22 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-e43106ab-26c3-434f-a1a0-7de06a74c985 req-4d70123e-dc01-425f-94bf-cf7981943704 service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:37:22 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-e43106ab-26c3-434f-a1a0-7de06a74c985 req-4d70123e-dc01-425f-94bf-cf7981943704 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:37:22 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-e43106ab-26c3-434f-a1a0-7de06a74c985 req-4d70123e-dc01-425f-94bf-cf7981943704 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:37:22 user devstack@n-api.service[72088]: INFO nova.api.openstack.compute.server_external_events [req-e43106ab-26c3-434f-a1a0-7de06a74c985 req-4d70123e-dc01-425f-94bf-cf7981943704 service nova] Creating event network-vif-deleted:0ff284fa-ebe1-4fe5-9942-7d57a7bb641a for instance 5d000531-5884-405d-9e17-1dc5f39226d0 on user Apr 11 19:37:22 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [req-e43106ab-26c3-434f-a1a0-7de06a74c985 req-4d70123e-dc01-425f-94bf-cf7981943704 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062504 Apr 11 19:37:22 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 242/741] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:37:22 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:37:22 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [None req-7577736a-3830-4823-9c93-e69e15323893 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Calling method '>' {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:37:22 user devstack@n-api.service[72089]: DEBUG nova.compute.api [None req-7577736a-3830-4823-9c93-e69e15323893 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] [instance: bd559e67-3c8f-42b4-b1d6-fd171c8850b8] Fetching instance by UUID {{(pid=72089) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:37:22 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-7577736a-3830-4823-9c93-e69e15323893 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:37:22 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-7577736a-3830-4823-9c93-e69e15323893 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:37:22 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-7577736a-3830-4823-9c93-e69e15323893 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:37:22 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-7577736a-3830-4823-9c93-e69e15323893 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:37:22 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-7577736a-3830-4823-9c93-e69e15323893 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:37:22 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-7577736a-3830-4823-9c93-e69e15323893 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:37:22 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [None req-7577736a-3830-4823-9c93-e69e15323893 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bd559e67-3c8f-42b4-b1d6-fd171c8850b8/os-volume_attachments/fe7d53f9-3e55-493f-937b-b8bb59c63939" status: 200 len: 194 microversion: 2.1 time: 0.072012 Apr 11 19:37:22 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 254/742] 10.0.0.210 () {62 vars in 1490 bytes} [Tue Apr 11 19:37:22 2023] GET /compute/v2.1/servers/bd559e67-3c8f-42b4-b1d6-fd171c8850b8/os-volume_attachments/fe7d53f9-3e55-493f-937b-b8bb59c63939 => generated 194 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 11 19:37:22 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [None req-f1f4821f-8e9a-4a1e-a311-2b9344130580 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Calling method '>' {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:37:22 user devstack@n-api.service[72090]: DEBUG nova.compute.api [None req-f1f4821f-8e9a-4a1e-a311-2b9344130580 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] [instance: bd559e67-3c8f-42b4-b1d6-fd171c8850b8] Fetching instance by UUID {{(pid=72090) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:37:22 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-f1f4821f-8e9a-4a1e-a311-2b9344130580 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:37:22 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-f1f4821f-8e9a-4a1e-a311-2b9344130580 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:37:22 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-f1f4821f-8e9a-4a1e-a311-2b9344130580 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:37:22 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-f1f4821f-8e9a-4a1e-a311-2b9344130580 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:37:22 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-f1f4821f-8e9a-4a1e-a311-2b9344130580 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:37:22 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-f1f4821f-8e9a-4a1e-a311-2b9344130580 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:37:22 user devstack@n-api.service[72090]: DEBUG nova.objects.instance [None req-f1f4821f-8e9a-4a1e-a311-2b9344130580 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Lazy-loading 'services' on Instance uuid bd559e67-3c8f-42b4-b1d6-fd171c8850b8 {{(pid=72090) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 11 19:37:22 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [None req-f1f4821f-8e9a-4a1e-a311-2b9344130580 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/bd559e67-3c8f-42b4-b1d6-fd171c8850b8/os-volume_attachments/fe7d53f9-3e55-493f-937b-b8bb59c63939" status: 202 len: 0 microversion: 2.1 time: 0.199196 Apr 11 19:37:22 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 247/743] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Apr 11 19:37:22 2023] DELETE /compute/v2.1/servers/bd559e67-3c8f-42b4-b1d6-fd171c8850b8/os-volume_attachments/fe7d53f9-3e55-493f-937b-b8bb59c63939 => generated 0 bytes in 202 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 19:37:23 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [req-629de017-aa49-4b17-b417-b7d02912a8ce req-fca98d39-4e53-46dd-8395-cf9439f9f00e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d000531-5884-405d-9e17-1dc5f39226d0", "name": "network-vif-plugged", "status": "completed", "tag": "0ff284fa-ebe1-4fe5-9942-7d57a7bb641a"}]} {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:37:23 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-629de017-aa49-4b17-b417-b7d02912a8ce req-fca98d39-4e53-46dd-8395-cf9439f9f00e service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:37:23 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-629de017-aa49-4b17-b417-b7d02912a8ce req-fca98d39-4e53-46dd-8395-cf9439f9f00e service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:37:23 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-629de017-aa49-4b17-b417-b7d02912a8ce req-fca98d39-4e53-46dd-8395-cf9439f9f00e service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:37:23 user devstack@n-api.service[72088]: INFO nova.api.openstack.compute.server_external_events [req-629de017-aa49-4b17-b417-b7d02912a8ce req-fca98d39-4e53-46dd-8395-cf9439f9f00e service nova] Creating event network-vif-plugged:0ff284fa-ebe1-4fe5-9942-7d57a7bb641a for instance 5d000531-5884-405d-9e17-1dc5f39226d0 on user Apr 11 19:37:23 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [req-629de017-aa49-4b17-b417-b7d02912a8ce req-fca98d39-4e53-46dd-8395-cf9439f9f00e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052053 Apr 11 19:37:23 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 243/744] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:37:23 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:37:25 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [None req-4e07ea7a-83dd-4add-828d-c175191f78f8 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:37:25 user devstack@n-api.service[72089]: DEBUG nova.compute.api [None req-4e07ea7a-83dd-4add-828d-c175191f78f8 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] [instance: 647674d8-af53-405a-8116-4b7a01549bdf] Fetching instance by UUID {{(pid=72089) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:37:25 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-4e07ea7a-83dd-4add-828d-c175191f78f8 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:37:25 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-4e07ea7a-83dd-4add-828d-c175191f78f8 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:37:25 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-4e07ea7a-83dd-4add-828d-c175191f78f8 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:37:25 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-4e07ea7a-83dd-4add-828d-c175191f78f8 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:37:25 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-4e07ea7a-83dd-4add-828d-c175191f78f8 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:37:25 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-4e07ea7a-83dd-4add-828d-c175191f78f8 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:37:25 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [None req-4e07ea7a-83dd-4add-828d-c175191f78f8 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] 10.0.0.210 "POST /compute/v2.1/servers/647674d8-af53-405a-8116-4b7a01549bdf/action" status: 202 len: 0 microversion: 2.1 time: 0.165483 Apr 11 19:37:25 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 255/745] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Apr 11 19:37:25 2023] POST /compute/v2.1/servers/647674d8-af53-405a-8116-4b7a01549bdf/action => generated 0 bytes in 167 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 19:37:25 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [None req-3a0f7b1b-8b05-40c0-a6b7-3f20c277ad09 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Calling method '>' {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:37:25 user devstack@n-api.service[72090]: DEBUG nova.compute.api [None req-3a0f7b1b-8b05-40c0-a6b7-3f20c277ad09 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] [instance: 647674d8-af53-405a-8116-4b7a01549bdf] Fetching instance by UUID {{(pid=72090) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:37:25 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-3a0f7b1b-8b05-40c0-a6b7-3f20c277ad09 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:37:25 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-3a0f7b1b-8b05-40c0-a6b7-3f20c277ad09 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:37:25 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-3a0f7b1b-8b05-40c0-a6b7-3f20c277ad09 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:37:25 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-3a0f7b1b-8b05-40c0-a6b7-3f20c277ad09 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:37:25 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-3a0f7b1b-8b05-40c0-a6b7-3f20c277ad09 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:37:25 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-3a0f7b1b-8b05-40c0-a6b7-3f20c277ad09 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:37:25 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [None req-3eac048d-8aec-460d-ad87-71c584d4b987 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Calling method '>' {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:37:25 user devstack@n-api.service[72088]: DEBUG nova.compute.api [None req-3eac048d-8aec-460d-ad87-71c584d4b987 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] [instance: bd559e67-3c8f-42b4-b1d6-fd171c8850b8] Fetching instance by UUID {{(pid=72088) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:37:25 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-3eac048d-8aec-460d-ad87-71c584d4b987 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:37:25 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-3eac048d-8aec-460d-ad87-71c584d4b987 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:37:25 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-3eac048d-8aec-460d-ad87-71c584d4b987 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:37:25 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-3eac048d-8aec-460d-ad87-71c584d4b987 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:37:25 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-3eac048d-8aec-460d-ad87-71c584d4b987 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:37:25 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-3eac048d-8aec-460d-ad87-71c584d4b987 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:37:25 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [None req-3eac048d-8aec-460d-ad87-71c584d4b987 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bd559e67-3c8f-42b4-b1d6-fd171c8850b8/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.067070 Apr 11 19:37:25 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 244/746] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Apr 11 19:37:25 2023] GET /compute/v2.1/servers/bd559e67-3c8f-42b4-b1d6-fd171c8850b8/os-volume_attachments => generated 25 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 11 19:37:25 user devstack@n-api.service[72090]: DEBUG nova.policy [None req-3a0f7b1b-8b05-40c0-a6b7-3f20c277ad09 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05fb551c320a48f98a4ec00a7f7492d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60a7381a31b84e97a068528f90813773', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72090) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:37:25 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [None req-3a0f7b1b-8b05-40c0-a6b7-3f20c277ad09 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] 10.0.0.210 "GET /compute/v2.1/servers/647674d8-af53-405a-8116-4b7a01549bdf" status: 200 len: 1730 microversion: 2.1 time: 0.223713 Apr 11 19:37:25 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 248/747] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 19:37:25 2023] GET /compute/v2.1/servers/647674d8-af53-405a-8116-4b7a01549bdf => generated 1730 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:37:25 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [None req-82345331-4317-4431-acb6-d084d6904134 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Calling method '>' {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:37:25 user devstack@n-api.service[72089]: DEBUG nova.compute.api [None req-82345331-4317-4431-acb6-d084d6904134 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] [instance: bd559e67-3c8f-42b4-b1d6-fd171c8850b8] Fetching instance by UUID {{(pid=72089) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:37:25 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-82345331-4317-4431-acb6-d084d6904134 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:37:25 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-82345331-4317-4431-acb6-d084d6904134 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:37:25 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-82345331-4317-4431-acb6-d084d6904134 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:37:25 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-82345331-4317-4431-acb6-d084d6904134 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:37:25 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-82345331-4317-4431-acb6-d084d6904134 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:37:25 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-82345331-4317-4431-acb6-d084d6904134 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:37:25 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [None req-82345331-4317-4431-acb6-d084d6904134 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bd559e67-3c8f-42b4-b1d6-fd171c8850b8/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048892 Apr 11 19:37:25 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 256/748] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Apr 11 19:37:25 2023] GET /compute/v2.1/servers/bd559e67-3c8f-42b4-b1d6-fd171c8850b8/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Apr 11 19:37:25 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [None req-737868d7-948b-48d7-be5e-28b954028adc tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Calling method '>' {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:37:25 user devstack@n-api.service[72088]: DEBUG nova.compute.api [None req-737868d7-948b-48d7-be5e-28b954028adc tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] [instance: bd559e67-3c8f-42b4-b1d6-fd171c8850b8] Fetching instance by UUID {{(pid=72088) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:37:25 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-737868d7-948b-48d7-be5e-28b954028adc tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:37:25 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-737868d7-948b-48d7-be5e-28b954028adc tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:37:25 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-737868d7-948b-48d7-be5e-28b954028adc tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:37:25 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-737868d7-948b-48d7-be5e-28b954028adc tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:37:25 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-737868d7-948b-48d7-be5e-28b954028adc tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:37:25 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-737868d7-948b-48d7-be5e-28b954028adc tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:37:25 user devstack@n-api.service[72088]: DEBUG nova.compute.api [None req-737868d7-948b-48d7-be5e-28b954028adc tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] [instance: bd559e67-3c8f-42b4-b1d6-fd171c8850b8] Going to try to terminate instance {{(pid=72088) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 11 19:37:25 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [None req-737868d7-948b-48d7-be5e-28b954028adc tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/bd559e67-3c8f-42b4-b1d6-fd171c8850b8" status: 204 len: 0 microversion: 2.1 time: 0.134799 Apr 11 19:37:25 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 245/749] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 19:37:25 2023] DELETE /compute/v2.1/servers/bd559e67-3c8f-42b4-b1d6-fd171c8850b8 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 11 19:37:25 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [None req-a5a2654e-7db6-497e-808b-1553af9ce4e8 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Calling method '>' {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:37:25 user devstack@n-api.service[72090]: DEBUG nova.compute.api [None req-a5a2654e-7db6-497e-808b-1553af9ce4e8 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] [instance: bd559e67-3c8f-42b4-b1d6-fd171c8850b8] Fetching instance by UUID {{(pid=72090) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:37:25 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-a5a2654e-7db6-497e-808b-1553af9ce4e8 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:37:25 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-a5a2654e-7db6-497e-808b-1553af9ce4e8 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:37:25 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-a5a2654e-7db6-497e-808b-1553af9ce4e8 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:37:25 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-a5a2654e-7db6-497e-808b-1553af9ce4e8 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:37:25 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-a5a2654e-7db6-497e-808b-1553af9ce4e8 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:37:25 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-a5a2654e-7db6-497e-808b-1553af9ce4e8 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:37:26 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [req-082b255a-a16d-45fb-b76b-2e66fa237ec1 req-3ad56e60-fd4b-40cc-9ab8-64b1e14eb5a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd559e67-3c8f-42b4-b1d6-fd171c8850b8", "name": "network-vif-unplugged", "status": "completed", "tag": "ed9fd5c5-52fb-4d71-9ba0-911eaa1a92a2"}]} {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:37:26 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-082b255a-a16d-45fb-b76b-2e66fa237ec1 req-3ad56e60-fd4b-40cc-9ab8-64b1e14eb5a6 service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:37:26 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-082b255a-a16d-45fb-b76b-2e66fa237ec1 req-3ad56e60-fd4b-40cc-9ab8-64b1e14eb5a6 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:37:26 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-082b255a-a16d-45fb-b76b-2e66fa237ec1 req-3ad56e60-fd4b-40cc-9ab8-64b1e14eb5a6 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:37:26 user devstack@n-api.service[72089]: INFO nova.api.openstack.compute.server_external_events [req-082b255a-a16d-45fb-b76b-2e66fa237ec1 req-3ad56e60-fd4b-40cc-9ab8-64b1e14eb5a6 service nova] Creating event network-vif-unplugged:ed9fd5c5-52fb-4d71-9ba0-911eaa1a92a2 for instance bd559e67-3c8f-42b4-b1d6-fd171c8850b8 on user Apr 11 19:37:26 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [req-082b255a-a16d-45fb-b76b-2e66fa237ec1 req-3ad56e60-fd4b-40cc-9ab8-64b1e14eb5a6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.042049 Apr 11 19:37:26 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 257/750] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:37:26 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:37:26 user devstack@n-api.service[72090]: DEBUG nova.policy [None req-a5a2654e-7db6-497e-808b-1553af9ce4e8 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31c237e142784bd6aa460d6f1bf33400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd886d2ec5fc946b49af3c8ca7c8556c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72090) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:37:26 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [None req-a5a2654e-7db6-497e-808b-1553af9ce4e8 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bd559e67-3c8f-42b4-b1d6-fd171c8850b8" status: 200 len: 1663 microversion: 2.1 time: 0.341467 Apr 11 19:37:26 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 249/751] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 19:37:25 2023] GET /compute/v2.1/servers/bd559e67-3c8f-42b4-b1d6-fd171c8850b8 => generated 1663 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:37:27 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [req-ee28fea6-6d37-49d6-a8ed-8c12d2f45c2c req-b9765bad-1a09-4b8b-b165-664c978d097c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd559e67-3c8f-42b4-b1d6-fd171c8850b8", "name": "network-vif-deleted", "tag": "ed9fd5c5-52fb-4d71-9ba0-911eaa1a92a2"}]} {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:37:27 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-ee28fea6-6d37-49d6-a8ed-8c12d2f45c2c req-b9765bad-1a09-4b8b-b165-664c978d097c service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:37:27 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-ee28fea6-6d37-49d6-a8ed-8c12d2f45c2c req-b9765bad-1a09-4b8b-b165-664c978d097c service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:37:27 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-ee28fea6-6d37-49d6-a8ed-8c12d2f45c2c req-b9765bad-1a09-4b8b-b165-664c978d097c service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:37:27 user devstack@n-api.service[72088]: INFO nova.api.openstack.compute.server_external_events [req-ee28fea6-6d37-49d6-a8ed-8c12d2f45c2c req-b9765bad-1a09-4b8b-b165-664c978d097c service nova] Creating event network-vif-deleted:ed9fd5c5-52fb-4d71-9ba0-911eaa1a92a2 for instance bd559e67-3c8f-42b4-b1d6-fd171c8850b8 on user Apr 11 19:37:27 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [req-ee28fea6-6d37-49d6-a8ed-8c12d2f45c2c req-b9765bad-1a09-4b8b-b165-664c978d097c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058466 Apr 11 19:37:27 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 246/752] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:37:27 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:37:28 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [req-6cdc9f3b-3695-4a9b-abef-a59a14301e20 req-dc75d0c7-f117-4e97-8fa4-ba47db04da2b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd559e67-3c8f-42b4-b1d6-fd171c8850b8", "name": "network-vif-plugged", "status": "completed", "tag": "ed9fd5c5-52fb-4d71-9ba0-911eaa1a92a2"}, {"server_uuid": "647674d8-af53-405a-8116-4b7a01549bdf", "name": "network-vif-unplugged", "status": "completed", "tag": "e4e4888a-168a-4fe8-a43e-ee683b50a39a"}, {"server_uuid": "647674d8-af53-405a-8116-4b7a01549bdf", "name": "network-vif-plugged", "status": "completed", "tag": "e4e4888a-168a-4fe8-a43e-ee683b50a39a"}]} {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:37:28 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-6cdc9f3b-3695-4a9b-abef-a59a14301e20 req-dc75d0c7-f117-4e97-8fa4-ba47db04da2b service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:37:28 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-6cdc9f3b-3695-4a9b-abef-a59a14301e20 req-dc75d0c7-f117-4e97-8fa4-ba47db04da2b service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:37:28 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-6cdc9f3b-3695-4a9b-abef-a59a14301e20 req-dc75d0c7-f117-4e97-8fa4-ba47db04da2b service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:37:28 user devstack@n-api.service[72089]: INFO nova.api.openstack.compute.server_external_events [req-6cdc9f3b-3695-4a9b-abef-a59a14301e20 req-dc75d0c7-f117-4e97-8fa4-ba47db04da2b service nova] Creating event network-vif-plugged:ed9fd5c5-52fb-4d71-9ba0-911eaa1a92a2 for instance bd559e67-3c8f-42b4-b1d6-fd171c8850b8 on user Apr 11 19:37:28 user devstack@n-api.service[72089]: INFO nova.api.openstack.compute.server_external_events [req-6cdc9f3b-3695-4a9b-abef-a59a14301e20 req-dc75d0c7-f117-4e97-8fa4-ba47db04da2b service nova] Creating event network-vif-unplugged:e4e4888a-168a-4fe8-a43e-ee683b50a39a for instance 647674d8-af53-405a-8116-4b7a01549bdf on user Apr 11 19:37:28 user devstack@n-api.service[72089]: INFO nova.api.openstack.compute.server_external_events [req-6cdc9f3b-3695-4a9b-abef-a59a14301e20 req-dc75d0c7-f117-4e97-8fa4-ba47db04da2b service nova] Creating event network-vif-plugged:e4e4888a-168a-4fe8-a43e-ee683b50a39a for instance 647674d8-af53-405a-8116-4b7a01549bdf on user Apr 11 19:37:28 user devstack@n-api.service[72089]: DEBUG nova.compute.api [req-6cdc9f3b-3695-4a9b-abef-a59a14301e20 req-dc75d0c7-f117-4e97-8fa4-ba47db04da2b service nova] Instance 647674d8-af53-405a-8116-4b7a01549bdf is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=72089) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 11 19:37:28 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [req-6cdc9f3b-3695-4a9b-abef-a59a14301e20 req-dc75d0c7-f117-4e97-8fa4-ba47db04da2b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 527 microversion: 2.1 time: 0.063041 Apr 11 19:37:28 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 258/753] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:37:28 2023] POST /compute/v2.1/os-server-external-events => generated 527 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:37:37 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [req-37ac67d0-2cf0-4bad-a5d5-8b8aa993cadb req-b3e22dee-7b6d-4eb2-bde2-2049850779da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "647674d8-af53-405a-8116-4b7a01549bdf", "name": "network-vif-plugged", "status": "completed", "tag": "e4e4888a-168a-4fe8-a43e-ee683b50a39a"}]} {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:37:37 user devstack@n-api.service[72090]: DEBUG dbcounter [-] [72090] Writing DB stats nova_api:SELECT=15 {{(pid=72090) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:37:37 user devstack@n-api.service[72090]: DEBUG dbcounter [-] [72090] Writing DB stats nova_cell1:SELECT=45,nova_cell1:INSERT=2 {{(pid=72090) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:37:37 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-37ac67d0-2cf0-4bad-a5d5-8b8aa993cadb req-b3e22dee-7b6d-4eb2-bde2-2049850779da service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:37:37 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-37ac67d0-2cf0-4bad-a5d5-8b8aa993cadb req-b3e22dee-7b6d-4eb2-bde2-2049850779da service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:37:37 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-37ac67d0-2cf0-4bad-a5d5-8b8aa993cadb req-b3e22dee-7b6d-4eb2-bde2-2049850779da service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:37:37 user devstack@n-api.service[72090]: INFO nova.api.openstack.compute.server_external_events [req-37ac67d0-2cf0-4bad-a5d5-8b8aa993cadb req-b3e22dee-7b6d-4eb2-bde2-2049850779da service nova] Creating event network-vif-plugged:e4e4888a-168a-4fe8-a43e-ee683b50a39a for instance 647674d8-af53-405a-8116-4b7a01549bdf on user Apr 11 19:37:37 user devstack@n-api.service[72090]: DEBUG nova.compute.api [req-37ac67d0-2cf0-4bad-a5d5-8b8aa993cadb req-b3e22dee-7b6d-4eb2-bde2-2049850779da service nova] Instance 647674d8-af53-405a-8116-4b7a01549bdf is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=72090) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 11 19:37:37 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [req-37ac67d0-2cf0-4bad-a5d5-8b8aa993cadb req-b3e22dee-7b6d-4eb2-bde2-2049850779da service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061425 Apr 11 19:37:37 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 250/754] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:37:37 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:37:39 user devstack@n-api.service[72088]: DEBUG dbcounter [-] [72088] Writing DB stats nova_api:SELECT=23,nova_api:UPDATE=2 {{(pid=72088) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:37:39 user devstack@n-api.service[72088]: DEBUG dbcounter [-] [72088] Writing DB stats nova_cell1:SELECT=47,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=72088) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:37:39 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [req-0f344c37-0d23-4a6d-8eb4-8582b0b139c7 req-3cf1d3a7-5e38-4747-a835-d3ce50c48abd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "647674d8-af53-405a-8116-4b7a01549bdf", "name": "network-vif-plugged", "status": "completed", "tag": "e4e4888a-168a-4fe8-a43e-ee683b50a39a"}]} {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:37:39 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-0f344c37-0d23-4a6d-8eb4-8582b0b139c7 req-3cf1d3a7-5e38-4747-a835-d3ce50c48abd service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:37:39 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-0f344c37-0d23-4a6d-8eb4-8582b0b139c7 req-3cf1d3a7-5e38-4747-a835-d3ce50c48abd service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:37:39 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-0f344c37-0d23-4a6d-8eb4-8582b0b139c7 req-3cf1d3a7-5e38-4747-a835-d3ce50c48abd service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:37:39 user devstack@n-api.service[72088]: INFO nova.api.openstack.compute.server_external_events [req-0f344c37-0d23-4a6d-8eb4-8582b0b139c7 req-3cf1d3a7-5e38-4747-a835-d3ce50c48abd service nova] Creating event network-vif-plugged:e4e4888a-168a-4fe8-a43e-ee683b50a39a for instance 647674d8-af53-405a-8116-4b7a01549bdf on user Apr 11 19:37:39 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [req-0f344c37-0d23-4a6d-8eb4-8582b0b139c7 req-3cf1d3a7-5e38-4747-a835-d3ce50c48abd service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038879 Apr 11 19:37:39 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 247/755] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:37:39 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:37:39 user devstack@n-api.service[72089]: DEBUG dbcounter [-] [72089] Writing DB stats nova_api:SELECT=21,nova_api:UPDATE=1 {{(pid=72089) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:37:39 user devstack@n-api.service[72089]: DEBUG dbcounter [-] [72089] Writing DB stats nova_cell1:SELECT=82,nova_cell1:UPDATE=7,nova_cell1:INSERT=4 {{(pid=72089) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:37:39 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [None req-9b841e49-8bc5-4917-8954-3c4f3bb2fdfa tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Calling method '>' {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:37:39 user devstack@n-api.service[72090]: DEBUG nova.compute.api [None req-9b841e49-8bc5-4917-8954-3c4f3bb2fdfa tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] [instance: 781f3398-3d54-49a4-a751-60f4fbc5e49a] Fetching instance by UUID {{(pid=72090) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:37:39 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-9b841e49-8bc5-4917-8954-3c4f3bb2fdfa tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:37:39 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-9b841e49-8bc5-4917-8954-3c4f3bb2fdfa tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:37:39 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-9b841e49-8bc5-4917-8954-3c4f3bb2fdfa tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:37:39 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-9b841e49-8bc5-4917-8954-3c4f3bb2fdfa tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:37:39 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-9b841e49-8bc5-4917-8954-3c4f3bb2fdfa tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:37:39 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-9b841e49-8bc5-4917-8954-3c4f3bb2fdfa tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:37:39 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [None req-92dedbe1-79cb-4810-8e25-52cbdd0e07d8 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ed2471b8-307f-4229-bbc5-8319d5621c4d"}} {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:37:39 user devstack@n-api.service[72089]: DEBUG nova.compute.api [None req-92dedbe1-79cb-4810-8e25-52cbdd0e07d8 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] [instance: fbfa0825-c7c2-4f04-8c9a-102e238c3816] Fetching instance by UUID {{(pid=72089) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:37:39 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-92dedbe1-79cb-4810-8e25-52cbdd0e07d8 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:37:39 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-92dedbe1-79cb-4810-8e25-52cbdd0e07d8 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:37:39 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-92dedbe1-79cb-4810-8e25-52cbdd0e07d8 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:37:39 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-92dedbe1-79cb-4810-8e25-52cbdd0e07d8 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:37:39 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-92dedbe1-79cb-4810-8e25-52cbdd0e07d8 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:37:39 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-92dedbe1-79cb-4810-8e25-52cbdd0e07d8 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:37:40 user devstack@n-api.service[72090]: DEBUG nova.policy [None req-9b841e49-8bc5-4917-8954-3c4f3bb2fdfa tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf262cd03f4a41c4956d8784cf37d86d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caba0618fc743e7bfb2dd866a511df9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72090) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:37:40 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [None req-9b841e49-8bc5-4917-8954-3c4f3bb2fdfa tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] 10.0.0.210 "GET /compute/v2.1/servers/781f3398-3d54-49a4-a751-60f4fbc5e49a" status: 200 len: 1550 microversion: 2.1 time: 0.235667 Apr 11 19:37:40 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 251/756] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 19:37:39 2023] GET /compute/v2.1/servers/781f3398-3d54-49a4-a751-60f4fbc5e49a => generated 1550 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:37:40 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [None req-92dedbe1-79cb-4810-8e25-52cbdd0e07d8 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] 10.0.0.210 "POST /compute/v2.1/servers/fbfa0825-c7c2-4f04-8c9a-102e238c3816/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.673137 Apr 11 19:37:40 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 259/757] 10.0.0.210 () {66 vars in 1441 bytes} [Tue Apr 11 19:37:39 2023] POST /compute/v2.1/servers/fbfa0825-c7c2-4f04-8c9a-102e238c3816/os-volume_attachments => generated 188 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:37:40 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [None req-b69327dd-7866-4c04-9a16-305bf11995ae tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Calling method '>' {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:37:40 user devstack@n-api.service[72088]: DEBUG nova.compute.api [None req-b69327dd-7866-4c04-9a16-305bf11995ae tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] [instance: fbfa0825-c7c2-4f04-8c9a-102e238c3816] Fetching instance by UUID {{(pid=72088) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:37:40 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-b69327dd-7866-4c04-9a16-305bf11995ae tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:37:40 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-b69327dd-7866-4c04-9a16-305bf11995ae tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:37:40 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-b69327dd-7866-4c04-9a16-305bf11995ae tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:37:40 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-b69327dd-7866-4c04-9a16-305bf11995ae tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:37:40 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-b69327dd-7866-4c04-9a16-305bf11995ae tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:37:40 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-b69327dd-7866-4c04-9a16-305bf11995ae tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:37:40 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [None req-b69327dd-7866-4c04-9a16-305bf11995ae tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/fbfa0825-c7c2-4f04-8c9a-102e238c3816/os-volume_attachments/ed2471b8-307f-4229-bbc5-8319d5621c4d" status: 202 len: 0 microversion: 2.20 time: 0.243868 Apr 11 19:37:40 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 248/758] 10.0.0.210 () {64 vars in 1534 bytes} [Tue Apr 11 19:37:40 2023] DELETE /compute/v2.1/servers/fbfa0825-c7c2-4f04-8c9a-102e238c3816/os-volume_attachments/ed2471b8-307f-4229-bbc5-8319d5621c4d => generated 0 bytes in 245 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 11 19:37:40 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [None req-8336c00d-4aaf-4538-b69c-15b2e39e258c tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:37:40 user devstack@n-api.service[72090]: DEBUG nova.compute.api [None req-8336c00d-4aaf-4538-b69c-15b2e39e258c tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] [instance: fbfa0825-c7c2-4f04-8c9a-102e238c3816] Fetching instance by UUID {{(pid=72090) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:37:40 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-8336c00d-4aaf-4538-b69c-15b2e39e258c tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:37:40 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-8336c00d-4aaf-4538-b69c-15b2e39e258c tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:37:40 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-8336c00d-4aaf-4538-b69c-15b2e39e258c tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:37:40 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-8336c00d-4aaf-4538-b69c-15b2e39e258c tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:37:40 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-8336c00d-4aaf-4538-b69c-15b2e39e258c tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:37:40 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-8336c00d-4aaf-4538-b69c-15b2e39e258c tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:37:40 user devstack@n-api.service[72090]: DEBUG nova.compute.api [None req-8336c00d-4aaf-4538-b69c-15b2e39e258c tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] [instance: fbfa0825-c7c2-4f04-8c9a-102e238c3816] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=72090) unshelve /opt/stack/nova/nova/compute/api.py:4596}} Apr 11 19:37:41 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [None req-8336c00d-4aaf-4538-b69c-15b2e39e258c tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] 10.0.0.210 "POST /compute/v2.1/servers/fbfa0825-c7c2-4f04-8c9a-102e238c3816/action" status: 202 len: 0 microversion: 2.20 time: 0.115130 Apr 11 19:37:41 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 252/759] 10.0.0.210 () {66 vars in 1396 bytes} [Tue Apr 11 19:37:40 2023] POST /compute/v2.1/servers/fbfa0825-c7c2-4f04-8c9a-102e238c3816/action => generated 0 bytes in 117 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 11 19:37:41 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [None req-fecf3c2a-55d4-4210-b964-19d99a48b34d tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Calling method '>' {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:37:41 user devstack@n-api.service[72089]: DEBUG nova.compute.api [None req-fecf3c2a-55d4-4210-b964-19d99a48b34d tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] [instance: fbfa0825-c7c2-4f04-8c9a-102e238c3816] Fetching instance by UUID {{(pid=72089) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:37:41 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-fecf3c2a-55d4-4210-b964-19d99a48b34d tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:37:41 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-fecf3c2a-55d4-4210-b964-19d99a48b34d tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:37:41 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-fecf3c2a-55d4-4210-b964-19d99a48b34d tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:37:41 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-fecf3c2a-55d4-4210-b964-19d99a48b34d tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:37:41 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-fecf3c2a-55d4-4210-b964-19d99a48b34d tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:37:41 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-fecf3c2a-55d4-4210-b964-19d99a48b34d tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:37:41 user devstack@n-api.service[72089]: DEBUG nova.policy [None req-fecf3c2a-55d4-4210-b964-19d99a48b34d tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0558ba5a2b04d36ba2f2411090cc4e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d8b189667e34931aa36149620a036e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72089) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:37:41 user devstack@n-api.service[72089]: DEBUG nova.policy [None req-fecf3c2a-55d4-4210-b964-19d99a48b34d tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0558ba5a2b04d36ba2f2411090cc4e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d8b189667e34931aa36149620a036e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72089) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:37:41 user devstack@n-api.service[72089]: DEBUG nova.policy [None req-fecf3c2a-55d4-4210-b964-19d99a48b34d tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0558ba5a2b04d36ba2f2411090cc4e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d8b189667e34931aa36149620a036e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72089) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:37:41 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [None req-fecf3c2a-55d4-4210-b964-19d99a48b34d tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fbfa0825-c7c2-4f04-8c9a-102e238c3816" status: 200 len: 1661 microversion: 2.20 time: 0.168304 Apr 11 19:37:41 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 260/760] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 19:37:41 2023] GET /compute/v2.1/servers/fbfa0825-c7c2-4f04-8c9a-102e238c3816 => generated 1661 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 19:37:43 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [req-81fa7efa-4d84-49cc-9716-802cd04776fc req-3ba7007c-c2b3-4a03-95b5-85b432ae2de1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fbfa0825-c7c2-4f04-8c9a-102e238c3816", "tag": "0be0dfa4-d8ad-4d32-83ab-a090c0f77f34"}]} {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:37:43 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-81fa7efa-4d84-49cc-9716-802cd04776fc req-3ba7007c-c2b3-4a03-95b5-85b432ae2de1 service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:37:43 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-81fa7efa-4d84-49cc-9716-802cd04776fc req-3ba7007c-c2b3-4a03-95b5-85b432ae2de1 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:37:43 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-81fa7efa-4d84-49cc-9716-802cd04776fc req-3ba7007c-c2b3-4a03-95b5-85b432ae2de1 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:37:43 user devstack@n-api.service[72088]: INFO nova.api.openstack.compute.server_external_events [req-81fa7efa-4d84-49cc-9716-802cd04776fc req-3ba7007c-c2b3-4a03-95b5-85b432ae2de1 service nova] Creating event network-changed:0be0dfa4-d8ad-4d32-83ab-a090c0f77f34 for instance fbfa0825-c7c2-4f04-8c9a-102e238c3816 on user Apr 11 19:37:43 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [req-81fa7efa-4d84-49cc-9716-802cd04776fc req-3ba7007c-c2b3-4a03-95b5-85b432ae2de1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030493 Apr 11 19:37:43 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 249/761] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:37:43 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:37:49 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [None req-0bc775ae-7d90-4de3-b79f-b7af6ba46faa tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Calling method '>' {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:37:49 user devstack@n-api.service[72090]: DEBUG nova.compute.api [None req-0bc775ae-7d90-4de3-b79f-b7af6ba46faa tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] [instance: 8c45de50-92bc-467c-9f3d-7e667e1d0bb3] Fetching instance by UUID {{(pid=72090) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:37:49 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-0bc775ae-7d90-4de3-b79f-b7af6ba46faa tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:37:49 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-0bc775ae-7d90-4de3-b79f-b7af6ba46faa tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:37:49 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-0bc775ae-7d90-4de3-b79f-b7af6ba46faa tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:37:49 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-0bc775ae-7d90-4de3-b79f-b7af6ba46faa tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:37:49 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-0bc775ae-7d90-4de3-b79f-b7af6ba46faa tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:37:49 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-0bc775ae-7d90-4de3-b79f-b7af6ba46faa tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:37:49 user devstack@n-api.service[72090]: DEBUG nova.policy [None req-0bc775ae-7d90-4de3-b79f-b7af6ba46faa tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b3adca432b04d70818a51d1366f5c6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb91586feb3f4a4c84fa8c2183baaf8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72090) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:37:49 user devstack@n-api.service[72090]: DEBUG nova.policy [None req-0bc775ae-7d90-4de3-b79f-b7af6ba46faa tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b3adca432b04d70818a51d1366f5c6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb91586feb3f4a4c84fa8c2183baaf8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72090) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:37:49 user devstack@n-api.service[72090]: DEBUG nova.policy [None req-0bc775ae-7d90-4de3-b79f-b7af6ba46faa tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b3adca432b04d70818a51d1366f5c6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb91586feb3f4a4c84fa8c2183baaf8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72090) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:37:49 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [None req-0bc775ae-7d90-4de3-b79f-b7af6ba46faa tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8c45de50-92bc-467c-9f3d-7e667e1d0bb3" status: 200 len: 1768 microversion: 2.87 time: 0.310231 Apr 11 19:37:49 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 253/762] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 19:37:49 2023] GET /compute/v2.1/servers/8c45de50-92bc-467c-9f3d-7e667e1d0bb3 => generated 1768 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 19:37:51 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [req-fce149ed-5755-49cf-895a-f67d0f5645e3 req-4176f092-699e-4b5d-8510-5fa83f6e370c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fbfa0825-c7c2-4f04-8c9a-102e238c3816", "name": "network-vif-plugged", "status": "completed", "tag": "0be0dfa4-d8ad-4d32-83ab-a090c0f77f34"}]} {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:37:51 user devstack@n-api.service[72089]: DEBUG dbcounter [-] [72089] Writing DB stats nova_api:SELECT=4 {{(pid=72089) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:37:51 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-fce149ed-5755-49cf-895a-f67d0f5645e3 req-4176f092-699e-4b5d-8510-5fa83f6e370c service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:37:51 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-fce149ed-5755-49cf-895a-f67d0f5645e3 req-4176f092-699e-4b5d-8510-5fa83f6e370c service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:37:51 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-fce149ed-5755-49cf-895a-f67d0f5645e3 req-4176f092-699e-4b5d-8510-5fa83f6e370c service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:37:51 user devstack@n-api.service[72089]: INFO nova.api.openstack.compute.server_external_events [req-fce149ed-5755-49cf-895a-f67d0f5645e3 req-4176f092-699e-4b5d-8510-5fa83f6e370c service nova] Creating event network-vif-plugged:0be0dfa4-d8ad-4d32-83ab-a090c0f77f34 for instance fbfa0825-c7c2-4f04-8c9a-102e238c3816 on user Apr 11 19:37:51 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [req-fce149ed-5755-49cf-895a-f67d0f5645e3 req-4176f092-699e-4b5d-8510-5fa83f6e370c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047905 Apr 11 19:37:51 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 261/763] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:37:51 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:37:53 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [req-68fe5980-91c7-46d8-ad68-e5461adcdad2 req-76dfefab-b39d-4ebe-9842-cab8f4f1a3a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fbfa0825-c7c2-4f04-8c9a-102e238c3816", "name": "network-vif-plugged", "status": "completed", "tag": "0be0dfa4-d8ad-4d32-83ab-a090c0f77f34"}]} {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:37:53 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-68fe5980-91c7-46d8-ad68-e5461adcdad2 req-76dfefab-b39d-4ebe-9842-cab8f4f1a3a1 service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:37:53 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-68fe5980-91c7-46d8-ad68-e5461adcdad2 req-76dfefab-b39d-4ebe-9842-cab8f4f1a3a1 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:37:53 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-68fe5980-91c7-46d8-ad68-e5461adcdad2 req-76dfefab-b39d-4ebe-9842-cab8f4f1a3a1 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:37:53 user devstack@n-api.service[72088]: INFO nova.api.openstack.compute.server_external_events [req-68fe5980-91c7-46d8-ad68-e5461adcdad2 req-76dfefab-b39d-4ebe-9842-cab8f4f1a3a1 service nova] Creating event network-vif-plugged:0be0dfa4-d8ad-4d32-83ab-a090c0f77f34 for instance fbfa0825-c7c2-4f04-8c9a-102e238c3816 on user Apr 11 19:37:53 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [req-68fe5980-91c7-46d8-ad68-e5461adcdad2 req-76dfefab-b39d-4ebe-9842-cab8f4f1a3a1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038802 Apr 11 19:37:53 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 250/764] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:37:53 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:38:08 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [None req-b83fc736-4322-4da3-bd5b-167292f58983 tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] Calling method '>' {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:38:08 user devstack@n-api.service[72090]: DEBUG nova.compute.api [None req-b83fc736-4322-4da3-bd5b-167292f58983 tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] [instance: d42dc0ea-4631-44be-8b58-09877280ba2e] Fetching instance by UUID {{(pid=72090) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:38:08 user devstack@n-api.service[72090]: DEBUG dbcounter [-] [72090] Writing DB stats nova_cell1:SELECT=26,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=72090) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:38:08 user devstack@n-api.service[72090]: DEBUG dbcounter [-] [72090] Writing DB stats nova_api:SELECT=14,nova_api:UPDATE=1 {{(pid=72090) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:38:08 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-b83fc736-4322-4da3-bd5b-167292f58983 tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:38:08 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-b83fc736-4322-4da3-bd5b-167292f58983 tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:38:08 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-b83fc736-4322-4da3-bd5b-167292f58983 tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:38:08 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-b83fc736-4322-4da3-bd5b-167292f58983 tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:38:08 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-b83fc736-4322-4da3-bd5b-167292f58983 tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:38:08 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-b83fc736-4322-4da3-bd5b-167292f58983 tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:38:08 user devstack@n-api.service[72090]: DEBUG nova.policy [None req-b83fc736-4322-4da3-bd5b-167292f58983 tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68fcdcd3af164195bf0c7da3b8dfecb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7b9baa081ca455ea6931b7801c805b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72090) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:38:08 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [None req-b83fc736-4322-4da3-bd5b-167292f58983 tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d42dc0ea-4631-44be-8b58-09877280ba2e" status: 200 len: 1431 microversion: 2.1 time: 0.219888 Apr 11 19:38:08 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 254/765] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 19:38:08 2023] GET /compute/v2.1/servers/d42dc0ea-4631-44be-8b58-09877280ba2e => generated 1431 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:38:09 user devstack@n-api.service[72089]: DEBUG dbcounter [-] [72089] Writing DB stats nova_api:SELECT=2 {{(pid=72089) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:38:09 user devstack@n-api.service[72089]: DEBUG dbcounter [-] [72089] Writing DB stats nova_cell1:SELECT=23,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=72089) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:38:09 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [None req-2920b330-d108-4b87-84cc-6351f84f88d9 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Calling method '>' {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:38:09 user devstack@n-api.service[72089]: DEBUG nova.compute.api [None req-2920b330-d108-4b87-84cc-6351f84f88d9 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] [instance: 5d000531-5884-405d-9e17-1dc5f39226d0] Fetching instance by UUID {{(pid=72089) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:38:09 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-2920b330-d108-4b87-84cc-6351f84f88d9 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:38:09 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-2920b330-d108-4b87-84cc-6351f84f88d9 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:38:09 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-2920b330-d108-4b87-84cc-6351f84f88d9 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:38:09 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-2920b330-d108-4b87-84cc-6351f84f88d9 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:38:09 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-2920b330-d108-4b87-84cc-6351f84f88d9 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:38:09 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-2920b330-d108-4b87-84cc-6351f84f88d9 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:38:09 user devstack@n-api.service[72089]: INFO nova.api.openstack.wsgi [None req-2920b330-d108-4b87-84cc-6351f84f88d9 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] HTTP exception thrown: Instance 5d000531-5884-405d-9e17-1dc5f39226d0 could not be found. Apr 11 19:38:09 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [None req-2920b330-d108-4b87-84cc-6351f84f88d9 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Request method failure captured: Apr 11 19:38:09 user devstack@n-api.service[72089]: request: GET /compute/v2.1/servers/5d000531-5884-405d-9e17-1dc5f39226d0 HTTP/1.1 Apr 11 19:38:09 user devstack@n-api.service[72089]: Accept: application/json Apr 11 19:38:09 user devstack@n-api.service[72089]: Accept-Encoding: identity Apr 11 19:38:09 user devstack@n-api.service[72089]: Connection: close Apr 11 19:38:09 user devstack@n-api.service[72089]: Content-Length: 0 Apr 11 19:38:09 user devstack@n-api.service[72089]: Content-Type: application/json Apr 11 19:38:09 user devstack@n-api.service[72089]: Host: 10.0.0.210 Apr 11 19:38:09 user devstack@n-api.service[72089]: Openstack-System-Scope: None Apr 11 19:38:09 user devstack@n-api.service[72089]: User-Agent: python-urllib3/1.26.15 Apr 11 19:38:09 user devstack@n-api.service[72089]: X-Auth-Token: gAAAAABkNbWxfDFKvn38W01Z_CjCssLnT-2BMZi4Dl6isPkuIHw5SDhhYv0jQoPwwxoD-e_SKkKKh35dCiVbaYZDq700KdWh3p4FHBYXX2UA3fda-7SUfUt46bP3z3-JnANOAlnsiSw2JUmzEz5ZrxLU1V0Ries66oBuu5YQITBWxUCpmKcvp70 Apr 11 19:38:09 user devstack@n-api.service[72089]: X-Domain-Id: None Apr 11 19:38:09 user devstack@n-api.service[72089]: X-Domain-Name: None Apr 11 19:38:09 user devstack@n-api.service[72089]: X-Identity-Status: Confirmed Apr 11 19:38:09 user devstack@n-api.service[72089]: X-Is-Admin-Project: True Apr 11 19:38:09 user devstack@n-api.service[72089]: X-Project-Domain-Id: default Apr 11 19:38:09 user devstack@n-api.service[72089]: X-Project-Domain-Name: Default Apr 11 19:38:09 user devstack@n-api.service[72089]: X-Project-Id: 6d5246cf04a7401388cba38d16e298ae Apr 11 19:38:09 user devstack@n-api.service[72089]: X-Project-Name: tempest-VolumesSnapshotTestJSON-111705993 Apr 11 19:38:09 user devstack@n-api.service[72089]: X-Role: reader,member Apr 11 19:38:09 user devstack@n-api.service[72089]: X-Roles: reader,member Apr 11 19:38:09 user devstack@n-api.service[72089]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/6d5246cf04a7401388cba38d16e298ae"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/6d5246cf04a7401388cba38d16e298ae"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/6d5246cf04a7401388cba38d16e298ae"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 11 19:38:09 user devstack@n-api.service[72089]: X-Tenant: tempest-VolumesSnapshotTestJSON-111705993 Apr 11 19:38:09 user devstack@n-api.service[72089]: X-Tenant-Id: 6d5246cf04a7401388cba38d16e298ae Apr 11 19:38:09 user devstack@n-api.service[72089]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-111705993 Apr 11 19:38:09 user devstack@n-api.service[72089]: X-User: tempest-VolumesSnapshotTestJSON-111705993-project-member Apr 11 19:38:09 user devstack@n-api.service[72089]: X-User-Domain-Id: default Apr 11 19:38:09 user devstack@n-api.service[72089]: X-User-Domain-Name: Default Apr 11 19:38:09 user devstack@n-api.service[72089]: X-User-Id: 20f337feb0ed4653976ace530bfdd877 Apr 11 19:38:09 user devstack@n-api.service[72089]: X-User-Name: tempest-VolumesSnapshotTestJSON-111705993-project-member Apr 11 19:38:09 user devstack@n-api.service[72089]: method: > Apr 11 19:38:09 user devstack@n-api.service[72089]: exception: Instance 5d000531-5884-405d-9e17-1dc5f39226d0 could not be found. Apr 11 19:38:09 user devstack@n-api.service[72089]: action_args: {'id': '5d000531-5884-405d-9e17-1dc5f39226d0'} Apr 11 19:38:09 user devstack@n-api.service[72089]: {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 19:38:09 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:38:09 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 19:38:09 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 19:38:09 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 19:38:09 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 19:38:09 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 19:38:09 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 19:38:09 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 19:38:09 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 19:38:09 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5d000531-5884-405d-9e17-1dc5f39226d0 could not be found. Apr 11 19:38:09 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi Apr 11 19:38:09 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 19:38:09 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi Apr 11 19:38:09 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:38:09 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 19:38:09 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 19:38:09 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 19:38:09 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 19:38:09 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 19:38:09 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 19:38:09 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 19:38:09 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 19:38:09 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 19:38:09 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 19:38:09 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 19:38:09 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 19:38:09 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5d000531-5884-405d-9e17-1dc5f39226d0 could not be found. Apr 11 19:38:09 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi Apr 11 19:38:09 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 19:38:09 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi Apr 11 19:38:09 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:38:09 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 19:38:09 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 19:38:09 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 19:38:09 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 19:38:09 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5d000531-5884-405d-9e17-1dc5f39226d0 could not be found. Apr 11 19:38:09 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi Apr 11 19:38:09 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [None req-2920b330-d108-4b87-84cc-6351f84f88d9 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Returning 404 to user: Instance 5d000531-5884-405d-9e17-1dc5f39226d0 could not be found. {{(pid=72089) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 19:38:09 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [None req-2920b330-d108-4b87-84cc-6351f84f88d9 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5d000531-5884-405d-9e17-1dc5f39226d0" status: 404 len: 111 microversion: 2.1 time: 0.056552 Apr 11 19:38:09 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 262/766] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 19:38:09 2023] GET /compute/v2.1/servers/5d000531-5884-405d-9e17-1dc5f39226d0 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 11 19:38:10 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [req-4d349c9f-78a1-4ebd-b7bf-ac3c08ae90f4 req-9a16fafc-a426-4484-a84c-4ae8eb5c3cf4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d42dc0ea-4631-44be-8b58-09877280ba2e", "tag": "fd43e974-64b6-4605-83cb-11b9cfe58341"}]} {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:38:10 user devstack@n-api.service[72088]: DEBUG dbcounter [-] [72088] Writing DB stats nova_api:SELECT=8 {{(pid=72088) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:38:10 user devstack@n-api.service[72088]: DEBUG dbcounter [-] [72088] Writing DB stats nova_cell1:SELECT=21,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=72088) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:38:10 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-4d349c9f-78a1-4ebd-b7bf-ac3c08ae90f4 req-9a16fafc-a426-4484-a84c-4ae8eb5c3cf4 service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:38:10 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-4d349c9f-78a1-4ebd-b7bf-ac3c08ae90f4 req-9a16fafc-a426-4484-a84c-4ae8eb5c3cf4 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:38:10 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-4d349c9f-78a1-4ebd-b7bf-ac3c08ae90f4 req-9a16fafc-a426-4484-a84c-4ae8eb5c3cf4 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:38:10 user devstack@n-api.service[72088]: INFO nova.api.openstack.compute.server_external_events [req-4d349c9f-78a1-4ebd-b7bf-ac3c08ae90f4 req-9a16fafc-a426-4484-a84c-4ae8eb5c3cf4 service nova] Creating event network-changed:fd43e974-64b6-4605-83cb-11b9cfe58341 for instance d42dc0ea-4631-44be-8b58-09877280ba2e on user Apr 11 19:38:10 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [req-4d349c9f-78a1-4ebd-b7bf-ac3c08ae90f4 req-9a16fafc-a426-4484-a84c-4ae8eb5c3cf4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041028 Apr 11 19:38:10 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 251/767] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:38:10 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:38:10 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [None req-a3235533-ce8f-4c57-b19a-e7d4d89da1cf tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:38:10 user devstack@n-api.service[72090]: DEBUG nova.compute.api [None req-a3235533-ce8f-4c57-b19a-e7d4d89da1cf tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] [instance: d42dc0ea-4631-44be-8b58-09877280ba2e] Fetching instance by UUID {{(pid=72090) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:38:10 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-a3235533-ce8f-4c57-b19a-e7d4d89da1cf tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:38:10 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-a3235533-ce8f-4c57-b19a-e7d4d89da1cf tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:38:10 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-a3235533-ce8f-4c57-b19a-e7d4d89da1cf tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:38:10 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-a3235533-ce8f-4c57-b19a-e7d4d89da1cf tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:38:10 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-a3235533-ce8f-4c57-b19a-e7d4d89da1cf tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:38:10 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-a3235533-ce8f-4c57-b19a-e7d4d89da1cf tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:38:10 user devstack@n-api.service[72090]: DEBUG nova.objects.instance [None req-a3235533-ce8f-4c57-b19a-e7d4d89da1cf tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] Lazy-loading 'flavor' on Instance uuid d42dc0ea-4631-44be-8b58-09877280ba2e {{(pid=72090) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 11 19:38:10 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [None req-a3235533-ce8f-4c57-b19a-e7d4d89da1cf tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] 10.0.0.210 "POST /compute/v2.1/servers/d42dc0ea-4631-44be-8b58-09877280ba2e/action" status: 202 len: 0 microversion: 2.1 time: 0.127084 Apr 11 19:38:10 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 255/768] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Apr 11 19:38:10 2023] POST /compute/v2.1/servers/d42dc0ea-4631-44be-8b58-09877280ba2e/action => generated 0 bytes in 129 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 19:38:10 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [None req-7576fb27-fdc4-4b3b-803f-e9e3262c9990 tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] Calling method '>' {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:38:10 user devstack@n-api.service[72089]: DEBUG nova.compute.api [None req-7576fb27-fdc4-4b3b-803f-e9e3262c9990 tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] [instance: d42dc0ea-4631-44be-8b58-09877280ba2e] Fetching instance by UUID {{(pid=72089) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:38:10 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-7576fb27-fdc4-4b3b-803f-e9e3262c9990 tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:38:10 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-7576fb27-fdc4-4b3b-803f-e9e3262c9990 tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:38:10 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-7576fb27-fdc4-4b3b-803f-e9e3262c9990 tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:38:10 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-7576fb27-fdc4-4b3b-803f-e9e3262c9990 tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:38:10 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-7576fb27-fdc4-4b3b-803f-e9e3262c9990 tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:38:10 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-7576fb27-fdc4-4b3b-803f-e9e3262c9990 tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:38:10 user devstack@n-api.service[72089]: DEBUG nova.policy [None req-7576fb27-fdc4-4b3b-803f-e9e3262c9990 tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68fcdcd3af164195bf0c7da3b8dfecb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7b9baa081ca455ea6931b7801c805b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72089) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:38:10 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [None req-7576fb27-fdc4-4b3b-803f-e9e3262c9990 tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d42dc0ea-4631-44be-8b58-09877280ba2e" status: 200 len: 1437 microversion: 2.1 time: 0.247094 Apr 11 19:38:10 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 263/769] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 19:38:10 2023] GET /compute/v2.1/servers/d42dc0ea-4631-44be-8b58-09877280ba2e => generated 1437 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:38:12 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [req-89131a88-a31e-400a-be84-524c622b1d31 req-11f847e7-686a-4230-aa44-3359e17d870a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d42dc0ea-4631-44be-8b58-09877280ba2e", "name": "network-vif-unplugged", "status": "completed", "tag": "fd43e974-64b6-4605-83cb-11b9cfe58341"}, {"server_uuid": "d42dc0ea-4631-44be-8b58-09877280ba2e", "name": "network-vif-plugged", "status": "completed", "tag": "fd43e974-64b6-4605-83cb-11b9cfe58341"}]} {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:38:12 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-89131a88-a31e-400a-be84-524c622b1d31 req-11f847e7-686a-4230-aa44-3359e17d870a service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:38:12 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-89131a88-a31e-400a-be84-524c622b1d31 req-11f847e7-686a-4230-aa44-3359e17d870a service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:38:12 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-89131a88-a31e-400a-be84-524c622b1d31 req-11f847e7-686a-4230-aa44-3359e17d870a service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:38:12 user devstack@n-api.service[72088]: INFO nova.api.openstack.compute.server_external_events [req-89131a88-a31e-400a-be84-524c622b1d31 req-11f847e7-686a-4230-aa44-3359e17d870a service nova] Creating event network-vif-unplugged:fd43e974-64b6-4605-83cb-11b9cfe58341 for instance d42dc0ea-4631-44be-8b58-09877280ba2e on user Apr 11 19:38:12 user devstack@n-api.service[72088]: INFO nova.api.openstack.compute.server_external_events [req-89131a88-a31e-400a-be84-524c622b1d31 req-11f847e7-686a-4230-aa44-3359e17d870a service nova] Creating event network-vif-plugged:fd43e974-64b6-4605-83cb-11b9cfe58341 for instance d42dc0ea-4631-44be-8b58-09877280ba2e on user Apr 11 19:38:12 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [req-89131a88-a31e-400a-be84-524c622b1d31 req-11f847e7-686a-4230-aa44-3359e17d870a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.036760 Apr 11 19:38:12 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 252/770] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:38:12 2023] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 11 19:38:12 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [req-645006a8-f411-4c6c-98ec-36f81576ea85 req-d6c11e76-6736-4be0-ae8c-0fe04ad3762a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d42dc0ea-4631-44be-8b58-09877280ba2e", "tag": "fd43e974-64b6-4605-83cb-11b9cfe58341"}]} {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:38:12 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-645006a8-f411-4c6c-98ec-36f81576ea85 req-d6c11e76-6736-4be0-ae8c-0fe04ad3762a service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:38:12 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-645006a8-f411-4c6c-98ec-36f81576ea85 req-d6c11e76-6736-4be0-ae8c-0fe04ad3762a service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:38:12 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-645006a8-f411-4c6c-98ec-36f81576ea85 req-d6c11e76-6736-4be0-ae8c-0fe04ad3762a service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:38:12 user devstack@n-api.service[72090]: INFO nova.api.openstack.compute.server_external_events [req-645006a8-f411-4c6c-98ec-36f81576ea85 req-d6c11e76-6736-4be0-ae8c-0fe04ad3762a service nova] Creating event network-changed:fd43e974-64b6-4605-83cb-11b9cfe58341 for instance d42dc0ea-4631-44be-8b58-09877280ba2e on user Apr 11 19:38:12 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [req-645006a8-f411-4c6c-98ec-36f81576ea85 req-d6c11e76-6736-4be0-ae8c-0fe04ad3762a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036215 Apr 11 19:38:12 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 256/771] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:38:12 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:38:15 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [None req-19324837-0597-40e4-aee1-17320539ddc4 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Calling method '>' {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:38:15 user devstack@n-api.service[72089]: DEBUG nova.compute.api [None req-19324837-0597-40e4-aee1-17320539ddc4 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] [instance: 647674d8-af53-405a-8116-4b7a01549bdf] Fetching instance by UUID {{(pid=72089) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:38:15 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-19324837-0597-40e4-aee1-17320539ddc4 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:38:15 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-19324837-0597-40e4-aee1-17320539ddc4 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:38:15 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-19324837-0597-40e4-aee1-17320539ddc4 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:38:15 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-19324837-0597-40e4-aee1-17320539ddc4 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:38:15 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-19324837-0597-40e4-aee1-17320539ddc4 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:38:15 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-19324837-0597-40e4-aee1-17320539ddc4 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:38:15 user devstack@n-api.service[72089]: DEBUG nova.policy [None req-19324837-0597-40e4-aee1-17320539ddc4 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05fb551c320a48f98a4ec00a7f7492d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60a7381a31b84e97a068528f90813773', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72089) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:38:15 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [None req-19324837-0597-40e4-aee1-17320539ddc4 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] 10.0.0.210 "GET /compute/v2.1/servers/647674d8-af53-405a-8116-4b7a01549bdf" status: 200 len: 1723 microversion: 2.1 time: 0.169511 Apr 11 19:38:15 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 264/772] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 19:38:15 2023] GET /compute/v2.1/servers/647674d8-af53-405a-8116-4b7a01549bdf => generated 1723 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:38:16 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [None req-433add4f-9b90-43cf-87d8-7c1416ae3822 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Calling method '>' {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:38:16 user devstack@n-api.service[72088]: DEBUG nova.compute.api [None req-433add4f-9b90-43cf-87d8-7c1416ae3822 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] [instance: bd559e67-3c8f-42b4-b1d6-fd171c8850b8] Fetching instance by UUID {{(pid=72088) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:38:16 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-433add4f-9b90-43cf-87d8-7c1416ae3822 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:38:16 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-433add4f-9b90-43cf-87d8-7c1416ae3822 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:38:16 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-433add4f-9b90-43cf-87d8-7c1416ae3822 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:38:16 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-433add4f-9b90-43cf-87d8-7c1416ae3822 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:38:16 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-433add4f-9b90-43cf-87d8-7c1416ae3822 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:38:16 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-433add4f-9b90-43cf-87d8-7c1416ae3822 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:38:16 user devstack@n-api.service[72088]: INFO nova.api.openstack.wsgi [None req-433add4f-9b90-43cf-87d8-7c1416ae3822 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] HTTP exception thrown: Instance bd559e67-3c8f-42b4-b1d6-fd171c8850b8 could not be found. Apr 11 19:38:16 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [None req-433add4f-9b90-43cf-87d8-7c1416ae3822 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Request method failure captured: Apr 11 19:38:16 user devstack@n-api.service[72088]: request: GET /compute/v2.1/servers/bd559e67-3c8f-42b4-b1d6-fd171c8850b8 HTTP/1.1 Apr 11 19:38:16 user devstack@n-api.service[72088]: Accept: application/json Apr 11 19:38:16 user devstack@n-api.service[72088]: Accept-Encoding: identity Apr 11 19:38:16 user devstack@n-api.service[72088]: Connection: close Apr 11 19:38:16 user devstack@n-api.service[72088]: Content-Length: 0 Apr 11 19:38:16 user devstack@n-api.service[72088]: Content-Type: application/json Apr 11 19:38:16 user devstack@n-api.service[72088]: Host: 10.0.0.210 Apr 11 19:38:16 user devstack@n-api.service[72088]: Openstack-System-Scope: None Apr 11 19:38:16 user devstack@n-api.service[72088]: User-Agent: python-urllib3/1.26.15 Apr 11 19:38:16 user devstack@n-api.service[72088]: X-Auth-Token: gAAAAABkNbP8CMA9AeqH6ZTVBd6hPwyKW_mqzEk8TCy4_VwSHrn57Z_Bda3pQyUpuJX-ml6c86d6mPZr4tj0gPWVWRPU1qaBq_1kuRr0YmufsHHqiO99gy3dKVELLchOjYaKmeBKQQIjjUs9wfAR3HauKGrU7HoBmX3383Ea9RGxN47AXJGWJkA Apr 11 19:38:16 user devstack@n-api.service[72088]: X-Domain-Id: None Apr 11 19:38:16 user devstack@n-api.service[72088]: X-Domain-Name: None Apr 11 19:38:16 user devstack@n-api.service[72088]: X-Identity-Status: Confirmed Apr 11 19:38:16 user devstack@n-api.service[72088]: X-Is-Admin-Project: True Apr 11 19:38:16 user devstack@n-api.service[72088]: X-Project-Domain-Id: default Apr 11 19:38:16 user devstack@n-api.service[72088]: X-Project-Domain-Name: Default Apr 11 19:38:16 user devstack@n-api.service[72088]: X-Project-Id: d886d2ec5fc946b49af3c8ca7c8556c7 Apr 11 19:38:16 user devstack@n-api.service[72088]: X-Project-Name: tempest-AttachVolumeTestJSON-2144032498 Apr 11 19:38:16 user devstack@n-api.service[72088]: X-Role: reader,member Apr 11 19:38:16 user devstack@n-api.service[72088]: X-Roles: reader,member Apr 11 19:38:16 user devstack@n-api.service[72088]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d886d2ec5fc946b49af3c8ca7c8556c7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/d886d2ec5fc946b49af3c8ca7c8556c7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d886d2ec5fc946b49af3c8ca7c8556c7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 11 19:38:16 user devstack@n-api.service[72088]: X-Tenant: tempest-AttachVolumeTestJSON-2144032498 Apr 11 19:38:16 user devstack@n-api.service[72088]: X-Tenant-Id: d886d2ec5fc946b49af3c8ca7c8556c7 Apr 11 19:38:16 user devstack@n-api.service[72088]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2144032498 Apr 11 19:38:16 user devstack@n-api.service[72088]: X-User: tempest-AttachVolumeTestJSON-2144032498-project-member Apr 11 19:38:16 user devstack@n-api.service[72088]: X-User-Domain-Id: default Apr 11 19:38:16 user devstack@n-api.service[72088]: X-User-Domain-Name: Default Apr 11 19:38:16 user devstack@n-api.service[72088]: X-User-Id: 31c237e142784bd6aa460d6f1bf33400 Apr 11 19:38:16 user devstack@n-api.service[72088]: X-User-Name: tempest-AttachVolumeTestJSON-2144032498-project-member Apr 11 19:38:16 user devstack@n-api.service[72088]: method: > Apr 11 19:38:16 user devstack@n-api.service[72088]: exception: Instance bd559e67-3c8f-42b4-b1d6-fd171c8850b8 could not be found. Apr 11 19:38:16 user devstack@n-api.service[72088]: action_args: {'id': 'bd559e67-3c8f-42b4-b1d6-fd171c8850b8'} Apr 11 19:38:16 user devstack@n-api.service[72088]: {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 19:38:16 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:38:16 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 19:38:16 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 19:38:16 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 19:38:16 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 19:38:16 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 19:38:16 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 19:38:16 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 19:38:16 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 19:38:16 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bd559e67-3c8f-42b4-b1d6-fd171c8850b8 could not be found. Apr 11 19:38:16 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi Apr 11 19:38:16 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 19:38:16 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi Apr 11 19:38:16 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:38:16 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 19:38:16 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 19:38:16 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 19:38:16 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 19:38:16 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 19:38:16 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 19:38:16 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 19:38:16 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 19:38:16 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 19:38:16 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 19:38:16 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 19:38:16 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 19:38:16 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bd559e67-3c8f-42b4-b1d6-fd171c8850b8 could not be found. Apr 11 19:38:16 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi Apr 11 19:38:16 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 19:38:16 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi Apr 11 19:38:16 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:38:16 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 19:38:16 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 19:38:16 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 19:38:16 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 19:38:16 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bd559e67-3c8f-42b4-b1d6-fd171c8850b8 could not be found. Apr 11 19:38:16 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi Apr 11 19:38:16 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [None req-433add4f-9b90-43cf-87d8-7c1416ae3822 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Returning 404 to user: Instance bd559e67-3c8f-42b4-b1d6-fd171c8850b8 could not be found. {{(pid=72088) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 19:38:16 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [None req-433add4f-9b90-43cf-87d8-7c1416ae3822 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bd559e67-3c8f-42b4-b1d6-fd171c8850b8" status: 404 len: 111 microversion: 2.1 time: 0.035266 Apr 11 19:38:16 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 253/773] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 19:38:16 2023] GET /compute/v2.1/servers/bd559e67-3c8f-42b4-b1d6-fd171c8850b8 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 19:38:16 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [None req-a05cc676-f027-4ee0-b68f-e8e39de82ff7 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Action: 'create', calling method: .version_select at 0x7f119d907d90>, body: {"keypair": {"name": "tempest-keypair-1079379697", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOg6Hf94pVltDkkNWWRUkyDdm5FkHOFas15WTV4ELfursaPozu4TbpoIUk0HP0VHxjYdcQgsc8wfNgH6fYZasAgDxzJ8ujV0YM5uYIVaN2C0LA5O+gHU06Xkv+AxumfVcw=="}} {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:38:16 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [None req-89e96c10-8bca-4c18-b85a-c8e7221cbf7e tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Calling method '.version_select at 0x7f119d82d750>' {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:38:16 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [None req-89e96c10-8bca-4c18-b85a-c8e7221cbf7e tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1741457082" status: 202 len: 0 microversion: 2.1 time: 0.024856 Apr 11 19:38:16 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 265/774] 10.0.0.210 () {62 vars in 1298 bytes} [Tue Apr 11 19:38:16 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1741457082 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 19:38:16 user devstack@n-api.service[72090]: DEBUG nova.quota [None req-a05cc676-f027-4ee0-b68f-e8e39de82ff7 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Getting quotas for project b8e3a291c54b49db8e12a88ba41865e3. Resources: {'key_pairs'} {{(pid=72090) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 19:38:16 user devstack@n-api.service[72090]: DEBUG nova.quota [None req-a05cc676-f027-4ee0-b68f-e8e39de82ff7 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Getting quotas for user ba7f82b529e74d99838b6264b94d823b and project b8e3a291c54b49db8e12a88ba41865e3. Resources: {'key_pairs'} {{(pid=72090) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 19:38:16 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [None req-a05cc676-f027-4ee0-b68f-e8e39de82ff7 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.073556 Apr 11 19:38:16 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 257/775] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Apr 11 19:38:16 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:38:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [None req-c8f316cd-89ab-4376-876e-ab2f9149a71e tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1910984367", "imageRef": "4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "c1382921-467f-4bd9-a91e-24ffb75a9553"}], "security_groups": [{"name": "tempest-securitygroup--306927495"}], "key_name": "tempest-keypair-1079379697", "user_data": "}} {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:38:18 user devstack@n-api.service[72088]: DEBUG nova.network.neutron [None req-c8f316cd-89ab-4376-876e-ab2f9149a71e tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] validate_networks() for [('c1382921-467f-4bd9-a91e-24ffb75a9553', None, None, None, None, None)] {{(pid=72088) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 11 19:38:18 user devstack@n-api.service[72088]: DEBUG nova.virt.hardware [None req-c8f316cd-89ab-4376-876e-ab2f9149a71e tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Flavor limits 0:0:0 {{(pid=72088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 19:38:18 user devstack@n-api.service[72088]: DEBUG nova.virt.hardware [None req-c8f316cd-89ab-4376-876e-ab2f9149a71e tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Image limits 0:0:0 {{(pid=72088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 19:38:18 user devstack@n-api.service[72088]: DEBUG nova.virt.hardware [None req-c8f316cd-89ab-4376-876e-ab2f9149a71e tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Flavor pref 0:0:0 {{(pid=72088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 19:38:18 user devstack@n-api.service[72088]: DEBUG nova.virt.hardware [None req-c8f316cd-89ab-4376-876e-ab2f9149a71e tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Image pref 0:0:0 {{(pid=72088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 19:38:18 user devstack@n-api.service[72088]: DEBUG nova.virt.hardware [None req-c8f316cd-89ab-4376-876e-ab2f9149a71e tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 19:38:18 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-c8f316cd-89ab-4376-876e-ab2f9149a71e tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:38:18 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-c8f316cd-89ab-4376-876e-ab2f9149a71e tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:38:18 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-c8f316cd-89ab-4376-876e-ab2f9149a71e tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:38:18 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-c8f316cd-89ab-4376-876e-ab2f9149a71e tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:38:18 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-c8f316cd-89ab-4376-876e-ab2f9149a71e tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:38:18 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-c8f316cd-89ab-4376-876e-ab2f9149a71e tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:38:18 user devstack@n-api.service[72088]: DEBUG nova.quota [None req-c8f316cd-89ab-4376-876e-ab2f9149a71e tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Getting quotas for project b8e3a291c54b49db8e12a88ba41865e3. Resources: {'ram', 'instances', 'cores'} {{(pid=72088) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 19:38:18 user devstack@n-api.service[72088]: DEBUG nova.quota [None req-c8f316cd-89ab-4376-876e-ab2f9149a71e tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Getting quotas for user ba7f82b529e74d99838b6264b94d823b and project b8e3a291c54b49db8e12a88ba41865e3. Resources: {'ram', 'instances', 'cores'} {{(pid=72088) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 19:38:18 user devstack@n-api.service[72088]: DEBUG nova.compute.api [None req-c8f316cd-89ab-4376-876e-ab2f9149a71e tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Going to run 1 instances... {{(pid=72088) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 11 19:38:18 user devstack@n-api.service[72088]: DEBUG nova.compute.api [None req-c8f316cd-89ab-4376-876e-ab2f9149a71e tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] [instance: bf0a75f5-2f44-4687-af12-046f6761fee2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=72088) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 11 19:38:18 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [None req-c8f316cd-89ab-4376-876e-ab2f9149a71e tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.622193 Apr 11 19:38:18 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 254/776] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 11 19:38:17 2023] POST /compute/v2.1/servers => generated 406 bytes in 624 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 11 19:38:18 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [None req-0cbbc273-607e-4398-a9b7-737c092514b9 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Calling method '>' {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:38:18 user devstack@n-api.service[72089]: DEBUG nova.compute.api [None req-0cbbc273-607e-4398-a9b7-737c092514b9 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] [instance: bf0a75f5-2f44-4687-af12-046f6761fee2] Fetching instance by UUID {{(pid=72089) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:38:18 user devstack@n-api.service[72089]: DEBUG nova.policy [None req-0cbbc273-607e-4398-a9b7-737c092514b9 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba7f82b529e74d99838b6264b94d823b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e3a291c54b49db8e12a88ba41865e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72089) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:38:18 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [None req-0cbbc273-607e-4398-a9b7-737c092514b9 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bf0a75f5-2f44-4687-af12-046f6761fee2" status: 200 len: 1240 microversion: 2.1 time: 0.073779 Apr 11 19:38:18 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 266/777] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 19:38:18 2023] GET /compute/v2.1/servers/bf0a75f5-2f44-4687-af12-046f6761fee2 => generated 1240 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:38:19 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [None req-7dc49351-ea0e-45e7-83d6-6a51f2b0f450 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Calling method '>' {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:38:19 user devstack@n-api.service[72090]: DEBUG nova.compute.api [None req-7dc49351-ea0e-45e7-83d6-6a51f2b0f450 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] [instance: bd559e67-3c8f-42b4-b1d6-fd171c8850b8] Fetching instance by UUID {{(pid=72090) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:38:19 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-7dc49351-ea0e-45e7-83d6-6a51f2b0f450 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:38:19 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-7dc49351-ea0e-45e7-83d6-6a51f2b0f450 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:38:19 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-7dc49351-ea0e-45e7-83d6-6a51f2b0f450 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:38:19 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-7dc49351-ea0e-45e7-83d6-6a51f2b0f450 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:38:19 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-7dc49351-ea0e-45e7-83d6-6a51f2b0f450 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:38:19 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-7dc49351-ea0e-45e7-83d6-6a51f2b0f450 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:38:19 user devstack@n-api.service[72090]: INFO nova.api.openstack.wsgi [None req-7dc49351-ea0e-45e7-83d6-6a51f2b0f450 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] HTTP exception thrown: Instance bd559e67-3c8f-42b4-b1d6-fd171c8850b8 could not be found. Apr 11 19:38:19 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [None req-7dc49351-ea0e-45e7-83d6-6a51f2b0f450 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Request method failure captured: Apr 11 19:38:19 user devstack@n-api.service[72090]: request: DELETE /compute/v2.1/servers/bd559e67-3c8f-42b4-b1d6-fd171c8850b8 HTTP/1.1 Apr 11 19:38:19 user devstack@n-api.service[72090]: Accept: application/json Apr 11 19:38:19 user devstack@n-api.service[72090]: Accept-Encoding: identity Apr 11 19:38:19 user devstack@n-api.service[72090]: Connection: close Apr 11 19:38:19 user devstack@n-api.service[72090]: Content-Length: 0 Apr 11 19:38:19 user devstack@n-api.service[72090]: Content-Type: application/json Apr 11 19:38:19 user devstack@n-api.service[72090]: Host: 10.0.0.210 Apr 11 19:38:19 user devstack@n-api.service[72090]: Openstack-System-Scope: None Apr 11 19:38:19 user devstack@n-api.service[72090]: User-Agent: python-urllib3/1.26.15 Apr 11 19:38:19 user devstack@n-api.service[72090]: X-Auth-Token: gAAAAABkNbP8CMA9AeqH6ZTVBd6hPwyKW_mqzEk8TCy4_VwSHrn57Z_Bda3pQyUpuJX-ml6c86d6mPZr4tj0gPWVWRPU1qaBq_1kuRr0YmufsHHqiO99gy3dKVELLchOjYaKmeBKQQIjjUs9wfAR3HauKGrU7HoBmX3383Ea9RGxN47AXJGWJkA Apr 11 19:38:19 user devstack@n-api.service[72090]: X-Domain-Id: None Apr 11 19:38:19 user devstack@n-api.service[72090]: X-Domain-Name: None Apr 11 19:38:19 user devstack@n-api.service[72090]: X-Identity-Status: Confirmed Apr 11 19:38:19 user devstack@n-api.service[72090]: X-Is-Admin-Project: True Apr 11 19:38:19 user devstack@n-api.service[72090]: X-Project-Domain-Id: default Apr 11 19:38:19 user devstack@n-api.service[72090]: X-Project-Domain-Name: Default Apr 11 19:38:19 user devstack@n-api.service[72090]: X-Project-Id: d886d2ec5fc946b49af3c8ca7c8556c7 Apr 11 19:38:19 user devstack@n-api.service[72090]: X-Project-Name: tempest-AttachVolumeTestJSON-2144032498 Apr 11 19:38:19 user devstack@n-api.service[72090]: X-Role: reader,member Apr 11 19:38:19 user devstack@n-api.service[72090]: X-Roles: reader,member Apr 11 19:38:19 user devstack@n-api.service[72090]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d886d2ec5fc946b49af3c8ca7c8556c7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/d886d2ec5fc946b49af3c8ca7c8556c7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d886d2ec5fc946b49af3c8ca7c8556c7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 11 19:38:19 user devstack@n-api.service[72090]: X-Tenant: tempest-AttachVolumeTestJSON-2144032498 Apr 11 19:38:19 user devstack@n-api.service[72090]: X-Tenant-Id: d886d2ec5fc946b49af3c8ca7c8556c7 Apr 11 19:38:19 user devstack@n-api.service[72090]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2144032498 Apr 11 19:38:19 user devstack@n-api.service[72090]: X-User: tempest-AttachVolumeTestJSON-2144032498-project-member Apr 11 19:38:19 user devstack@n-api.service[72090]: X-User-Domain-Id: default Apr 11 19:38:19 user devstack@n-api.service[72090]: X-User-Domain-Name: Default Apr 11 19:38:19 user devstack@n-api.service[72090]: X-User-Id: 31c237e142784bd6aa460d6f1bf33400 Apr 11 19:38:19 user devstack@n-api.service[72090]: X-User-Name: tempest-AttachVolumeTestJSON-2144032498-project-member Apr 11 19:38:19 user devstack@n-api.service[72090]: method: > Apr 11 19:38:19 user devstack@n-api.service[72090]: exception: Instance bd559e67-3c8f-42b4-b1d6-fd171c8850b8 could not be found. Apr 11 19:38:19 user devstack@n-api.service[72090]: action_args: {'id': 'bd559e67-3c8f-42b4-b1d6-fd171c8850b8'} Apr 11 19:38:19 user devstack@n-api.service[72090]: {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 19:38:19 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:38:19 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 19:38:19 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 19:38:19 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 19:38:19 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 19:38:19 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 19:38:19 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 19:38:19 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 19:38:19 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 19:38:19 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bd559e67-3c8f-42b4-b1d6-fd171c8850b8 could not be found. Apr 11 19:38:19 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi Apr 11 19:38:19 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 19:38:19 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi Apr 11 19:38:19 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:38:19 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 19:38:19 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 19:38:19 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 19:38:19 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 19:38:19 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 19:38:19 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 19:38:19 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 11 19:38:19 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 11 19:38:19 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 11 19:38:19 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 11 19:38:19 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 19:38:19 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 19:38:19 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 19:38:19 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 19:38:19 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bd559e67-3c8f-42b4-b1d6-fd171c8850b8 could not be found. Apr 11 19:38:19 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi Apr 11 19:38:19 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 19:38:19 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi Apr 11 19:38:19 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:38:19 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 19:38:19 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 19:38:19 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 19:38:19 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 19:38:19 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bd559e67-3c8f-42b4-b1d6-fd171c8850b8 could not be found. Apr 11 19:38:19 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi Apr 11 19:38:19 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [None req-7dc49351-ea0e-45e7-83d6-6a51f2b0f450 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Returning 404 to user: Instance bd559e67-3c8f-42b4-b1d6-fd171c8850b8 could not be found. {{(pid=72090) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 19:38:19 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [None req-7dc49351-ea0e-45e7-83d6-6a51f2b0f450 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/bd559e67-3c8f-42b4-b1d6-fd171c8850b8" status: 404 len: 111 microversion: 2.1 time: 0.131351 Apr 11 19:38:19 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 258/778] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 19:38:19 2023] DELETE /compute/v2.1/servers/bd559e67-3c8f-42b4-b1d6-fd171c8850b8 => generated 111 bytes in 132 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 19:38:19 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [None req-c57dcdd5-b626-4ed6-a0c4-37db18364702 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Calling method '>' {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:38:19 user devstack@n-api.service[72088]: DEBUG nova.compute.api [None req-c57dcdd5-b626-4ed6-a0c4-37db18364702 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] [instance: bd559e67-3c8f-42b4-b1d6-fd171c8850b8] Fetching instance by UUID {{(pid=72088) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:38:19 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-c57dcdd5-b626-4ed6-a0c4-37db18364702 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:38:19 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-c57dcdd5-b626-4ed6-a0c4-37db18364702 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:38:19 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-c57dcdd5-b626-4ed6-a0c4-37db18364702 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:38:19 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-c57dcdd5-b626-4ed6-a0c4-37db18364702 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:38:19 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-c57dcdd5-b626-4ed6-a0c4-37db18364702 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:38:19 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-c57dcdd5-b626-4ed6-a0c4-37db18364702 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:38:19 user devstack@n-api.service[72088]: INFO nova.api.openstack.wsgi [None req-c57dcdd5-b626-4ed6-a0c4-37db18364702 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] HTTP exception thrown: Instance bd559e67-3c8f-42b4-b1d6-fd171c8850b8 could not be found. Apr 11 19:38:19 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [None req-c57dcdd5-b626-4ed6-a0c4-37db18364702 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Request method failure captured: Apr 11 19:38:19 user devstack@n-api.service[72088]: request: GET /compute/v2.1/servers/bd559e67-3c8f-42b4-b1d6-fd171c8850b8 HTTP/1.1 Apr 11 19:38:19 user devstack@n-api.service[72088]: Accept: application/json Apr 11 19:38:19 user devstack@n-api.service[72088]: Accept-Encoding: identity Apr 11 19:38:19 user devstack@n-api.service[72088]: Connection: close Apr 11 19:38:19 user devstack@n-api.service[72088]: Content-Length: 0 Apr 11 19:38:19 user devstack@n-api.service[72088]: Content-Type: application/json Apr 11 19:38:19 user devstack@n-api.service[72088]: Host: 10.0.0.210 Apr 11 19:38:19 user devstack@n-api.service[72088]: Openstack-System-Scope: None Apr 11 19:38:19 user devstack@n-api.service[72088]: User-Agent: python-urllib3/1.26.15 Apr 11 19:38:19 user devstack@n-api.service[72088]: X-Auth-Token: gAAAAABkNbP8CMA9AeqH6ZTVBd6hPwyKW_mqzEk8TCy4_VwSHrn57Z_Bda3pQyUpuJX-ml6c86d6mPZr4tj0gPWVWRPU1qaBq_1kuRr0YmufsHHqiO99gy3dKVELLchOjYaKmeBKQQIjjUs9wfAR3HauKGrU7HoBmX3383Ea9RGxN47AXJGWJkA Apr 11 19:38:19 user devstack@n-api.service[72088]: X-Domain-Id: None Apr 11 19:38:19 user devstack@n-api.service[72088]: X-Domain-Name: None Apr 11 19:38:19 user devstack@n-api.service[72088]: X-Identity-Status: Confirmed Apr 11 19:38:19 user devstack@n-api.service[72088]: X-Is-Admin-Project: True Apr 11 19:38:19 user devstack@n-api.service[72088]: X-Project-Domain-Id: default Apr 11 19:38:19 user devstack@n-api.service[72088]: X-Project-Domain-Name: Default Apr 11 19:38:19 user devstack@n-api.service[72088]: X-Project-Id: d886d2ec5fc946b49af3c8ca7c8556c7 Apr 11 19:38:19 user devstack@n-api.service[72088]: X-Project-Name: tempest-AttachVolumeTestJSON-2144032498 Apr 11 19:38:19 user devstack@n-api.service[72088]: X-Role: reader,member Apr 11 19:38:19 user devstack@n-api.service[72088]: X-Roles: reader,member Apr 11 19:38:19 user devstack@n-api.service[72088]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d886d2ec5fc946b49af3c8ca7c8556c7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/d886d2ec5fc946b49af3c8ca7c8556c7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d886d2ec5fc946b49af3c8ca7c8556c7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 11 19:38:19 user devstack@n-api.service[72088]: X-Tenant: tempest-AttachVolumeTestJSON-2144032498 Apr 11 19:38:19 user devstack@n-api.service[72088]: X-Tenant-Id: d886d2ec5fc946b49af3c8ca7c8556c7 Apr 11 19:38:19 user devstack@n-api.service[72088]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2144032498 Apr 11 19:38:19 user devstack@n-api.service[72088]: X-User: tempest-AttachVolumeTestJSON-2144032498-project-member Apr 11 19:38:19 user devstack@n-api.service[72088]: X-User-Domain-Id: default Apr 11 19:38:19 user devstack@n-api.service[72088]: X-User-Domain-Name: Default Apr 11 19:38:19 user devstack@n-api.service[72088]: X-User-Id: 31c237e142784bd6aa460d6f1bf33400 Apr 11 19:38:19 user devstack@n-api.service[72088]: X-User-Name: tempest-AttachVolumeTestJSON-2144032498-project-member Apr 11 19:38:19 user devstack@n-api.service[72088]: method: > Apr 11 19:38:19 user devstack@n-api.service[72088]: exception: Instance bd559e67-3c8f-42b4-b1d6-fd171c8850b8 could not be found. Apr 11 19:38:19 user devstack@n-api.service[72088]: action_args: {'id': 'bd559e67-3c8f-42b4-b1d6-fd171c8850b8'} Apr 11 19:38:19 user devstack@n-api.service[72088]: {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 19:38:19 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:38:19 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 19:38:19 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 19:38:19 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 19:38:19 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 19:38:19 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 19:38:19 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 19:38:19 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 19:38:19 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 19:38:19 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bd559e67-3c8f-42b4-b1d6-fd171c8850b8 could not be found. Apr 11 19:38:19 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi Apr 11 19:38:19 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 19:38:19 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi Apr 11 19:38:19 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:38:19 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 19:38:19 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 19:38:19 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 19:38:19 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 19:38:19 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 19:38:19 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 19:38:19 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 19:38:19 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 19:38:19 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 19:38:19 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 19:38:19 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 19:38:19 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 19:38:19 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bd559e67-3c8f-42b4-b1d6-fd171c8850b8 could not be found. Apr 11 19:38:19 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi Apr 11 19:38:19 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 19:38:19 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi Apr 11 19:38:19 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:38:19 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 19:38:19 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 19:38:19 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 19:38:19 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 19:38:19 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bd559e67-3c8f-42b4-b1d6-fd171c8850b8 could not be found. Apr 11 19:38:19 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi Apr 11 19:38:19 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [None req-c57dcdd5-b626-4ed6-a0c4-37db18364702 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Returning 404 to user: Instance bd559e67-3c8f-42b4-b1d6-fd171c8850b8 could not be found. {{(pid=72088) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 19:38:19 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [None req-c57dcdd5-b626-4ed6-a0c4-37db18364702 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bd559e67-3c8f-42b4-b1d6-fd171c8850b8" status: 404 len: 111 microversion: 2.1 time: 0.050368 Apr 11 19:38:19 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 255/779] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 19:38:19 2023] GET /compute/v2.1/servers/bd559e67-3c8f-42b4-b1d6-fd171c8850b8 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 19:38:21 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [req-3b3b7f34-c7d7-45a1-a3e6-1c6fd86652da req-9653c022-8433-4b52-85df-2706ba3cbc38 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bf0a75f5-2f44-4687-af12-046f6761fee2", "tag": "c662b1b3-b2b3-4502-81af-9afdf3e591dc"}]} {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:38:21 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-3b3b7f34-c7d7-45a1-a3e6-1c6fd86652da req-9653c022-8433-4b52-85df-2706ba3cbc38 service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:38:21 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-3b3b7f34-c7d7-45a1-a3e6-1c6fd86652da req-9653c022-8433-4b52-85df-2706ba3cbc38 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:38:21 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-3b3b7f34-c7d7-45a1-a3e6-1c6fd86652da req-9653c022-8433-4b52-85df-2706ba3cbc38 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:38:21 user devstack@n-api.service[72089]: INFO nova.api.openstack.compute.server_external_events [req-3b3b7f34-c7d7-45a1-a3e6-1c6fd86652da req-9653c022-8433-4b52-85df-2706ba3cbc38 service nova] Creating event network-changed:c662b1b3-b2b3-4502-81af-9afdf3e591dc for instance bf0a75f5-2f44-4687-af12-046f6761fee2 on user Apr 11 19:38:21 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [req-3b3b7f34-c7d7-45a1-a3e6-1c6fd86652da req-9653c022-8433-4b52-85df-2706ba3cbc38 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034530 Apr 11 19:38:21 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 267/780] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:38:21 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:38:21 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [None req-4027f71f-032c-409e-abe8-db5f34c89271 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Calling method '>' {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:38:21 user devstack@n-api.service[72090]: DEBUG nova.compute.api [None req-4027f71f-032c-409e-abe8-db5f34c89271 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] [instance: 6802f099-9236-4c79-a892-2963f1b15b0e] Fetching instance by UUID {{(pid=72090) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:38:21 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-4027f71f-032c-409e-abe8-db5f34c89271 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:38:21 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-4027f71f-032c-409e-abe8-db5f34c89271 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:38:21 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-4027f71f-032c-409e-abe8-db5f34c89271 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:38:21 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-4027f71f-032c-409e-abe8-db5f34c89271 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:38:21 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-4027f71f-032c-409e-abe8-db5f34c89271 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:38:21 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-4027f71f-032c-409e-abe8-db5f34c89271 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:38:22 user devstack@n-api.service[72090]: INFO nova.api.openstack.wsgi [None req-4027f71f-032c-409e-abe8-db5f34c89271 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] HTTP exception thrown: Instance 6802f099-9236-4c79-a892-2963f1b15b0e could not be found. Apr 11 19:38:22 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [None req-4027f71f-032c-409e-abe8-db5f34c89271 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Request method failure captured: Apr 11 19:38:22 user devstack@n-api.service[72090]: request: DELETE /compute/v2.1/servers/6802f099-9236-4c79-a892-2963f1b15b0e HTTP/1.1 Apr 11 19:38:22 user devstack@n-api.service[72090]: Accept: application/json Apr 11 19:38:22 user devstack@n-api.service[72090]: Accept-Encoding: identity Apr 11 19:38:22 user devstack@n-api.service[72090]: Connection: close Apr 11 19:38:22 user devstack@n-api.service[72090]: Content-Length: 0 Apr 11 19:38:22 user devstack@n-api.service[72090]: Content-Type: application/json Apr 11 19:38:22 user devstack@n-api.service[72090]: Host: 10.0.0.210 Apr 11 19:38:22 user devstack@n-api.service[72090]: Openstack-System-Scope: None Apr 11 19:38:22 user devstack@n-api.service[72090]: User-Agent: python-urllib3/1.26.15 Apr 11 19:38:22 user devstack@n-api.service[72090]: X-Auth-Token: gAAAAABkNbP8CMA9AeqH6ZTVBd6hPwyKW_mqzEk8TCy4_VwSHrn57Z_Bda3pQyUpuJX-ml6c86d6mPZr4tj0gPWVWRPU1qaBq_1kuRr0YmufsHHqiO99gy3dKVELLchOjYaKmeBKQQIjjUs9wfAR3HauKGrU7HoBmX3383Ea9RGxN47AXJGWJkA Apr 11 19:38:22 user devstack@n-api.service[72090]: X-Domain-Id: None Apr 11 19:38:22 user devstack@n-api.service[72090]: X-Domain-Name: None Apr 11 19:38:22 user devstack@n-api.service[72090]: X-Identity-Status: Confirmed Apr 11 19:38:22 user devstack@n-api.service[72090]: X-Is-Admin-Project: True Apr 11 19:38:22 user devstack@n-api.service[72090]: X-Project-Domain-Id: default Apr 11 19:38:22 user devstack@n-api.service[72090]: X-Project-Domain-Name: Default Apr 11 19:38:22 user devstack@n-api.service[72090]: X-Project-Id: d886d2ec5fc946b49af3c8ca7c8556c7 Apr 11 19:38:22 user devstack@n-api.service[72090]: X-Project-Name: tempest-AttachVolumeTestJSON-2144032498 Apr 11 19:38:22 user devstack@n-api.service[72090]: X-Role: reader,member Apr 11 19:38:22 user devstack@n-api.service[72090]: X-Roles: reader,member Apr 11 19:38:22 user devstack@n-api.service[72090]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d886d2ec5fc946b49af3c8ca7c8556c7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/d886d2ec5fc946b49af3c8ca7c8556c7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d886d2ec5fc946b49af3c8ca7c8556c7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 11 19:38:22 user devstack@n-api.service[72090]: X-Tenant: tempest-AttachVolumeTestJSON-2144032498 Apr 11 19:38:22 user devstack@n-api.service[72090]: X-Tenant-Id: d886d2ec5fc946b49af3c8ca7c8556c7 Apr 11 19:38:22 user devstack@n-api.service[72090]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2144032498 Apr 11 19:38:22 user devstack@n-api.service[72090]: X-User: tempest-AttachVolumeTestJSON-2144032498-project-member Apr 11 19:38:22 user devstack@n-api.service[72090]: X-User-Domain-Id: default Apr 11 19:38:22 user devstack@n-api.service[72090]: X-User-Domain-Name: Default Apr 11 19:38:22 user devstack@n-api.service[72090]: X-User-Id: 31c237e142784bd6aa460d6f1bf33400 Apr 11 19:38:22 user devstack@n-api.service[72090]: X-User-Name: tempest-AttachVolumeTestJSON-2144032498-project-member Apr 11 19:38:22 user devstack@n-api.service[72090]: method: > Apr 11 19:38:22 user devstack@n-api.service[72090]: exception: Instance 6802f099-9236-4c79-a892-2963f1b15b0e could not be found. Apr 11 19:38:22 user devstack@n-api.service[72090]: action_args: {'id': '6802f099-9236-4c79-a892-2963f1b15b0e'} Apr 11 19:38:22 user devstack@n-api.service[72090]: {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 19:38:22 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:38:22 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 19:38:22 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 19:38:22 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 19:38:22 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 19:38:22 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 19:38:22 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 19:38:22 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 19:38:22 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 19:38:22 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6802f099-9236-4c79-a892-2963f1b15b0e could not be found. Apr 11 19:38:22 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi Apr 11 19:38:22 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 19:38:22 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi Apr 11 19:38:22 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:38:22 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 19:38:22 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 19:38:22 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 19:38:22 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 19:38:22 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 19:38:22 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 19:38:22 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 11 19:38:22 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 11 19:38:22 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 11 19:38:22 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 11 19:38:22 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 19:38:22 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 19:38:22 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 19:38:22 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 19:38:22 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6802f099-9236-4c79-a892-2963f1b15b0e could not be found. Apr 11 19:38:22 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi Apr 11 19:38:22 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 19:38:22 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi Apr 11 19:38:22 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:38:22 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 19:38:22 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 19:38:22 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 19:38:22 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 19:38:22 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6802f099-9236-4c79-a892-2963f1b15b0e could not be found. Apr 11 19:38:22 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi Apr 11 19:38:22 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [None req-4027f71f-032c-409e-abe8-db5f34c89271 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Returning 404 to user: Instance 6802f099-9236-4c79-a892-2963f1b15b0e could not be found. {{(pid=72090) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 19:38:22 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [None req-4027f71f-032c-409e-abe8-db5f34c89271 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/6802f099-9236-4c79-a892-2963f1b15b0e" status: 404 len: 111 microversion: 2.1 time: 0.342626 Apr 11 19:38:22 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 259/781] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 19:38:21 2023] DELETE /compute/v2.1/servers/6802f099-9236-4c79-a892-2963f1b15b0e => generated 111 bytes in 344 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 19:38:22 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [None req-f8002a3f-9299-451c-83fc-ea3727746fe6 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Calling method '>' {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:38:22 user devstack@n-api.service[72088]: DEBUG nova.compute.api [None req-f8002a3f-9299-451c-83fc-ea3727746fe6 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] [instance: 6802f099-9236-4c79-a892-2963f1b15b0e] Fetching instance by UUID {{(pid=72088) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:38:22 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-f8002a3f-9299-451c-83fc-ea3727746fe6 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:38:22 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-f8002a3f-9299-451c-83fc-ea3727746fe6 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:38:22 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-f8002a3f-9299-451c-83fc-ea3727746fe6 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:38:22 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-f8002a3f-9299-451c-83fc-ea3727746fe6 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:38:22 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-f8002a3f-9299-451c-83fc-ea3727746fe6 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:38:22 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-f8002a3f-9299-451c-83fc-ea3727746fe6 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:38:22 user devstack@n-api.service[72088]: INFO nova.api.openstack.wsgi [None req-f8002a3f-9299-451c-83fc-ea3727746fe6 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] HTTP exception thrown: Instance 6802f099-9236-4c79-a892-2963f1b15b0e could not be found. Apr 11 19:38:22 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [None req-f8002a3f-9299-451c-83fc-ea3727746fe6 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Request method failure captured: Apr 11 19:38:22 user devstack@n-api.service[72088]: request: GET /compute/v2.1/servers/6802f099-9236-4c79-a892-2963f1b15b0e HTTP/1.1 Apr 11 19:38:22 user devstack@n-api.service[72088]: Accept: application/json Apr 11 19:38:22 user devstack@n-api.service[72088]: Accept-Encoding: identity Apr 11 19:38:22 user devstack@n-api.service[72088]: Connection: close Apr 11 19:38:22 user devstack@n-api.service[72088]: Content-Length: 0 Apr 11 19:38:22 user devstack@n-api.service[72088]: Content-Type: application/json Apr 11 19:38:22 user devstack@n-api.service[72088]: Host: 10.0.0.210 Apr 11 19:38:22 user devstack@n-api.service[72088]: Openstack-System-Scope: None Apr 11 19:38:22 user devstack@n-api.service[72088]: User-Agent: python-urllib3/1.26.15 Apr 11 19:38:22 user devstack@n-api.service[72088]: X-Auth-Token: gAAAAABkNbP8CMA9AeqH6ZTVBd6hPwyKW_mqzEk8TCy4_VwSHrn57Z_Bda3pQyUpuJX-ml6c86d6mPZr4tj0gPWVWRPU1qaBq_1kuRr0YmufsHHqiO99gy3dKVELLchOjYaKmeBKQQIjjUs9wfAR3HauKGrU7HoBmX3383Ea9RGxN47AXJGWJkA Apr 11 19:38:22 user devstack@n-api.service[72088]: X-Domain-Id: None Apr 11 19:38:22 user devstack@n-api.service[72088]: X-Domain-Name: None Apr 11 19:38:22 user devstack@n-api.service[72088]: X-Identity-Status: Confirmed Apr 11 19:38:22 user devstack@n-api.service[72088]: X-Is-Admin-Project: True Apr 11 19:38:22 user devstack@n-api.service[72088]: X-Project-Domain-Id: default Apr 11 19:38:22 user devstack@n-api.service[72088]: X-Project-Domain-Name: Default Apr 11 19:38:22 user devstack@n-api.service[72088]: X-Project-Id: d886d2ec5fc946b49af3c8ca7c8556c7 Apr 11 19:38:22 user devstack@n-api.service[72088]: X-Project-Name: tempest-AttachVolumeTestJSON-2144032498 Apr 11 19:38:22 user devstack@n-api.service[72088]: X-Role: reader,member Apr 11 19:38:22 user devstack@n-api.service[72088]: X-Roles: reader,member Apr 11 19:38:22 user devstack@n-api.service[72088]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d886d2ec5fc946b49af3c8ca7c8556c7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/d886d2ec5fc946b49af3c8ca7c8556c7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d886d2ec5fc946b49af3c8ca7c8556c7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 11 19:38:22 user devstack@n-api.service[72088]: X-Tenant: tempest-AttachVolumeTestJSON-2144032498 Apr 11 19:38:22 user devstack@n-api.service[72088]: X-Tenant-Id: d886d2ec5fc946b49af3c8ca7c8556c7 Apr 11 19:38:22 user devstack@n-api.service[72088]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2144032498 Apr 11 19:38:22 user devstack@n-api.service[72088]: X-User: tempest-AttachVolumeTestJSON-2144032498-project-member Apr 11 19:38:22 user devstack@n-api.service[72088]: X-User-Domain-Id: default Apr 11 19:38:22 user devstack@n-api.service[72088]: X-User-Domain-Name: Default Apr 11 19:38:22 user devstack@n-api.service[72088]: X-User-Id: 31c237e142784bd6aa460d6f1bf33400 Apr 11 19:38:22 user devstack@n-api.service[72088]: X-User-Name: tempest-AttachVolumeTestJSON-2144032498-project-member Apr 11 19:38:22 user devstack@n-api.service[72088]: method: > Apr 11 19:38:22 user devstack@n-api.service[72088]: exception: Instance 6802f099-9236-4c79-a892-2963f1b15b0e could not be found. Apr 11 19:38:22 user devstack@n-api.service[72088]: action_args: {'id': '6802f099-9236-4c79-a892-2963f1b15b0e'} Apr 11 19:38:22 user devstack@n-api.service[72088]: {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 19:38:22 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:38:22 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 19:38:22 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 19:38:22 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 19:38:22 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 19:38:22 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 19:38:22 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 19:38:22 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 19:38:22 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 19:38:22 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6802f099-9236-4c79-a892-2963f1b15b0e could not be found. Apr 11 19:38:22 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi Apr 11 19:38:22 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 19:38:22 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi Apr 11 19:38:22 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:38:22 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 19:38:22 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 19:38:22 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 19:38:22 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 19:38:22 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 19:38:22 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 19:38:22 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 19:38:22 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 19:38:22 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 19:38:22 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 19:38:22 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 19:38:22 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 19:38:22 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6802f099-9236-4c79-a892-2963f1b15b0e could not be found. Apr 11 19:38:22 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi Apr 11 19:38:22 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 19:38:22 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi Apr 11 19:38:22 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:38:22 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 19:38:22 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 19:38:22 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 19:38:22 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 19:38:22 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6802f099-9236-4c79-a892-2963f1b15b0e could not be found. Apr 11 19:38:22 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi Apr 11 19:38:22 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [None req-f8002a3f-9299-451c-83fc-ea3727746fe6 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Returning 404 to user: Instance 6802f099-9236-4c79-a892-2963f1b15b0e could not be found. {{(pid=72088) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 19:38:22 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [None req-f8002a3f-9299-451c-83fc-ea3727746fe6 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6802f099-9236-4c79-a892-2963f1b15b0e" status: 404 len: 111 microversion: 2.1 time: 0.028307 Apr 11 19:38:22 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 256/782] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 19:38:22 2023] GET /compute/v2.1/servers/6802f099-9236-4c79-a892-2963f1b15b0e => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 19:38:24 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [req-acafccee-7f91-43a3-baaa-f5e201c954de req-96e56674-7019-425c-b55b-8902448348b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf0a75f5-2f44-4687-af12-046f6761fee2", "name": "network-vif-plugged", "status": "completed", "tag": "c662b1b3-b2b3-4502-81af-9afdf3e591dc"}]} {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:38:24 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-acafccee-7f91-43a3-baaa-f5e201c954de req-96e56674-7019-425c-b55b-8902448348b3 service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:38:24 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-acafccee-7f91-43a3-baaa-f5e201c954de req-96e56674-7019-425c-b55b-8902448348b3 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:38:24 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-acafccee-7f91-43a3-baaa-f5e201c954de req-96e56674-7019-425c-b55b-8902448348b3 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:38:24 user devstack@n-api.service[72089]: INFO nova.api.openstack.compute.server_external_events [req-acafccee-7f91-43a3-baaa-f5e201c954de req-96e56674-7019-425c-b55b-8902448348b3 service nova] Creating event network-vif-plugged:c662b1b3-b2b3-4502-81af-9afdf3e591dc for instance bf0a75f5-2f44-4687-af12-046f6761fee2 on user Apr 11 19:38:24 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [req-acafccee-7f91-43a3-baaa-f5e201c954de req-96e56674-7019-425c-b55b-8902448348b3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040217 Apr 11 19:38:24 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 268/783] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:38:24 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:38:26 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [req-ed2d7d5c-fd6e-4672-a364-ed56284e3024 req-750f429e-48c0-4ac2-822b-64d2b5d65978 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf0a75f5-2f44-4687-af12-046f6761fee2", "name": "network-vif-plugged", "status": "completed", "tag": "c662b1b3-b2b3-4502-81af-9afdf3e591dc"}]} {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:38:26 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-ed2d7d5c-fd6e-4672-a364-ed56284e3024 req-750f429e-48c0-4ac2-822b-64d2b5d65978 service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:38:26 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-ed2d7d5c-fd6e-4672-a364-ed56284e3024 req-750f429e-48c0-4ac2-822b-64d2b5d65978 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:38:26 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-ed2d7d5c-fd6e-4672-a364-ed56284e3024 req-750f429e-48c0-4ac2-822b-64d2b5d65978 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:38:26 user devstack@n-api.service[72090]: INFO nova.api.openstack.compute.server_external_events [req-ed2d7d5c-fd6e-4672-a364-ed56284e3024 req-750f429e-48c0-4ac2-822b-64d2b5d65978 service nova] Creating event network-vif-plugged:c662b1b3-b2b3-4502-81af-9afdf3e591dc for instance bf0a75f5-2f44-4687-af12-046f6761fee2 on user Apr 11 19:38:26 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [req-ed2d7d5c-fd6e-4672-a364-ed56284e3024 req-750f429e-48c0-4ac2-822b-64d2b5d65978 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052320 Apr 11 19:38:26 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 260/784] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:38:26 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:38:27 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [None req-38b17d97-042e-4479-9357-d7b0336f6c79 tempest-VolumesNegativeTest-1481793988 tempest-VolumesNegativeTest-1481793988-project-member] Action: 'create', calling method: .version_select at 0x7f119d9b8e50>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1800735231", "metadata": {"Type": "work"}}} {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:38:27 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [None req-38b17d97-042e-4479-9357-d7b0336f6c79 tempest-VolumesNegativeTest-1481793988 tempest-VolumesNegativeTest-1481793988-project-member] Request method failure captured: Apr 11 19:38:27 user devstack@n-api.service[72088]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Apr 11 19:38:27 user devstack@n-api.service[72088]: Accept: application/json Apr 11 19:38:27 user devstack@n-api.service[72088]: Accept-Encoding: identity Apr 11 19:38:27 user devstack@n-api.service[72088]: Connection: close Apr 11 19:38:27 user devstack@n-api.service[72088]: Content-Length: 122 Apr 11 19:38:27 user devstack@n-api.service[72088]: Content-Type: application/json Apr 11 19:38:27 user devstack@n-api.service[72088]: Host: 10.0.0.210 Apr 11 19:38:27 user devstack@n-api.service[72088]: Openstack-System-Scope: None Apr 11 19:38:27 user devstack@n-api.service[72088]: User-Agent: python-urllib3/1.26.15 Apr 11 19:38:27 user devstack@n-api.service[72088]: X-Auth-Token: gAAAAABkNbcyP8i4dhb-mdmKaEceeyLoBCjUGl2VnlZUNyMHknxaNkeu_E9Y1jte5o_WXYsqVqQHJq79Oupxm7-ec3AgYCwc9qjVJt4CoCdply6JqlwlGsH7HVcuCv9b7iK2cmblWEW4pK5ZgNGkSd2IKUPppo9ADvW_-6wbA9QUbdV-UNvhZC8 Apr 11 19:38:27 user devstack@n-api.service[72088]: X-Domain-Id: None Apr 11 19:38:27 user devstack@n-api.service[72088]: X-Domain-Name: None Apr 11 19:38:27 user devstack@n-api.service[72088]: X-Identity-Status: Confirmed Apr 11 19:38:27 user devstack@n-api.service[72088]: X-Is-Admin-Project: True Apr 11 19:38:27 user devstack@n-api.service[72088]: X-Project-Domain-Id: default Apr 11 19:38:27 user devstack@n-api.service[72088]: X-Project-Domain-Name: Default Apr 11 19:38:27 user devstack@n-api.service[72088]: X-Project-Id: 0fd429d2268e4d7f9fb1809ca9a4bb1e Apr 11 19:38:27 user devstack@n-api.service[72088]: X-Project-Name: tempest-VolumesNegativeTest-1481793988 Apr 11 19:38:27 user devstack@n-api.service[72088]: X-Role: reader,member Apr 11 19:38:27 user devstack@n-api.service[72088]: X-Roles: reader,member Apr 11 19:38:27 user devstack@n-api.service[72088]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0fd429d2268e4d7f9fb1809ca9a4bb1e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/0fd429d2268e4d7f9fb1809ca9a4bb1e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0fd429d2268e4d7f9fb1809ca9a4bb1e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 11 19:38:27 user devstack@n-api.service[72088]: X-Tenant: tempest-VolumesNegativeTest-1481793988 Apr 11 19:38:27 user devstack@n-api.service[72088]: X-Tenant-Id: 0fd429d2268e4d7f9fb1809ca9a4bb1e Apr 11 19:38:27 user devstack@n-api.service[72088]: X-Tenant-Name: tempest-VolumesNegativeTest-1481793988 Apr 11 19:38:27 user devstack@n-api.service[72088]: X-User: tempest-VolumesNegativeTest-1481793988-project-member Apr 11 19:38:27 user devstack@n-api.service[72088]: X-User-Domain-Id: default Apr 11 19:38:27 user devstack@n-api.service[72088]: X-User-Domain-Name: Default Apr 11 19:38:27 user devstack@n-api.service[72088]: X-User-Id: f0383c7d62a248f59b4d46f73c2ebd4f Apr 11 19:38:27 user devstack@n-api.service[72088]: X-User-Name: tempest-VolumesNegativeTest-1481793988-project-member Apr 11 19:38:27 user devstack@n-api.service[72088]: Apr 11 19:38:27 user devstack@n-api.service[72088]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1800735231", "metadata": {"Type": "work"}}} Apr 11 19:38:27 user devstack@n-api.service[72088]: method: Apr 11 19:38:27 user devstack@n-api.service[72088]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Apr 11 19:38:27 user devstack@n-api.service[72088]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1800735231', 'metadata': {'Type': 'work'}}}} Apr 11 19:38:27 user devstack@n-api.service[72088]: {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 19:38:27 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:38:27 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Apr 11 19:38:27 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Apr 11 19:38:27 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/jsonschema/validators.py", line 314, in validate Apr 11 19:38:27 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi raise error Apr 11 19:38:27 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Apr 11 19:38:27 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi Apr 11 19:38:27 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Apr 11 19:38:27 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Apr 11 19:38:27 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi Apr 11 19:38:27 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi On instance['volume']: Apr 11 19:38:27 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi '#$%' Apr 11 19:38:27 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi Apr 11 19:38:27 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 19:38:27 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi Apr 11 19:38:27 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:38:27 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 19:38:27 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 19:38:27 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 19:38:27 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 19:38:27 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 11 19:38:27 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 11 19:38:27 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 19:38:27 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 19:38:27 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Apr 11 19:38:27 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Apr 11 19:38:27 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Apr 11 19:38:27 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Apr 11 19:38:27 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Apr 11 19:38:27 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Apr 11 19:38:27 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Apr 11 19:38:27 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi Apr 11 19:38:27 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 19:38:27 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi Apr 11 19:38:27 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:38:27 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 19:38:27 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 19:38:27 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Apr 11 19:38:27 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Apr 11 19:38:27 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Apr 11 19:38:27 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi Apr 11 19:38:27 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [None req-38b17d97-042e-4479-9357-d7b0336f6c79 tempest-VolumesNegativeTest-1481793988 tempest-VolumesNegativeTest-1481793988-project-member] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=72088) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 19:38:27 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [None req-38b17d97-042e-4479-9357-d7b0336f6c79 tempest-VolumesNegativeTest-1481793988 tempest-VolumesNegativeTest-1481793988-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.229511 Apr 11 19:38:27 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 257/785] 10.0.0.210 () {64 vars in 1233 bytes} [Tue Apr 11 19:38:27 2023] POST /compute/v2.1/os-volumes => generated 127 bytes in 231 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 11 19:38:27 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [None req-a4df171a-4aa3-445b-b8a4-0b6d33e838f7 tempest-VolumesNegativeTest-1481793988 tempest-VolumesNegativeTest-1481793988-project-member] Action: 'create', calling method: .version_select at 0x7f119d82fb50>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1432256251", "metadata": {"Type": "work"}}} {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:38:27 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [None req-a4df171a-4aa3-445b-b8a4-0b6d33e838f7 tempest-VolumesNegativeTest-1481793988 tempest-VolumesNegativeTest-1481793988-project-member] Request method failure captured: Apr 11 19:38:27 user devstack@n-api.service[72089]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Apr 11 19:38:27 user devstack@n-api.service[72089]: Accept: application/json Apr 11 19:38:27 user devstack@n-api.service[72089]: Accept-Encoding: identity Apr 11 19:38:27 user devstack@n-api.service[72089]: Connection: close Apr 11 19:38:27 user devstack@n-api.service[72089]: Content-Length: 120 Apr 11 19:38:27 user devstack@n-api.service[72089]: Content-Type: application/json Apr 11 19:38:27 user devstack@n-api.service[72089]: Host: 10.0.0.210 Apr 11 19:38:27 user devstack@n-api.service[72089]: Openstack-System-Scope: None Apr 11 19:38:27 user devstack@n-api.service[72089]: User-Agent: python-urllib3/1.26.15 Apr 11 19:38:27 user devstack@n-api.service[72089]: X-Auth-Token: gAAAAABkNbcyP8i4dhb-mdmKaEceeyLoBCjUGl2VnlZUNyMHknxaNkeu_E9Y1jte5o_WXYsqVqQHJq79Oupxm7-ec3AgYCwc9qjVJt4CoCdply6JqlwlGsH7HVcuCv9b7iK2cmblWEW4pK5ZgNGkSd2IKUPppo9ADvW_-6wbA9QUbdV-UNvhZC8 Apr 11 19:38:27 user devstack@n-api.service[72089]: X-Domain-Id: None Apr 11 19:38:27 user devstack@n-api.service[72089]: X-Domain-Name: None Apr 11 19:38:27 user devstack@n-api.service[72089]: X-Identity-Status: Confirmed Apr 11 19:38:27 user devstack@n-api.service[72089]: X-Is-Admin-Project: True Apr 11 19:38:27 user devstack@n-api.service[72089]: X-Project-Domain-Id: default Apr 11 19:38:27 user devstack@n-api.service[72089]: X-Project-Domain-Name: Default Apr 11 19:38:27 user devstack@n-api.service[72089]: X-Project-Id: 0fd429d2268e4d7f9fb1809ca9a4bb1e Apr 11 19:38:27 user devstack@n-api.service[72089]: X-Project-Name: tempest-VolumesNegativeTest-1481793988 Apr 11 19:38:27 user devstack@n-api.service[72089]: X-Role: reader,member Apr 11 19:38:27 user devstack@n-api.service[72089]: X-Roles: reader,member Apr 11 19:38:27 user devstack@n-api.service[72089]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0fd429d2268e4d7f9fb1809ca9a4bb1e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/0fd429d2268e4d7f9fb1809ca9a4bb1e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0fd429d2268e4d7f9fb1809ca9a4bb1e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 11 19:38:27 user devstack@n-api.service[72089]: X-Tenant: tempest-VolumesNegativeTest-1481793988 Apr 11 19:38:27 user devstack@n-api.service[72089]: X-Tenant-Id: 0fd429d2268e4d7f9fb1809ca9a4bb1e Apr 11 19:38:27 user devstack@n-api.service[72089]: X-Tenant-Name: tempest-VolumesNegativeTest-1481793988 Apr 11 19:38:27 user devstack@n-api.service[72089]: X-User: tempest-VolumesNegativeTest-1481793988-project-member Apr 11 19:38:27 user devstack@n-api.service[72089]: X-User-Domain-Id: default Apr 11 19:38:27 user devstack@n-api.service[72089]: X-User-Domain-Name: Default Apr 11 19:38:27 user devstack@n-api.service[72089]: X-User-Id: f0383c7d62a248f59b4d46f73c2ebd4f Apr 11 19:38:27 user devstack@n-api.service[72089]: X-User-Name: tempest-VolumesNegativeTest-1481793988-project-member Apr 11 19:38:27 user devstack@n-api.service[72089]: Apr 11 19:38:27 user devstack@n-api.service[72089]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1432256251", "metadata": {"Type": "work"}}} Apr 11 19:38:27 user devstack@n-api.service[72089]: method: Apr 11 19:38:27 user devstack@n-api.service[72089]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Apr 11 19:38:27 user devstack@n-api.service[72089]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1432256251', 'metadata': {'Type': 'work'}}}} Apr 11 19:38:27 user devstack@n-api.service[72089]: {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 19:38:27 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:38:27 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Apr 11 19:38:27 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Apr 11 19:38:27 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/jsonschema/validators.py", line 314, in validate Apr 11 19:38:27 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi raise error Apr 11 19:38:27 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Apr 11 19:38:27 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi Apr 11 19:38:27 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Apr 11 19:38:27 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Apr 11 19:38:27 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi Apr 11 19:38:27 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi On instance['volume']: Apr 11 19:38:27 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi '0' Apr 11 19:38:27 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi Apr 11 19:38:27 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 19:38:27 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi Apr 11 19:38:27 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:38:27 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 19:38:27 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 19:38:27 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 19:38:27 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 19:38:27 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 11 19:38:27 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 11 19:38:27 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 19:38:27 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 19:38:27 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Apr 11 19:38:27 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Apr 11 19:38:27 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Apr 11 19:38:27 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Apr 11 19:38:27 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Apr 11 19:38:27 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Apr 11 19:38:27 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Apr 11 19:38:27 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi Apr 11 19:38:27 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 19:38:27 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi Apr 11 19:38:27 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:38:27 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 19:38:27 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 19:38:27 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Apr 11 19:38:27 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Apr 11 19:38:27 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Apr 11 19:38:27 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi Apr 11 19:38:27 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [None req-a4df171a-4aa3-445b-b8a4-0b6d33e838f7 tempest-VolumesNegativeTest-1481793988 tempest-VolumesNegativeTest-1481793988-project-member] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=72089) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 19:38:27 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [None req-a4df171a-4aa3-445b-b8a4-0b6d33e838f7 tempest-VolumesNegativeTest-1481793988 tempest-VolumesNegativeTest-1481793988-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.018915 Apr 11 19:38:27 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 269/786] 10.0.0.210 () {64 vars in 1233 bytes} [Tue Apr 11 19:38:27 2023] POST /compute/v2.1/os-volumes => generated 125 bytes in 21 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 11 19:38:27 user devstack@n-api.service[72090]: DEBUG dbcounter [-] [72090] Writing DB stats nova_cell0:SELECT=4 {{(pid=72090) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:38:27 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [None req-11c6d0dc-ed23-4e8f-ae4d-c47e9a5250c4 tempest-VolumesNegativeTest-1481793988 tempest-VolumesNegativeTest-1481793988-project-member] Action: 'create', calling method: .version_select at 0x7f119d9069e0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-250743073", "metadata": {"Type": "work"}}} {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:38:27 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [None req-11c6d0dc-ed23-4e8f-ae4d-c47e9a5250c4 tempest-VolumesNegativeTest-1481793988 tempest-VolumesNegativeTest-1481793988-project-member] Request method failure captured: Apr 11 19:38:27 user devstack@n-api.service[72090]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Apr 11 19:38:27 user devstack@n-api.service[72090]: Accept: application/json Apr 11 19:38:27 user devstack@n-api.service[72090]: Accept-Encoding: identity Apr 11 19:38:27 user devstack@n-api.service[72090]: Connection: close Apr 11 19:38:27 user devstack@n-api.service[72090]: Content-Length: 118 Apr 11 19:38:27 user devstack@n-api.service[72090]: Content-Type: application/json Apr 11 19:38:27 user devstack@n-api.service[72090]: Host: 10.0.0.210 Apr 11 19:38:27 user devstack@n-api.service[72090]: Openstack-System-Scope: None Apr 11 19:38:27 user devstack@n-api.service[72090]: User-Agent: python-urllib3/1.26.15 Apr 11 19:38:27 user devstack@n-api.service[72090]: X-Auth-Token: gAAAAABkNbcyP8i4dhb-mdmKaEceeyLoBCjUGl2VnlZUNyMHknxaNkeu_E9Y1jte5o_WXYsqVqQHJq79Oupxm7-ec3AgYCwc9qjVJt4CoCdply6JqlwlGsH7HVcuCv9b7iK2cmblWEW4pK5ZgNGkSd2IKUPppo9ADvW_-6wbA9QUbdV-UNvhZC8 Apr 11 19:38:27 user devstack@n-api.service[72090]: X-Domain-Id: None Apr 11 19:38:27 user devstack@n-api.service[72090]: X-Domain-Name: None Apr 11 19:38:27 user devstack@n-api.service[72090]: X-Identity-Status: Confirmed Apr 11 19:38:27 user devstack@n-api.service[72090]: X-Is-Admin-Project: True Apr 11 19:38:27 user devstack@n-api.service[72090]: X-Project-Domain-Id: default Apr 11 19:38:27 user devstack@n-api.service[72090]: X-Project-Domain-Name: Default Apr 11 19:38:27 user devstack@n-api.service[72090]: X-Project-Id: 0fd429d2268e4d7f9fb1809ca9a4bb1e Apr 11 19:38:27 user devstack@n-api.service[72090]: X-Project-Name: tempest-VolumesNegativeTest-1481793988 Apr 11 19:38:27 user devstack@n-api.service[72090]: X-Role: reader,member Apr 11 19:38:27 user devstack@n-api.service[72090]: X-Roles: reader,member Apr 11 19:38:27 user devstack@n-api.service[72090]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0fd429d2268e4d7f9fb1809ca9a4bb1e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/0fd429d2268e4d7f9fb1809ca9a4bb1e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0fd429d2268e4d7f9fb1809ca9a4bb1e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 11 19:38:27 user devstack@n-api.service[72090]: X-Tenant: tempest-VolumesNegativeTest-1481793988 Apr 11 19:38:27 user devstack@n-api.service[72090]: X-Tenant-Id: 0fd429d2268e4d7f9fb1809ca9a4bb1e Apr 11 19:38:27 user devstack@n-api.service[72090]: X-Tenant-Name: tempest-VolumesNegativeTest-1481793988 Apr 11 19:38:27 user devstack@n-api.service[72090]: X-User: tempest-VolumesNegativeTest-1481793988-project-member Apr 11 19:38:27 user devstack@n-api.service[72090]: X-User-Domain-Id: default Apr 11 19:38:27 user devstack@n-api.service[72090]: X-User-Domain-Name: Default Apr 11 19:38:27 user devstack@n-api.service[72090]: X-User-Id: f0383c7d62a248f59b4d46f73c2ebd4f Apr 11 19:38:27 user devstack@n-api.service[72090]: X-User-Name: tempest-VolumesNegativeTest-1481793988-project-member Apr 11 19:38:27 user devstack@n-api.service[72090]: Apr 11 19:38:27 user devstack@n-api.service[72090]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-250743073", "metadata": {"Type": "work"}}} Apr 11 19:38:27 user devstack@n-api.service[72090]: method: Apr 11 19:38:27 user devstack@n-api.service[72090]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Apr 11 19:38:27 user devstack@n-api.service[72090]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-250743073', 'metadata': {'Type': 'work'}}}} Apr 11 19:38:27 user devstack@n-api.service[72090]: {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 19:38:27 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:38:27 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Apr 11 19:38:27 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Apr 11 19:38:27 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/jsonschema/validators.py", line 314, in validate Apr 11 19:38:27 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi raise error Apr 11 19:38:27 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Apr 11 19:38:27 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi Apr 11 19:38:27 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Apr 11 19:38:27 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Apr 11 19:38:27 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi Apr 11 19:38:27 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi On instance['volume']: Apr 11 19:38:27 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi '' Apr 11 19:38:27 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi Apr 11 19:38:27 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 19:38:27 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi Apr 11 19:38:27 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:38:27 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 19:38:27 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 19:38:27 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 19:38:27 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 19:38:27 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 11 19:38:27 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 11 19:38:27 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 19:38:27 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 19:38:27 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Apr 11 19:38:27 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Apr 11 19:38:27 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Apr 11 19:38:27 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Apr 11 19:38:27 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Apr 11 19:38:27 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Apr 11 19:38:27 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Apr 11 19:38:27 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi Apr 11 19:38:27 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 19:38:27 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi Apr 11 19:38:27 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:38:27 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 19:38:27 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 19:38:27 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Apr 11 19:38:27 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Apr 11 19:38:27 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Apr 11 19:38:27 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi Apr 11 19:38:27 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [None req-11c6d0dc-ed23-4e8f-ae4d-c47e9a5250c4 tempest-VolumesNegativeTest-1481793988 tempest-VolumesNegativeTest-1481793988-project-member] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=72090) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 19:38:27 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [None req-11c6d0dc-ed23-4e8f-ae4d-c47e9a5250c4 tempest-VolumesNegativeTest-1481793988 tempest-VolumesNegativeTest-1481793988-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.026463 Apr 11 19:38:27 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 261/787] 10.0.0.210 () {64 vars in 1233 bytes} [Tue Apr 11 19:38:27 2023] POST /compute/v2.1/os-volumes => generated 121 bytes in 30 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 11 19:38:27 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [None req-338039d1-d5b3-47c4-a190-90c16dbd1fab tempest-VolumesNegativeTest-1481793988 tempest-VolumesNegativeTest-1481793988-project-member] Calling method '.version_select at 0x7f119d9004c0>' {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:38:27 user devstack@n-api.service[72088]: INFO nova.api.openstack.wsgi [None req-338039d1-d5b3-47c4-a190-90c16dbd1fab tempest-VolumesNegativeTest-1481793988 tempest-VolumesNegativeTest-1481793988-project-member] HTTP exception thrown: Volume tempest-invalid-1913417005 could not be found. Apr 11 19:38:27 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [None req-338039d1-d5b3-47c4-a190-90c16dbd1fab tempest-VolumesNegativeTest-1481793988 tempest-VolumesNegativeTest-1481793988-project-member] Request method failure captured: Apr 11 19:38:27 user devstack@n-api.service[72088]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1913417005 HTTP/1.1 Apr 11 19:38:27 user devstack@n-api.service[72088]: Accept: application/json Apr 11 19:38:27 user devstack@n-api.service[72088]: Accept-Encoding: identity Apr 11 19:38:27 user devstack@n-api.service[72088]: Connection: close Apr 11 19:38:27 user devstack@n-api.service[72088]: Content-Length: 0 Apr 11 19:38:27 user devstack@n-api.service[72088]: Content-Type: application/json Apr 11 19:38:27 user devstack@n-api.service[72088]: Host: 10.0.0.210 Apr 11 19:38:27 user devstack@n-api.service[72088]: Openstack-System-Scope: None Apr 11 19:38:27 user devstack@n-api.service[72088]: User-Agent: python-urllib3/1.26.15 Apr 11 19:38:27 user devstack@n-api.service[72088]: X-Auth-Token: gAAAAABkNbcyP8i4dhb-mdmKaEceeyLoBCjUGl2VnlZUNyMHknxaNkeu_E9Y1jte5o_WXYsqVqQHJq79Oupxm7-ec3AgYCwc9qjVJt4CoCdply6JqlwlGsH7HVcuCv9b7iK2cmblWEW4pK5ZgNGkSd2IKUPppo9ADvW_-6wbA9QUbdV-UNvhZC8 Apr 11 19:38:27 user devstack@n-api.service[72088]: X-Domain-Id: None Apr 11 19:38:27 user devstack@n-api.service[72088]: X-Domain-Name: None Apr 11 19:38:27 user devstack@n-api.service[72088]: X-Identity-Status: Confirmed Apr 11 19:38:27 user devstack@n-api.service[72088]: X-Is-Admin-Project: True Apr 11 19:38:27 user devstack@n-api.service[72088]: X-Project-Domain-Id: default Apr 11 19:38:27 user devstack@n-api.service[72088]: X-Project-Domain-Name: Default Apr 11 19:38:27 user devstack@n-api.service[72088]: X-Project-Id: 0fd429d2268e4d7f9fb1809ca9a4bb1e Apr 11 19:38:27 user devstack@n-api.service[72088]: X-Project-Name: tempest-VolumesNegativeTest-1481793988 Apr 11 19:38:27 user devstack@n-api.service[72088]: X-Role: reader,member Apr 11 19:38:27 user devstack@n-api.service[72088]: X-Roles: reader,member Apr 11 19:38:27 user devstack@n-api.service[72088]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0fd429d2268e4d7f9fb1809ca9a4bb1e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/0fd429d2268e4d7f9fb1809ca9a4bb1e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0fd429d2268e4d7f9fb1809ca9a4bb1e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 11 19:38:27 user devstack@n-api.service[72088]: X-Tenant: tempest-VolumesNegativeTest-1481793988 Apr 11 19:38:27 user devstack@n-api.service[72088]: X-Tenant-Id: 0fd429d2268e4d7f9fb1809ca9a4bb1e Apr 11 19:38:27 user devstack@n-api.service[72088]: X-Tenant-Name: tempest-VolumesNegativeTest-1481793988 Apr 11 19:38:27 user devstack@n-api.service[72088]: X-User: tempest-VolumesNegativeTest-1481793988-project-member Apr 11 19:38:27 user devstack@n-api.service[72088]: X-User-Domain-Id: default Apr 11 19:38:27 user devstack@n-api.service[72088]: X-User-Domain-Name: Default Apr 11 19:38:27 user devstack@n-api.service[72088]: X-User-Id: f0383c7d62a248f59b4d46f73c2ebd4f Apr 11 19:38:27 user devstack@n-api.service[72088]: X-User-Name: tempest-VolumesNegativeTest-1481793988-project-member Apr 11 19:38:27 user devstack@n-api.service[72088]: method: Apr 11 19:38:27 user devstack@n-api.service[72088]: exception: Volume tempest-invalid-1913417005 could not be found. Apr 11 19:38:27 user devstack@n-api.service[72088]: action_args: {'id': 'tempest-invalid-1913417005'} Apr 11 19:38:27 user devstack@n-api.service[72088]: {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 19:38:27 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:38:27 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 11 19:38:27 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 11 19:38:27 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Apr 11 19:38:27 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Apr 11 19:38:27 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Apr 11 19:38:27 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi return self._delete(loc) Apr 11 19:38:27 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 313, in _delete Apr 11 19:38:27 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Apr 11 19:38:27 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 229, in delete Apr 11 19:38:27 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Apr 11 19:38:27 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 11 19:38:27 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 11 19:38:27 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 11 19:38:27 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 11 19:38:27 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1913417005 could not be found. (HTTP 404) (Request-ID: req-49a9a4c7-b255-4e0d-9811-2cf31763a9c4) Apr 11 19:38:27 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi Apr 11 19:38:27 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 19:38:27 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi Apr 11 19:38:27 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:38:27 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Apr 11 19:38:27 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Apr 11 19:38:27 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 11 19:38:27 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 11 19:38:27 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 11 19:38:27 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 11 19:38:27 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 11 19:38:27 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 11 19:38:27 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 11 19:38:27 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 11 19:38:27 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Apr 11 19:38:27 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Apr 11 19:38:27 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Apr 11 19:38:27 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi return self._delete(loc) Apr 11 19:38:27 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 313, in _delete Apr 11 19:38:27 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Apr 11 19:38:27 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 229, in delete Apr 11 19:38:27 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Apr 11 19:38:27 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 11 19:38:27 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 11 19:38:27 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 11 19:38:27 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 11 19:38:27 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1913417005 could not be found. Apr 11 19:38:27 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi Apr 11 19:38:27 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 19:38:27 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi Apr 11 19:38:27 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:38:27 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 19:38:27 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 19:38:27 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 19:38:27 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 19:38:27 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 11 19:38:27 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 11 19:38:27 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 19:38:27 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 19:38:27 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Apr 11 19:38:27 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 19:38:27 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1913417005 could not be found. Apr 11 19:38:27 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi Apr 11 19:38:27 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 19:38:27 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi Apr 11 19:38:27 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:38:27 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 19:38:27 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 19:38:27 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 19:38:27 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 19:38:27 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1913417005 could not be found. Apr 11 19:38:27 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi Apr 11 19:38:27 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [None req-338039d1-d5b3-47c4-a190-90c16dbd1fab tempest-VolumesNegativeTest-1481793988 tempest-VolumesNegativeTest-1481793988-project-member] Returning 404 to user: Volume tempest-invalid-1913417005 could not be found. {{(pid=72088) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 19:38:27 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [None req-338039d1-d5b3-47c4-a190-90c16dbd1fab tempest-VolumesNegativeTest-1481793988 tempest-VolumesNegativeTest-1481793988-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1913417005" status: 404 len: 99 microversion: 2.1 time: 0.036289 Apr 11 19:38:27 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 258/788] 10.0.0.210 () {62 vars in 1295 bytes} [Tue Apr 11 19:38:27 2023] DELETE /compute/v2.1/os-volumes/tempest-invalid-1913417005 => generated 99 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Apr 11 19:38:27 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [None req-995c8f69-4465-422c-9a45-655971abe29d tempest-VolumesNegativeTest-1481793988 tempest-VolumesNegativeTest-1481793988-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.006609 Apr 11 19:38:27 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 270/789] 10.0.0.210 () {62 vars in 1217 bytes} [Tue Apr 11 19:38:27 2023] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 8 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Apr 11 19:38:27 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [None req-f6c1e520-2855-45d3-a1f8-161cd9fbfe2a tempest-VolumesNegativeTest-1481793988 tempest-VolumesNegativeTest-1481793988-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004232 Apr 11 19:38:27 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 262/790] 10.0.0.210 () {62 vars in 1214 bytes} [Tue Apr 11 19:38:27 2023] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Apr 11 19:38:27 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [None req-2b2f885a-eddd-43aa-8a5c-5d66ec999e22 tempest-VolumesNegativeTest-1481793988 tempest-VolumesNegativeTest-1481793988-project-member] Calling method '.version_select at 0x7f119d9bb370>' {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:38:27 user devstack@n-api.service[72088]: INFO nova.api.openstack.wsgi [None req-2b2f885a-eddd-43aa-8a5c-5d66ec999e22 tempest-VolumesNegativeTest-1481793988 tempest-VolumesNegativeTest-1481793988-project-member] HTTP exception thrown: Volume a79572fe-c893-47a0-afc3-c319905b021b could not be found. Apr 11 19:38:27 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [None req-2b2f885a-eddd-43aa-8a5c-5d66ec999e22 tempest-VolumesNegativeTest-1481793988 tempest-VolumesNegativeTest-1481793988-project-member] Request method failure captured: Apr 11 19:38:27 user devstack@n-api.service[72088]: request: DELETE /compute/v2.1/os-volumes/a79572fe-c893-47a0-afc3-c319905b021b HTTP/1.1 Apr 11 19:38:27 user devstack@n-api.service[72088]: Accept: application/json Apr 11 19:38:27 user devstack@n-api.service[72088]: Accept-Encoding: identity Apr 11 19:38:27 user devstack@n-api.service[72088]: Connection: close Apr 11 19:38:27 user devstack@n-api.service[72088]: Content-Length: 0 Apr 11 19:38:27 user devstack@n-api.service[72088]: Content-Type: application/json Apr 11 19:38:27 user devstack@n-api.service[72088]: Host: 10.0.0.210 Apr 11 19:38:27 user devstack@n-api.service[72088]: Openstack-System-Scope: None Apr 11 19:38:27 user devstack@n-api.service[72088]: User-Agent: python-urllib3/1.26.15 Apr 11 19:38:27 user devstack@n-api.service[72088]: X-Auth-Token: gAAAAABkNbcyP8i4dhb-mdmKaEceeyLoBCjUGl2VnlZUNyMHknxaNkeu_E9Y1jte5o_WXYsqVqQHJq79Oupxm7-ec3AgYCwc9qjVJt4CoCdply6JqlwlGsH7HVcuCv9b7iK2cmblWEW4pK5ZgNGkSd2IKUPppo9ADvW_-6wbA9QUbdV-UNvhZC8 Apr 11 19:38:27 user devstack@n-api.service[72088]: X-Domain-Id: None Apr 11 19:38:27 user devstack@n-api.service[72088]: X-Domain-Name: None Apr 11 19:38:27 user devstack@n-api.service[72088]: X-Identity-Status: Confirmed Apr 11 19:38:27 user devstack@n-api.service[72088]: X-Is-Admin-Project: True Apr 11 19:38:27 user devstack@n-api.service[72088]: X-Project-Domain-Id: default Apr 11 19:38:27 user devstack@n-api.service[72088]: X-Project-Domain-Name: Default Apr 11 19:38:27 user devstack@n-api.service[72088]: X-Project-Id: 0fd429d2268e4d7f9fb1809ca9a4bb1e Apr 11 19:38:27 user devstack@n-api.service[72088]: X-Project-Name: tempest-VolumesNegativeTest-1481793988 Apr 11 19:38:27 user devstack@n-api.service[72088]: X-Role: reader,member Apr 11 19:38:27 user devstack@n-api.service[72088]: X-Roles: reader,member Apr 11 19:38:27 user devstack@n-api.service[72088]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0fd429d2268e4d7f9fb1809ca9a4bb1e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/0fd429d2268e4d7f9fb1809ca9a4bb1e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0fd429d2268e4d7f9fb1809ca9a4bb1e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 11 19:38:27 user devstack@n-api.service[72088]: X-Tenant: tempest-VolumesNegativeTest-1481793988 Apr 11 19:38:27 user devstack@n-api.service[72088]: X-Tenant-Id: 0fd429d2268e4d7f9fb1809ca9a4bb1e Apr 11 19:38:27 user devstack@n-api.service[72088]: X-Tenant-Name: tempest-VolumesNegativeTest-1481793988 Apr 11 19:38:27 user devstack@n-api.service[72088]: X-User: tempest-VolumesNegativeTest-1481793988-project-member Apr 11 19:38:27 user devstack@n-api.service[72088]: X-User-Domain-Id: default Apr 11 19:38:27 user devstack@n-api.service[72088]: X-User-Domain-Name: Default Apr 11 19:38:27 user devstack@n-api.service[72088]: X-User-Id: f0383c7d62a248f59b4d46f73c2ebd4f Apr 11 19:38:27 user devstack@n-api.service[72088]: X-User-Name: tempest-VolumesNegativeTest-1481793988-project-member Apr 11 19:38:27 user devstack@n-api.service[72088]: method: Apr 11 19:38:27 user devstack@n-api.service[72088]: exception: Volume a79572fe-c893-47a0-afc3-c319905b021b could not be found. Apr 11 19:38:27 user devstack@n-api.service[72088]: action_args: {'id': 'a79572fe-c893-47a0-afc3-c319905b021b'} Apr 11 19:38:27 user devstack@n-api.service[72088]: {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 19:38:27 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:38:27 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 11 19:38:27 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 11 19:38:27 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Apr 11 19:38:27 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Apr 11 19:38:27 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Apr 11 19:38:27 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi return self._delete(loc) Apr 11 19:38:27 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 313, in _delete Apr 11 19:38:27 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Apr 11 19:38:27 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 229, in delete Apr 11 19:38:27 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Apr 11 19:38:27 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 11 19:38:27 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 11 19:38:27 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 11 19:38:27 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 11 19:38:27 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume a79572fe-c893-47a0-afc3-c319905b021b could not be found. (HTTP 404) (Request-ID: req-ae8e2494-5d88-4f5b-9cb5-31488625712a) Apr 11 19:38:27 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi Apr 11 19:38:27 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 19:38:27 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi Apr 11 19:38:27 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:38:27 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Apr 11 19:38:27 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Apr 11 19:38:27 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 11 19:38:27 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 11 19:38:27 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 11 19:38:27 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 11 19:38:27 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 11 19:38:27 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 11 19:38:27 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 11 19:38:27 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 11 19:38:27 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Apr 11 19:38:27 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Apr 11 19:38:27 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Apr 11 19:38:27 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi return self._delete(loc) Apr 11 19:38:27 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 313, in _delete Apr 11 19:38:27 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Apr 11 19:38:27 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 229, in delete Apr 11 19:38:27 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Apr 11 19:38:27 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 11 19:38:27 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 11 19:38:27 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 11 19:38:27 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 11 19:38:27 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume a79572fe-c893-47a0-afc3-c319905b021b could not be found. Apr 11 19:38:27 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi Apr 11 19:38:27 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 19:38:27 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi Apr 11 19:38:27 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:38:27 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 19:38:27 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 19:38:27 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 19:38:27 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 19:38:27 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 11 19:38:27 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 11 19:38:27 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 19:38:27 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 19:38:27 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Apr 11 19:38:27 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 19:38:27 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume a79572fe-c893-47a0-afc3-c319905b021b could not be found. Apr 11 19:38:27 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi Apr 11 19:38:27 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 19:38:27 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi Apr 11 19:38:27 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:38:27 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 19:38:27 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 19:38:27 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 19:38:27 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 19:38:27 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume a79572fe-c893-47a0-afc3-c319905b021b could not be found. Apr 11 19:38:27 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi Apr 11 19:38:27 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [None req-2b2f885a-eddd-43aa-8a5c-5d66ec999e22 tempest-VolumesNegativeTest-1481793988 tempest-VolumesNegativeTest-1481793988-project-member] Returning 404 to user: Volume a79572fe-c893-47a0-afc3-c319905b021b could not be found. {{(pid=72088) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 19:38:27 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [None req-2b2f885a-eddd-43aa-8a5c-5d66ec999e22 tempest-VolumesNegativeTest-1481793988 tempest-VolumesNegativeTest-1481793988-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/a79572fe-c893-47a0-afc3-c319905b021b" status: 404 len: 109 microversion: 2.1 time: 0.038424 Apr 11 19:38:27 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 259/791] 10.0.0.210 () {62 vars in 1325 bytes} [Tue Apr 11 19:38:27 2023] DELETE /compute/v2.1/os-volumes/a79572fe-c893-47a0-afc3-c319905b021b => generated 109 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 11 19:38:27 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [None req-3ba1d42f-de15-418e-9f74-b7ff9667f015 tempest-VolumesNegativeTest-1481793988 tempest-VolumesNegativeTest-1481793988-project-member] Calling method '.version_select at 0x7f119d884f70>' {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:38:27 user devstack@n-api.service[72089]: INFO nova.api.openstack.wsgi [None req-3ba1d42f-de15-418e-9f74-b7ff9667f015 tempest-VolumesNegativeTest-1481793988 tempest-VolumesNegativeTest-1481793988-project-member] HTTP exception thrown: Volume 85ce8b98-62a7-4af9-9bfa-0963a8c700c2 could not be found. Apr 11 19:38:27 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [None req-3ba1d42f-de15-418e-9f74-b7ff9667f015 tempest-VolumesNegativeTest-1481793988 tempest-VolumesNegativeTest-1481793988-project-member] Request method failure captured: Apr 11 19:38:27 user devstack@n-api.service[72089]: request: GET /compute/v2.1/os-volumes/85ce8b98-62a7-4af9-9bfa-0963a8c700c2 HTTP/1.1 Apr 11 19:38:27 user devstack@n-api.service[72089]: Accept: application/json Apr 11 19:38:27 user devstack@n-api.service[72089]: Accept-Encoding: identity Apr 11 19:38:27 user devstack@n-api.service[72089]: Connection: close Apr 11 19:38:27 user devstack@n-api.service[72089]: Content-Length: 0 Apr 11 19:38:27 user devstack@n-api.service[72089]: Content-Type: application/json Apr 11 19:38:27 user devstack@n-api.service[72089]: Host: 10.0.0.210 Apr 11 19:38:27 user devstack@n-api.service[72089]: Openstack-System-Scope: None Apr 11 19:38:27 user devstack@n-api.service[72089]: User-Agent: python-urllib3/1.26.15 Apr 11 19:38:27 user devstack@n-api.service[72089]: X-Auth-Token: gAAAAABkNbcyP8i4dhb-mdmKaEceeyLoBCjUGl2VnlZUNyMHknxaNkeu_E9Y1jte5o_WXYsqVqQHJq79Oupxm7-ec3AgYCwc9qjVJt4CoCdply6JqlwlGsH7HVcuCv9b7iK2cmblWEW4pK5ZgNGkSd2IKUPppo9ADvW_-6wbA9QUbdV-UNvhZC8 Apr 11 19:38:27 user devstack@n-api.service[72089]: X-Domain-Id: None Apr 11 19:38:27 user devstack@n-api.service[72089]: X-Domain-Name: None Apr 11 19:38:27 user devstack@n-api.service[72089]: X-Identity-Status: Confirmed Apr 11 19:38:27 user devstack@n-api.service[72089]: X-Is-Admin-Project: True Apr 11 19:38:27 user devstack@n-api.service[72089]: X-Project-Domain-Id: default Apr 11 19:38:27 user devstack@n-api.service[72089]: X-Project-Domain-Name: Default Apr 11 19:38:27 user devstack@n-api.service[72089]: X-Project-Id: 0fd429d2268e4d7f9fb1809ca9a4bb1e Apr 11 19:38:27 user devstack@n-api.service[72089]: X-Project-Name: tempest-VolumesNegativeTest-1481793988 Apr 11 19:38:27 user devstack@n-api.service[72089]: X-Role: reader,member Apr 11 19:38:27 user devstack@n-api.service[72089]: X-Roles: reader,member Apr 11 19:38:27 user devstack@n-api.service[72089]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0fd429d2268e4d7f9fb1809ca9a4bb1e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/0fd429d2268e4d7f9fb1809ca9a4bb1e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0fd429d2268e4d7f9fb1809ca9a4bb1e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 11 19:38:27 user devstack@n-api.service[72089]: X-Tenant: tempest-VolumesNegativeTest-1481793988 Apr 11 19:38:27 user devstack@n-api.service[72089]: X-Tenant-Id: 0fd429d2268e4d7f9fb1809ca9a4bb1e Apr 11 19:38:27 user devstack@n-api.service[72089]: X-Tenant-Name: tempest-VolumesNegativeTest-1481793988 Apr 11 19:38:27 user devstack@n-api.service[72089]: X-User: tempest-VolumesNegativeTest-1481793988-project-member Apr 11 19:38:27 user devstack@n-api.service[72089]: X-User-Domain-Id: default Apr 11 19:38:27 user devstack@n-api.service[72089]: X-User-Domain-Name: Default Apr 11 19:38:27 user devstack@n-api.service[72089]: X-User-Id: f0383c7d62a248f59b4d46f73c2ebd4f Apr 11 19:38:27 user devstack@n-api.service[72089]: X-User-Name: tempest-VolumesNegativeTest-1481793988-project-member Apr 11 19:38:27 user devstack@n-api.service[72089]: method: Apr 11 19:38:27 user devstack@n-api.service[72089]: exception: Volume 85ce8b98-62a7-4af9-9bfa-0963a8c700c2 could not be found. Apr 11 19:38:27 user devstack@n-api.service[72089]: action_args: {'id': '85ce8b98-62a7-4af9-9bfa-0963a8c700c2'} Apr 11 19:38:27 user devstack@n-api.service[72089]: {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 19:38:27 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:38:27 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 11 19:38:27 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 11 19:38:27 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 11 19:38:27 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 11 19:38:27 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 11 19:38:27 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 11 19:38:27 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 11 19:38:27 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 11 19:38:27 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 11 19:38:27 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 11 19:38:27 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 11 19:38:27 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 11 19:38:27 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 11 19:38:27 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 11 19:38:27 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 85ce8b98-62a7-4af9-9bfa-0963a8c700c2 could not be found. (HTTP 404) (Request-ID: req-b69e6bdf-038c-4fe7-a875-289f3e78202c) Apr 11 19:38:27 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi Apr 11 19:38:27 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 19:38:27 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi Apr 11 19:38:27 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:38:27 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Apr 11 19:38:27 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Apr 11 19:38:27 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 11 19:38:27 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 11 19:38:27 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 11 19:38:27 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 11 19:38:27 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 11 19:38:27 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 11 19:38:27 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 11 19:38:27 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 11 19:38:27 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 11 19:38:27 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 11 19:38:27 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 11 19:38:27 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 11 19:38:27 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 11 19:38:27 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 11 19:38:27 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 11 19:38:27 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 11 19:38:27 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 11 19:38:27 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 11 19:38:27 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 11 19:38:27 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 11 19:38:27 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 85ce8b98-62a7-4af9-9bfa-0963a8c700c2 could not be found. Apr 11 19:38:27 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi Apr 11 19:38:27 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 19:38:27 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi Apr 11 19:38:27 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:38:27 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 19:38:27 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 19:38:27 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 19:38:27 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 19:38:27 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 11 19:38:27 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 11 19:38:27 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 19:38:27 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 19:38:27 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Apr 11 19:38:27 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 19:38:27 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 85ce8b98-62a7-4af9-9bfa-0963a8c700c2 could not be found. Apr 11 19:38:27 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi Apr 11 19:38:27 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 19:38:27 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi Apr 11 19:38:27 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:38:27 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 19:38:27 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 19:38:27 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 19:38:27 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 19:38:27 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 85ce8b98-62a7-4af9-9bfa-0963a8c700c2 could not be found. Apr 11 19:38:27 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi Apr 11 19:38:27 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [None req-3ba1d42f-de15-418e-9f74-b7ff9667f015 tempest-VolumesNegativeTest-1481793988 tempest-VolumesNegativeTest-1481793988-project-member] Returning 404 to user: Volume 85ce8b98-62a7-4af9-9bfa-0963a8c700c2 could not be found. {{(pid=72089) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 19:38:27 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [None req-3ba1d42f-de15-418e-9f74-b7ff9667f015 tempest-VolumesNegativeTest-1481793988 tempest-VolumesNegativeTest-1481793988-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/85ce8b98-62a7-4af9-9bfa-0963a8c700c2" status: 404 len: 109 microversion: 2.1 time: 0.039115 Apr 11 19:38:27 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 271/792] 10.0.0.210 () {62 vars in 1322 bytes} [Tue Apr 11 19:38:27 2023] GET /compute/v2.1/os-volumes/85ce8b98-62a7-4af9-9bfa-0963a8c700c2 => generated 109 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 19:38:31 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [None req-cdbe3c30-f678-4bc9-850c-48f960a0533f tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Calling method '>' {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:38:31 user devstack@n-api.service[72090]: DEBUG nova.compute.api [None req-cdbe3c30-f678-4bc9-850c-48f960a0533f tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] [instance: fbfa0825-c7c2-4f04-8c9a-102e238c3816] Fetching instance by UUID {{(pid=72090) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:38:31 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-cdbe3c30-f678-4bc9-850c-48f960a0533f tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:38:31 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-cdbe3c30-f678-4bc9-850c-48f960a0533f tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:38:31 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-cdbe3c30-f678-4bc9-850c-48f960a0533f tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:38:31 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-cdbe3c30-f678-4bc9-850c-48f960a0533f tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:38:31 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-cdbe3c30-f678-4bc9-850c-48f960a0533f tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:38:31 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-cdbe3c30-f678-4bc9-850c-48f960a0533f tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:38:31 user devstack@n-api.service[72090]: DEBUG nova.policy [None req-cdbe3c30-f678-4bc9-850c-48f960a0533f tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0558ba5a2b04d36ba2f2411090cc4e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d8b189667e34931aa36149620a036e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72090) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:38:31 user devstack@n-api.service[72090]: DEBUG nova.policy [None req-cdbe3c30-f678-4bc9-850c-48f960a0533f tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0558ba5a2b04d36ba2f2411090cc4e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d8b189667e34931aa36149620a036e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72090) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:38:31 user devstack@n-api.service[72090]: DEBUG nova.policy [None req-cdbe3c30-f678-4bc9-850c-48f960a0533f tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0558ba5a2b04d36ba2f2411090cc4e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d8b189667e34931aa36149620a036e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72090) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:38:31 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [None req-cdbe3c30-f678-4bc9-850c-48f960a0533f tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fbfa0825-c7c2-4f04-8c9a-102e238c3816" status: 200 len: 1706 microversion: 2.20 time: 0.172576 Apr 11 19:38:31 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 263/793] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 19:38:31 2023] GET /compute/v2.1/servers/fbfa0825-c7c2-4f04-8c9a-102e238c3816 => generated 1706 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 19:38:40 user devstack@n-api.service[72088]: DEBUG dbcounter [-] [72088] Writing DB stats nova_cell0:SELECT=2 {{(pid=72088) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:38:40 user devstack@n-api.service[72088]: DEBUG dbcounter [-] [72088] Writing DB stats nova_cell0:SELECT=6 {{(pid=72088) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:38:40 user devstack@n-api.service[72088]: DEBUG dbcounter [-] [72088] Writing DB stats nova_api:SELECT=25,nova_api:INSERT=3 {{(pid=72088) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:38:40 user devstack@n-api.service[72088]: DEBUG dbcounter [-] [72088] Writing DB stats nova_cell1:SELECT=12 {{(pid=72088) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:38:40 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [None req-754c499f-22b7-4ccd-a09d-03c0d2c7ce2d tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Calling method '>' {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:38:40 user devstack@n-api.service[72088]: DEBUG nova.compute.api [None req-754c499f-22b7-4ccd-a09d-03c0d2c7ce2d tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] [instance: 781f3398-3d54-49a4-a751-60f4fbc5e49a] Fetching instance by UUID {{(pid=72088) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:38:40 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-754c499f-22b7-4ccd-a09d-03c0d2c7ce2d tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:38:40 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-754c499f-22b7-4ccd-a09d-03c0d2c7ce2d tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:38:40 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-754c499f-22b7-4ccd-a09d-03c0d2c7ce2d tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:38:40 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-754c499f-22b7-4ccd-a09d-03c0d2c7ce2d tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:38:40 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-754c499f-22b7-4ccd-a09d-03c0d2c7ce2d tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:38:40 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-754c499f-22b7-4ccd-a09d-03c0d2c7ce2d tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:38:40 user devstack@n-api.service[72088]: DEBUG nova.policy [None req-754c499f-22b7-4ccd-a09d-03c0d2c7ce2d tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf262cd03f4a41c4956d8784cf37d86d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caba0618fc743e7bfb2dd866a511df9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72088) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:38:40 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [None req-754c499f-22b7-4ccd-a09d-03c0d2c7ce2d tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] 10.0.0.210 "GET /compute/v2.1/servers/781f3398-3d54-49a4-a751-60f4fbc5e49a" status: 200 len: 1550 microversion: 2.1 time: 0.186982 Apr 11 19:38:40 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 260/794] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 19:38:40 2023] GET /compute/v2.1/servers/781f3398-3d54-49a4-a751-60f4fbc5e49a => generated 1550 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:38:40 user devstack@n-api.service[72089]: DEBUG dbcounter [-] [72089] Writing DB stats nova_cell0:SELECT=2 {{(pid=72089) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:38:40 user devstack@n-api.service[72089]: DEBUG dbcounter [-] [72089] Writing DB stats nova_api:SELECT=17,nova_api:DELETE=1 {{(pid=72089) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:38:40 user devstack@n-api.service[72089]: DEBUG dbcounter [-] [72089] Writing DB stats nova_cell1:SELECT=18 {{(pid=72089) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:38:40 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [None req-389a0100-024c-4d2f-bf07-1032ef6062a0 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Calling method '>' {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:38:40 user devstack@n-api.service[72089]: DEBUG nova.compute.api [None req-389a0100-024c-4d2f-bf07-1032ef6062a0 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] [instance: 781f3398-3d54-49a4-a751-60f4fbc5e49a] Fetching instance by UUID {{(pid=72089) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:38:40 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-389a0100-024c-4d2f-bf07-1032ef6062a0 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:38:40 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-389a0100-024c-4d2f-bf07-1032ef6062a0 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:38:40 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-389a0100-024c-4d2f-bf07-1032ef6062a0 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:38:40 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-389a0100-024c-4d2f-bf07-1032ef6062a0 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:38:40 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-389a0100-024c-4d2f-bf07-1032ef6062a0 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:38:40 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-389a0100-024c-4d2f-bf07-1032ef6062a0 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:38:40 user devstack@n-api.service[72089]: DEBUG nova.compute.api [None req-389a0100-024c-4d2f-bf07-1032ef6062a0 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] [instance: 781f3398-3d54-49a4-a751-60f4fbc5e49a] Going to try to terminate instance {{(pid=72089) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 11 19:38:40 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [None req-389a0100-024c-4d2f-bf07-1032ef6062a0 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/781f3398-3d54-49a4-a751-60f4fbc5e49a" status: 204 len: 0 microversion: 2.1 time: 0.154108 Apr 11 19:38:40 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 272/795] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 19:38:40 2023] DELETE /compute/v2.1/servers/781f3398-3d54-49a4-a751-60f4fbc5e49a => generated 0 bytes in 156 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 11 19:38:40 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [None req-c36b7916-5795-4e21-97bf-e3d51c1c3a29 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Calling method '>' {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:38:40 user devstack@n-api.service[72090]: DEBUG nova.compute.api [None req-c36b7916-5795-4e21-97bf-e3d51c1c3a29 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] [instance: 781f3398-3d54-49a4-a751-60f4fbc5e49a] Fetching instance by UUID {{(pid=72090) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:38:40 user devstack@n-api.service[72090]: DEBUG dbcounter [-] [72090] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=1 {{(pid=72090) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:38:40 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-c36b7916-5795-4e21-97bf-e3d51c1c3a29 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:38:40 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-c36b7916-5795-4e21-97bf-e3d51c1c3a29 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:38:40 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-c36b7916-5795-4e21-97bf-e3d51c1c3a29 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:38:40 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-c36b7916-5795-4e21-97bf-e3d51c1c3a29 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:38:40 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-c36b7916-5795-4e21-97bf-e3d51c1c3a29 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:38:40 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-c36b7916-5795-4e21-97bf-e3d51c1c3a29 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:38:40 user devstack@n-api.service[72090]: DEBUG dbcounter [-] [72090] Writing DB stats nova_cell1:SELECT=36,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=72090) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:38:40 user devstack@n-api.service[72090]: DEBUG nova.policy [None req-c36b7916-5795-4e21-97bf-e3d51c1c3a29 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf262cd03f4a41c4956d8784cf37d86d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caba0618fc743e7bfb2dd866a511df9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72090) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:38:40 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [None req-c36b7916-5795-4e21-97bf-e3d51c1c3a29 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] 10.0.0.210 "GET /compute/v2.1/servers/781f3398-3d54-49a4-a751-60f4fbc5e49a" status: 200 len: 1556 microversion: 2.1 time: 0.210442 Apr 11 19:38:40 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 264/796] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 19:38:40 2023] GET /compute/v2.1/servers/781f3398-3d54-49a4-a751-60f4fbc5e49a => generated 1556 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 19:38:41 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [req-e9a52476-8aaa-4e68-af97-f48d22d51d55 req-571c6d4c-ecd2-4a5f-bec5-e36af230fd2f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "781f3398-3d54-49a4-a751-60f4fbc5e49a", "name": "network-vif-unplugged", "status": "completed", "tag": "eb83845b-f94f-422d-9970-c00e62a4b142"}]} {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:38:41 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-e9a52476-8aaa-4e68-af97-f48d22d51d55 req-571c6d4c-ecd2-4a5f-bec5-e36af230fd2f service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:38:41 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-e9a52476-8aaa-4e68-af97-f48d22d51d55 req-571c6d4c-ecd2-4a5f-bec5-e36af230fd2f service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:38:41 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-e9a52476-8aaa-4e68-af97-f48d22d51d55 req-571c6d4c-ecd2-4a5f-bec5-e36af230fd2f service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:38:41 user devstack@n-api.service[72088]: INFO nova.api.openstack.compute.server_external_events [req-e9a52476-8aaa-4e68-af97-f48d22d51d55 req-571c6d4c-ecd2-4a5f-bec5-e36af230fd2f service nova] Creating event network-vif-unplugged:eb83845b-f94f-422d-9970-c00e62a4b142 for instance 781f3398-3d54-49a4-a751-60f4fbc5e49a on user Apr 11 19:38:41 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [req-e9a52476-8aaa-4e68-af97-f48d22d51d55 req-571c6d4c-ecd2-4a5f-bec5-e36af230fd2f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031989 Apr 11 19:38:41 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 261/797] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:38:41 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:38:43 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [req-67340bdb-dcf7-4f4c-82a3-690fa2281248 req-6bfd0de4-70f5-47da-ad08-8347e38923df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "781f3398-3d54-49a4-a751-60f4fbc5e49a", "name": "network-vif-plugged", "status": "completed", "tag": "eb83845b-f94f-422d-9970-c00e62a4b142"}, {"server_uuid": "781f3398-3d54-49a4-a751-60f4fbc5e49a", "name": "network-vif-deleted", "tag": "eb83845b-f94f-422d-9970-c00e62a4b142"}]} {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:38:43 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-67340bdb-dcf7-4f4c-82a3-690fa2281248 req-6bfd0de4-70f5-47da-ad08-8347e38923df service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:38:43 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-67340bdb-dcf7-4f4c-82a3-690fa2281248 req-6bfd0de4-70f5-47da-ad08-8347e38923df service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:38:43 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-67340bdb-dcf7-4f4c-82a3-690fa2281248 req-6bfd0de4-70f5-47da-ad08-8347e38923df service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:38:43 user devstack@n-api.service[72089]: INFO nova.api.openstack.compute.server_external_events [req-67340bdb-dcf7-4f4c-82a3-690fa2281248 req-6bfd0de4-70f5-47da-ad08-8347e38923df service nova] Creating event network-vif-plugged:eb83845b-f94f-422d-9970-c00e62a4b142 for instance 781f3398-3d54-49a4-a751-60f4fbc5e49a on user Apr 11 19:38:43 user devstack@n-api.service[72089]: INFO nova.api.openstack.compute.server_external_events [req-67340bdb-dcf7-4f4c-82a3-690fa2281248 req-6bfd0de4-70f5-47da-ad08-8347e38923df service nova] Creating event network-vif-deleted:eb83845b-f94f-422d-9970-c00e62a4b142 for instance 781f3398-3d54-49a4-a751-60f4fbc5e49a on user Apr 11 19:38:43 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [req-67340bdb-dcf7-4f4c-82a3-690fa2281248 req-6bfd0de4-70f5-47da-ad08-8347e38923df service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.042216 Apr 11 19:38:43 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 273/798] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:38:43 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:38:49 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [None req-4f1180f8-0479-44ca-b22a-af9bfbfe0a80 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Action: 'action', calling method: >, body: {"rescue": {"rescue_image_ref": "bfa897bc-dbd2-4019-9649-f67af551a372"}} {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:38:49 user devstack@n-api.service[72090]: DEBUG nova.compute.api [None req-4f1180f8-0479-44ca-b22a-af9bfbfe0a80 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] [instance: 8c45de50-92bc-467c-9f3d-7e667e1d0bb3] Fetching instance by UUID {{(pid=72090) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:38:50 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-4f1180f8-0479-44ca-b22a-af9bfbfe0a80 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:38:50 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-4f1180f8-0479-44ca-b22a-af9bfbfe0a80 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:38:50 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-4f1180f8-0479-44ca-b22a-af9bfbfe0a80 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:38:50 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-4f1180f8-0479-44ca-b22a-af9bfbfe0a80 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:38:50 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-4f1180f8-0479-44ca-b22a-af9bfbfe0a80 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:38:50 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-4f1180f8-0479-44ca-b22a-af9bfbfe0a80 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:38:50 user devstack@n-api.service[72090]: DEBUG nova.objects.instance [None req-4f1180f8-0479-44ca-b22a-af9bfbfe0a80 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Lazy-loading 'flavor' on Instance uuid 8c45de50-92bc-467c-9f3d-7e667e1d0bb3 {{(pid=72090) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 11 19:38:50 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [None req-4f1180f8-0479-44ca-b22a-af9bfbfe0a80 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] 10.0.0.210 "POST /compute/v2.1/servers/8c45de50-92bc-467c-9f3d-7e667e1d0bb3/action" status: 200 len: 29 microversion: 2.87 time: 0.602238 Apr 11 19:38:50 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 265/799] 10.0.0.210 () {66 vars in 1396 bytes} [Tue Apr 11 19:38:49 2023] POST /compute/v2.1/servers/8c45de50-92bc-467c-9f3d-7e667e1d0bb3/action => generated 29 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 19:38:50 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [None req-ee2d9595-a543-4662-9e10-10539a510f74 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Calling method '>' {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:38:50 user devstack@n-api.service[72088]: DEBUG nova.compute.api [None req-ee2d9595-a543-4662-9e10-10539a510f74 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] [instance: 8c45de50-92bc-467c-9f3d-7e667e1d0bb3] Fetching instance by UUID {{(pid=72088) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:38:50 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-ee2d9595-a543-4662-9e10-10539a510f74 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:38:50 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-ee2d9595-a543-4662-9e10-10539a510f74 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:38:50 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-ee2d9595-a543-4662-9e10-10539a510f74 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:38:50 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-ee2d9595-a543-4662-9e10-10539a510f74 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:38:50 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-ee2d9595-a543-4662-9e10-10539a510f74 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:38:50 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-ee2d9595-a543-4662-9e10-10539a510f74 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:38:50 user devstack@n-api.service[72088]: DEBUG nova.policy [None req-ee2d9595-a543-4662-9e10-10539a510f74 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b3adca432b04d70818a51d1366f5c6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb91586feb3f4a4c84fa8c2183baaf8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72088) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:38:50 user devstack@n-api.service[72088]: DEBUG nova.policy [None req-ee2d9595-a543-4662-9e10-10539a510f74 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b3adca432b04d70818a51d1366f5c6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb91586feb3f4a4c84fa8c2183baaf8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72088) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:38:50 user devstack@n-api.service[72088]: DEBUG nova.policy [None req-ee2d9595-a543-4662-9e10-10539a510f74 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b3adca432b04d70818a51d1366f5c6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb91586feb3f4a4c84fa8c2183baaf8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72088) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:38:50 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [None req-ee2d9595-a543-4662-9e10-10539a510f74 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8c45de50-92bc-467c-9f3d-7e667e1d0bb3" status: 200 len: 1774 microversion: 2.87 time: 0.383631 Apr 11 19:38:50 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 262/800] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 19:38:50 2023] GET /compute/v2.1/servers/8c45de50-92bc-467c-9f3d-7e667e1d0bb3 => generated 1774 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 19:38:51 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [req-687ef340-69d4-41be-9eac-394a0d9febaa req-9ab49628-9a5f-42eb-85ee-33fce8dbf5e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c45de50-92bc-467c-9f3d-7e667e1d0bb3", "name": "network-vif-unplugged", "status": "completed", "tag": "82ee2878-c477-419c-97ba-9ac4b36dacab"}]} {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:38:51 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-687ef340-69d4-41be-9eac-394a0d9febaa req-9ab49628-9a5f-42eb-85ee-33fce8dbf5e4 service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:38:51 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-687ef340-69d4-41be-9eac-394a0d9febaa req-9ab49628-9a5f-42eb-85ee-33fce8dbf5e4 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:38:51 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-687ef340-69d4-41be-9eac-394a0d9febaa req-9ab49628-9a5f-42eb-85ee-33fce8dbf5e4 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:38:51 user devstack@n-api.service[72089]: INFO nova.api.openstack.compute.server_external_events [req-687ef340-69d4-41be-9eac-394a0d9febaa req-9ab49628-9a5f-42eb-85ee-33fce8dbf5e4 service nova] Creating event network-vif-unplugged:82ee2878-c477-419c-97ba-9ac4b36dacab for instance 8c45de50-92bc-467c-9f3d-7e667e1d0bb3 on user Apr 11 19:38:51 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [req-687ef340-69d4-41be-9eac-394a0d9febaa req-9ab49628-9a5f-42eb-85ee-33fce8dbf5e4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.039269 Apr 11 19:38:51 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 274/801] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:38:51 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:38:53 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [req-5a04daaa-c255-4efa-910a-b7b9341f88b5 req-8a15a481-74ea-4046-8bd4-2b2b4fdc3da8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c45de50-92bc-467c-9f3d-7e667e1d0bb3", "name": "network-vif-plugged", "status": "completed", "tag": "82ee2878-c477-419c-97ba-9ac4b36dacab"}]} {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:38:53 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-5a04daaa-c255-4efa-910a-b7b9341f88b5 req-8a15a481-74ea-4046-8bd4-2b2b4fdc3da8 service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:38:53 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-5a04daaa-c255-4efa-910a-b7b9341f88b5 req-8a15a481-74ea-4046-8bd4-2b2b4fdc3da8 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:38:53 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-5a04daaa-c255-4efa-910a-b7b9341f88b5 req-8a15a481-74ea-4046-8bd4-2b2b4fdc3da8 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:38:53 user devstack@n-api.service[72090]: INFO nova.api.openstack.compute.server_external_events [req-5a04daaa-c255-4efa-910a-b7b9341f88b5 req-8a15a481-74ea-4046-8bd4-2b2b4fdc3da8 service nova] Creating event network-vif-plugged:82ee2878-c477-419c-97ba-9ac4b36dacab for instance 8c45de50-92bc-467c-9f3d-7e667e1d0bb3 on user Apr 11 19:38:53 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [req-5a04daaa-c255-4efa-910a-b7b9341f88b5 req-8a15a481-74ea-4046-8bd4-2b2b4fdc3da8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035502 Apr 11 19:38:53 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 266/802] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:38:53 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:38:56 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [req-fd1f73b1-de6d-4c32-aa1b-afd993b9fd96 req-1de1fb76-f4b5-4a3b-b55f-5929098a0a82 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c45de50-92bc-467c-9f3d-7e667e1d0bb3", "name": "network-vif-plugged", "status": "completed", "tag": "82ee2878-c477-419c-97ba-9ac4b36dacab"}]} {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:38:56 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-fd1f73b1-de6d-4c32-aa1b-afd993b9fd96 req-1de1fb76-f4b5-4a3b-b55f-5929098a0a82 service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:38:56 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-fd1f73b1-de6d-4c32-aa1b-afd993b9fd96 req-1de1fb76-f4b5-4a3b-b55f-5929098a0a82 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:38:56 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-fd1f73b1-de6d-4c32-aa1b-afd993b9fd96 req-1de1fb76-f4b5-4a3b-b55f-5929098a0a82 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:38:56 user devstack@n-api.service[72088]: INFO nova.api.openstack.compute.server_external_events [req-fd1f73b1-de6d-4c32-aa1b-afd993b9fd96 req-1de1fb76-f4b5-4a3b-b55f-5929098a0a82 service nova] Creating event network-vif-plugged:82ee2878-c477-419c-97ba-9ac4b36dacab for instance 8c45de50-92bc-467c-9f3d-7e667e1d0bb3 on user Apr 11 19:38:56 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [req-fd1f73b1-de6d-4c32-aa1b-afd993b9fd96 req-1de1fb76-f4b5-4a3b-b55f-5929098a0a82 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035233 Apr 11 19:38:56 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 263/803] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:38:56 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:38:58 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [req-1c2a86f5-3f20-4040-aa88-79c22d2b9d3b req-ab1813fa-0376-4043-9f15-978f487a2f46 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c45de50-92bc-467c-9f3d-7e667e1d0bb3", "name": "network-vif-plugged", "status": "completed", "tag": "82ee2878-c477-419c-97ba-9ac4b36dacab"}]} {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:38:58 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-1c2a86f5-3f20-4040-aa88-79c22d2b9d3b req-ab1813fa-0376-4043-9f15-978f487a2f46 service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:38:58 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-1c2a86f5-3f20-4040-aa88-79c22d2b9d3b req-ab1813fa-0376-4043-9f15-978f487a2f46 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:38:58 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-1c2a86f5-3f20-4040-aa88-79c22d2b9d3b req-ab1813fa-0376-4043-9f15-978f487a2f46 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:38:58 user devstack@n-api.service[72089]: INFO nova.api.openstack.compute.server_external_events [req-1c2a86f5-3f20-4040-aa88-79c22d2b9d3b req-ab1813fa-0376-4043-9f15-978f487a2f46 service nova] Creating event network-vif-plugged:82ee2878-c477-419c-97ba-9ac4b36dacab for instance 8c45de50-92bc-467c-9f3d-7e667e1d0bb3 on user Apr 11 19:38:58 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [req-1c2a86f5-3f20-4040-aa88-79c22d2b9d3b req-ab1813fa-0376-4043-9f15-978f487a2f46 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037269 Apr 11 19:38:58 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 275/804] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:38:58 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:39:00 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [None req-ea43f2e4-ff2f-4cba-90d8-c4900acc14db tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] Calling method '>' {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:39:00 user devstack@n-api.service[72090]: DEBUG nova.compute.api [None req-ea43f2e4-ff2f-4cba-90d8-c4900acc14db tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] [instance: d42dc0ea-4631-44be-8b58-09877280ba2e] Fetching instance by UUID {{(pid=72090) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:39:00 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-ea43f2e4-ff2f-4cba-90d8-c4900acc14db tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:39:00 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-ea43f2e4-ff2f-4cba-90d8-c4900acc14db tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:39:00 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-ea43f2e4-ff2f-4cba-90d8-c4900acc14db tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:39:00 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-ea43f2e4-ff2f-4cba-90d8-c4900acc14db tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:39:00 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-ea43f2e4-ff2f-4cba-90d8-c4900acc14db tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:39:00 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-ea43f2e4-ff2f-4cba-90d8-c4900acc14db tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:39:01 user devstack@n-api.service[72090]: DEBUG nova.policy [None req-ea43f2e4-ff2f-4cba-90d8-c4900acc14db tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68fcdcd3af164195bf0c7da3b8dfecb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7b9baa081ca455ea6931b7801c805b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72090) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:39:01 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [None req-ea43f2e4-ff2f-4cba-90d8-c4900acc14db tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d42dc0ea-4631-44be-8b58-09877280ba2e" status: 200 len: 1496 microversion: 2.1 time: 0.214454 Apr 11 19:39:01 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 267/805] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 19:39:00 2023] GET /compute/v2.1/servers/d42dc0ea-4631-44be-8b58-09877280ba2e => generated 1496 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:39:08 user devstack@n-api.service[72088]: DEBUG dbcounter [-] [72088] Writing DB stats nova_api:SELECT=10 {{(pid=72088) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:39:08 user devstack@n-api.service[72088]: DEBUG dbcounter [-] [72088] Writing DB stats nova_cell1:SELECT=16 {{(pid=72088) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:39:08 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [None req-355ad992-9eca-4700-b94a-bc62688109c0 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Calling method '>' {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:39:08 user devstack@n-api.service[72088]: DEBUG nova.compute.api [None req-355ad992-9eca-4700-b94a-bc62688109c0 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] [instance: bf0a75f5-2f44-4687-af12-046f6761fee2] Fetching instance by UUID {{(pid=72088) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:39:08 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-355ad992-9eca-4700-b94a-bc62688109c0 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:39:08 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-355ad992-9eca-4700-b94a-bc62688109c0 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:39:08 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-355ad992-9eca-4700-b94a-bc62688109c0 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:39:08 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-355ad992-9eca-4700-b94a-bc62688109c0 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:39:08 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-355ad992-9eca-4700-b94a-bc62688109c0 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:39:08 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-355ad992-9eca-4700-b94a-bc62688109c0 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:39:08 user devstack@n-api.service[72088]: DEBUG nova.policy [None req-355ad992-9eca-4700-b94a-bc62688109c0 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba7f82b529e74d99838b6264b94d823b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e3a291c54b49db8e12a88ba41865e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72088) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:39:08 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [None req-355ad992-9eca-4700-b94a-bc62688109c0 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bf0a75f5-2f44-4687-af12-046f6761fee2" status: 200 len: 1554 microversion: 2.1 time: 0.164234 Apr 11 19:39:08 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 264/806] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 19:39:08 2023] GET /compute/v2.1/servers/bf0a75f5-2f44-4687-af12-046f6761fee2 => generated 1554 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:39:15 user devstack@n-api.service[72089]: DEBUG dbcounter [-] [72089] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=72089) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:39:15 user devstack@n-api.service[72089]: DEBUG dbcounter [-] [72089] Writing DB stats nova_cell1:SELECT=21,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=72089) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:39:15 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [None req-58b631b6-8f71-489e-8be7-ae29d6d4de2e tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Calling method '>' {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:39:15 user devstack@n-api.service[72089]: DEBUG nova.compute.api [None req-58b631b6-8f71-489e-8be7-ae29d6d4de2e tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] [instance: 647674d8-af53-405a-8116-4b7a01549bdf] Fetching instance by UUID {{(pid=72089) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:39:15 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-58b631b6-8f71-489e-8be7-ae29d6d4de2e tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:39:15 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-58b631b6-8f71-489e-8be7-ae29d6d4de2e tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:39:15 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-58b631b6-8f71-489e-8be7-ae29d6d4de2e tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:39:15 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-58b631b6-8f71-489e-8be7-ae29d6d4de2e tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:39:15 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-58b631b6-8f71-489e-8be7-ae29d6d4de2e tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:39:15 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-58b631b6-8f71-489e-8be7-ae29d6d4de2e tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:39:15 user devstack@n-api.service[72089]: DEBUG nova.policy [None req-58b631b6-8f71-489e-8be7-ae29d6d4de2e tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05fb551c320a48f98a4ec00a7f7492d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60a7381a31b84e97a068528f90813773', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72089) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:39:16 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [None req-58b631b6-8f71-489e-8be7-ae29d6d4de2e tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] 10.0.0.210 "GET /compute/v2.1/servers/647674d8-af53-405a-8116-4b7a01549bdf" status: 200 len: 1723 microversion: 2.1 time: 0.163441 Apr 11 19:39:16 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 276/807] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 19:39:15 2023] GET /compute/v2.1/servers/647674d8-af53-405a-8116-4b7a01549bdf => generated 1723 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:39:16 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [None req-376aec0c-8738-4576-954a-01f24d5e3479 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Calling method '>' {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:39:16 user devstack@n-api.service[72090]: DEBUG nova.compute.api [None req-376aec0c-8738-4576-954a-01f24d5e3479 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] [instance: 647674d8-af53-405a-8116-4b7a01549bdf] Fetching instance by UUID {{(pid=72090) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:39:16 user devstack@n-api.service[72090]: DEBUG dbcounter [-] [72090] Writing DB stats nova_api:SELECT=7 {{(pid=72090) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:39:16 user devstack@n-api.service[72090]: DEBUG dbcounter [-] [72090] Writing DB stats nova_cell1:SELECT=30,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=72090) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:39:16 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-376aec0c-8738-4576-954a-01f24d5e3479 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:39:16 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-376aec0c-8738-4576-954a-01f24d5e3479 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:39:16 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-376aec0c-8738-4576-954a-01f24d5e3479 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:39:16 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-376aec0c-8738-4576-954a-01f24d5e3479 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:39:16 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-376aec0c-8738-4576-954a-01f24d5e3479 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:39:16 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-376aec0c-8738-4576-954a-01f24d5e3479 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:39:16 user devstack@n-api.service[72090]: DEBUG nova.policy [None req-376aec0c-8738-4576-954a-01f24d5e3479 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05fb551c320a48f98a4ec00a7f7492d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60a7381a31b84e97a068528f90813773', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72090) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:39:16 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [None req-376aec0c-8738-4576-954a-01f24d5e3479 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] 10.0.0.210 "GET /compute/v2.1/servers/647674d8-af53-405a-8116-4b7a01549bdf" status: 200 len: 1723 microversion: 2.1 time: 0.161901 Apr 11 19:39:16 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 268/808] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 19:39:16 2023] GET /compute/v2.1/servers/647674d8-af53-405a-8116-4b7a01549bdf => generated 1723 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:39:30 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [None req-497d8c75-6b56-4ef9-985e-e5026629e8f8 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Calling method '>' {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:39:30 user devstack@n-api.service[72088]: DEBUG nova.compute.api [None req-497d8c75-6b56-4ef9-985e-e5026629e8f8 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] [instance: 781f3398-3d54-49a4-a751-60f4fbc5e49a] Fetching instance by UUID {{(pid=72088) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:39:30 user devstack@n-api.service[72088]: DEBUG dbcounter [-] [72088] Writing DB stats nova_api:SELECT=2 {{(pid=72088) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:39:30 user devstack@n-api.service[72088]: DEBUG dbcounter [-] [72088] Writing DB stats nova_cell1:SELECT=6 {{(pid=72088) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:39:30 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-497d8c75-6b56-4ef9-985e-e5026629e8f8 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:39:30 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-497d8c75-6b56-4ef9-985e-e5026629e8f8 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:39:30 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-497d8c75-6b56-4ef9-985e-e5026629e8f8 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:39:30 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-497d8c75-6b56-4ef9-985e-e5026629e8f8 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:39:30 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-497d8c75-6b56-4ef9-985e-e5026629e8f8 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:39:30 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-497d8c75-6b56-4ef9-985e-e5026629e8f8 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:39:30 user devstack@n-api.service[72088]: INFO nova.api.openstack.wsgi [None req-497d8c75-6b56-4ef9-985e-e5026629e8f8 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] HTTP exception thrown: Instance 781f3398-3d54-49a4-a751-60f4fbc5e49a could not be found. Apr 11 19:39:30 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [None req-497d8c75-6b56-4ef9-985e-e5026629e8f8 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Request method failure captured: Apr 11 19:39:30 user devstack@n-api.service[72088]: request: GET /compute/v2.1/servers/781f3398-3d54-49a4-a751-60f4fbc5e49a HTTP/1.1 Apr 11 19:39:30 user devstack@n-api.service[72088]: Accept: application/json Apr 11 19:39:30 user devstack@n-api.service[72088]: Accept-Encoding: identity Apr 11 19:39:30 user devstack@n-api.service[72088]: Connection: close Apr 11 19:39:30 user devstack@n-api.service[72088]: Content-Length: 0 Apr 11 19:39:30 user devstack@n-api.service[72088]: Content-Type: application/json Apr 11 19:39:30 user devstack@n-api.service[72088]: Host: 10.0.0.210 Apr 11 19:39:30 user devstack@n-api.service[72088]: Openstack-System-Scope: None Apr 11 19:39:30 user devstack@n-api.service[72088]: User-Agent: python-urllib3/1.26.15 Apr 11 19:39:30 user devstack@n-api.service[72088]: X-Auth-Token: gAAAAABkNbWuPL7tpG6O55jvFSGO371AELCQlFZHf6FrRxh7vClaI6XXjuETFNQG4Gook2-ws7z2jCWcd2rLpcqQWtWmqjJ0M2xKefxUzDSsHikQ381w5ena7_2Zjp6vyHkrh7PG-gVY2vEL8dYAJIJ3D9B2mOuFBAai8zWGdpQnauKzi-Qcl_M Apr 11 19:39:30 user devstack@n-api.service[72088]: X-Domain-Id: None Apr 11 19:39:30 user devstack@n-api.service[72088]: X-Domain-Name: None Apr 11 19:39:30 user devstack@n-api.service[72088]: X-Identity-Status: Confirmed Apr 11 19:39:30 user devstack@n-api.service[72088]: X-Is-Admin-Project: True Apr 11 19:39:30 user devstack@n-api.service[72088]: X-Project-Domain-Id: default Apr 11 19:39:30 user devstack@n-api.service[72088]: X-Project-Domain-Name: Default Apr 11 19:39:30 user devstack@n-api.service[72088]: X-Project-Id: 2caba0618fc743e7bfb2dd866a511df9 Apr 11 19:39:30 user devstack@n-api.service[72088]: X-Project-Name: tempest-TestVolumeBootPattern-935343500 Apr 11 19:39:30 user devstack@n-api.service[72088]: X-Role: reader,member Apr 11 19:39:30 user devstack@n-api.service[72088]: X-Roles: reader,member Apr 11 19:39:30 user devstack@n-api.service[72088]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2caba0618fc743e7bfb2dd866a511df9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/2caba0618fc743e7bfb2dd866a511df9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2caba0618fc743e7bfb2dd866a511df9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 11 19:39:30 user devstack@n-api.service[72088]: X-Tenant: tempest-TestVolumeBootPattern-935343500 Apr 11 19:39:30 user devstack@n-api.service[72088]: X-Tenant-Id: 2caba0618fc743e7bfb2dd866a511df9 Apr 11 19:39:30 user devstack@n-api.service[72088]: X-Tenant-Name: tempest-TestVolumeBootPattern-935343500 Apr 11 19:39:30 user devstack@n-api.service[72088]: X-User: tempest-TestVolumeBootPattern-935343500-project-member Apr 11 19:39:30 user devstack@n-api.service[72088]: X-User-Domain-Id: default Apr 11 19:39:30 user devstack@n-api.service[72088]: X-User-Domain-Name: Default Apr 11 19:39:30 user devstack@n-api.service[72088]: X-User-Id: cf262cd03f4a41c4956d8784cf37d86d Apr 11 19:39:30 user devstack@n-api.service[72088]: X-User-Name: tempest-TestVolumeBootPattern-935343500-project-member Apr 11 19:39:30 user devstack@n-api.service[72088]: method: > Apr 11 19:39:30 user devstack@n-api.service[72088]: exception: Instance 781f3398-3d54-49a4-a751-60f4fbc5e49a could not be found. Apr 11 19:39:30 user devstack@n-api.service[72088]: action_args: {'id': '781f3398-3d54-49a4-a751-60f4fbc5e49a'} Apr 11 19:39:30 user devstack@n-api.service[72088]: {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 19:39:30 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:39:30 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 19:39:30 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 19:39:30 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 19:39:30 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 19:39:30 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 19:39:30 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 19:39:30 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 19:39:30 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 19:39:30 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 781f3398-3d54-49a4-a751-60f4fbc5e49a could not be found. Apr 11 19:39:30 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi Apr 11 19:39:30 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 19:39:30 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi Apr 11 19:39:30 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:39:30 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 19:39:30 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 19:39:30 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 19:39:30 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 19:39:30 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 19:39:30 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 19:39:30 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 19:39:30 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 19:39:30 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 19:39:30 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 19:39:30 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 19:39:30 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 19:39:30 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 781f3398-3d54-49a4-a751-60f4fbc5e49a could not be found. Apr 11 19:39:30 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi Apr 11 19:39:30 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 19:39:30 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi Apr 11 19:39:30 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:39:30 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 19:39:30 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 19:39:30 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 19:39:30 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 19:39:30 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 781f3398-3d54-49a4-a751-60f4fbc5e49a could not be found. Apr 11 19:39:30 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi Apr 11 19:39:30 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [None req-497d8c75-6b56-4ef9-985e-e5026629e8f8 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Returning 404 to user: Instance 781f3398-3d54-49a4-a751-60f4fbc5e49a could not be found. {{(pid=72088) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 19:39:30 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [None req-497d8c75-6b56-4ef9-985e-e5026629e8f8 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] 10.0.0.210 "GET /compute/v2.1/servers/781f3398-3d54-49a4-a751-60f4fbc5e49a" status: 404 len: 111 microversion: 2.1 time: 0.041145 Apr 11 19:39:30 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 265/809] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 19:39:30 2023] GET /compute/v2.1/servers/781f3398-3d54-49a4-a751-60f4fbc5e49a => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 19:39:31 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [None req-1d13602b-e073-4ebb-b030-24cbe8d1c712 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Calling method '>' {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:39:31 user devstack@n-api.service[72089]: DEBUG nova.compute.api [None req-1d13602b-e073-4ebb-b030-24cbe8d1c712 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] [instance: fbfa0825-c7c2-4f04-8c9a-102e238c3816] Fetching instance by UUID {{(pid=72089) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:39:31 user devstack@n-api.service[72089]: DEBUG dbcounter [-] [72089] Writing DB stats nova_api:SELECT=2 {{(pid=72089) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:39:31 user devstack@n-api.service[72089]: DEBUG dbcounter [-] [72089] Writing DB stats nova_cell1:SELECT=6 {{(pid=72089) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:39:31 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-1d13602b-e073-4ebb-b030-24cbe8d1c712 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:39:31 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-1d13602b-e073-4ebb-b030-24cbe8d1c712 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:39:31 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-1d13602b-e073-4ebb-b030-24cbe8d1c712 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:39:31 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-1d13602b-e073-4ebb-b030-24cbe8d1c712 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:39:31 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-1d13602b-e073-4ebb-b030-24cbe8d1c712 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:39:31 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-1d13602b-e073-4ebb-b030-24cbe8d1c712 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:39:31 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [None req-1d13602b-e073-4ebb-b030-24cbe8d1c712 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fbfa0825-c7c2-4f04-8c9a-102e238c3816/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.057699 Apr 11 19:39:31 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 277/810] 10.0.0.210 () {64 vars in 1420 bytes} [Tue Apr 11 19:39:31 2023] GET /compute/v2.1/servers/fbfa0825-c7c2-4f04-8c9a-102e238c3816/os-volume_attachments => generated 25 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:39:31 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [None req-33963c79-b3c1-4569-aacf-55d1367da661 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Calling method '>' {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:39:31 user devstack@n-api.service[72090]: DEBUG nova.compute.api [None req-33963c79-b3c1-4569-aacf-55d1367da661 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] [instance: fbfa0825-c7c2-4f04-8c9a-102e238c3816] Fetching instance by UUID {{(pid=72090) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:39:31 user devstack@n-api.service[72090]: DEBUG dbcounter [-] [72090] Writing DB stats nova_api:SELECT=2 {{(pid=72090) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:39:31 user devstack@n-api.service[72090]: DEBUG dbcounter [-] [72090] Writing DB stats nova_cell1:SELECT=6 {{(pid=72090) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:39:31 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-33963c79-b3c1-4569-aacf-55d1367da661 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:39:31 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-33963c79-b3c1-4569-aacf-55d1367da661 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:39:31 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-33963c79-b3c1-4569-aacf-55d1367da661 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:39:31 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-33963c79-b3c1-4569-aacf-55d1367da661 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:39:31 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-33963c79-b3c1-4569-aacf-55d1367da661 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:39:31 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-33963c79-b3c1-4569-aacf-55d1367da661 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:39:31 user devstack@n-api.service[72090]: DEBUG nova.compute.api [None req-33963c79-b3c1-4569-aacf-55d1367da661 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] [instance: fbfa0825-c7c2-4f04-8c9a-102e238c3816] Going to try to terminate instance {{(pid=72090) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 11 19:39:31 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [None req-33963c79-b3c1-4569-aacf-55d1367da661 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/fbfa0825-c7c2-4f04-8c9a-102e238c3816" status: 204 len: 0 microversion: 2.20 time: 0.138904 Apr 11 19:39:31 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 269/811] 10.0.0.210 () {64 vars in 1357 bytes} [Tue Apr 11 19:39:31 2023] DELETE /compute/v2.1/servers/fbfa0825-c7c2-4f04-8c9a-102e238c3816 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 11 19:39:31 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [None req-ad2431b9-7b34-438c-b8d4-b6cc78d0ce84 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Calling method '>' {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:39:31 user devstack@n-api.service[72088]: DEBUG nova.compute.api [None req-ad2431b9-7b34-438c-b8d4-b6cc78d0ce84 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] [instance: fbfa0825-c7c2-4f04-8c9a-102e238c3816] Fetching instance by UUID {{(pid=72088) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:39:31 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-ad2431b9-7b34-438c-b8d4-b6cc78d0ce84 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:39:31 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-ad2431b9-7b34-438c-b8d4-b6cc78d0ce84 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:39:31 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-ad2431b9-7b34-438c-b8d4-b6cc78d0ce84 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:39:31 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-ad2431b9-7b34-438c-b8d4-b6cc78d0ce84 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:39:31 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-ad2431b9-7b34-438c-b8d4-b6cc78d0ce84 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:39:31 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-ad2431b9-7b34-438c-b8d4-b6cc78d0ce84 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:39:32 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [None req-3906b2db-85d6-4e45-981d-baf9b544d452 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Calling method '>' {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:39:32 user devstack@n-api.service[72089]: DEBUG nova.compute.api [None req-3906b2db-85d6-4e45-981d-baf9b544d452 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] [instance: afc22926-012a-43fe-99e6-063294c593a6] Fetching instance by UUID {{(pid=72089) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:39:32 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-3906b2db-85d6-4e45-981d-baf9b544d452 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:39:32 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-3906b2db-85d6-4e45-981d-baf9b544d452 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:39:32 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-3906b2db-85d6-4e45-981d-baf9b544d452 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:39:32 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-3906b2db-85d6-4e45-981d-baf9b544d452 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:39:32 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-3906b2db-85d6-4e45-981d-baf9b544d452 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:39:32 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-3906b2db-85d6-4e45-981d-baf9b544d452 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:39:32 user devstack@n-api.service[72089]: DEBUG nova.compute.api [None req-3906b2db-85d6-4e45-981d-baf9b544d452 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] [instance: afc22926-012a-43fe-99e6-063294c593a6] Going to try to terminate instance {{(pid=72089) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 11 19:39:32 user devstack@n-api.service[72088]: DEBUG nova.policy [None req-ad2431b9-7b34-438c-b8d4-b6cc78d0ce84 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0558ba5a2b04d36ba2f2411090cc4e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d8b189667e34931aa36149620a036e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72088) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:39:32 user devstack@n-api.service[72088]: DEBUG nova.policy [None req-ad2431b9-7b34-438c-b8d4-b6cc78d0ce84 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0558ba5a2b04d36ba2f2411090cc4e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d8b189667e34931aa36149620a036e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72088) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:39:32 user devstack@n-api.service[72088]: DEBUG nova.policy [None req-ad2431b9-7b34-438c-b8d4-b6cc78d0ce84 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0558ba5a2b04d36ba2f2411090cc4e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d8b189667e34931aa36149620a036e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72088) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:39:32 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [None req-ad2431b9-7b34-438c-b8d4-b6cc78d0ce84 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fbfa0825-c7c2-4f04-8c9a-102e238c3816" status: 200 len: 1712 microversion: 2.20 time: 0.215334 Apr 11 19:39:32 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 266/812] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 19:39:31 2023] GET /compute/v2.1/servers/fbfa0825-c7c2-4f04-8c9a-102e238c3816 => generated 1712 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 19:39:32 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [None req-3906b2db-85d6-4e45-981d-baf9b544d452 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/afc22926-012a-43fe-99e6-063294c593a6" status: 204 len: 0 microversion: 2.1 time: 0.138519 Apr 11 19:39:32 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 278/813] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 19:39:32 2023] DELETE /compute/v2.1/servers/afc22926-012a-43fe-99e6-063294c593a6 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 11 19:39:32 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [None req-b2bd9a76-efc2-436b-9fc8-2ae601813b5c tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Calling method '>' {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:39:32 user devstack@n-api.service[72090]: DEBUG nova.compute.api [None req-b2bd9a76-efc2-436b-9fc8-2ae601813b5c tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] [instance: afc22926-012a-43fe-99e6-063294c593a6] Fetching instance by UUID {{(pid=72090) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:39:32 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-b2bd9a76-efc2-436b-9fc8-2ae601813b5c tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:39:32 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-b2bd9a76-efc2-436b-9fc8-2ae601813b5c tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:39:32 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-b2bd9a76-efc2-436b-9fc8-2ae601813b5c tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:39:32 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-b2bd9a76-efc2-436b-9fc8-2ae601813b5c tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:39:32 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-b2bd9a76-efc2-436b-9fc8-2ae601813b5c tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:39:32 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-b2bd9a76-efc2-436b-9fc8-2ae601813b5c tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:39:32 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [req-ce4b8b24-01de-48cd-8389-7a18b2ae3b37 req-ef2beead-ed87-4cc2-a8c8-f70d025144da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fbfa0825-c7c2-4f04-8c9a-102e238c3816", "name": "network-vif-unplugged", "status": "completed", "tag": "0be0dfa4-d8ad-4d32-83ab-a090c0f77f34"}]} {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:39:32 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-ce4b8b24-01de-48cd-8389-7a18b2ae3b37 req-ef2beead-ed87-4cc2-a8c8-f70d025144da service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:39:32 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-ce4b8b24-01de-48cd-8389-7a18b2ae3b37 req-ef2beead-ed87-4cc2-a8c8-f70d025144da service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:39:32 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-ce4b8b24-01de-48cd-8389-7a18b2ae3b37 req-ef2beead-ed87-4cc2-a8c8-f70d025144da service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:39:32 user devstack@n-api.service[72088]: INFO nova.api.openstack.compute.server_external_events [req-ce4b8b24-01de-48cd-8389-7a18b2ae3b37 req-ef2beead-ed87-4cc2-a8c8-f70d025144da service nova] Creating event network-vif-unplugged:0be0dfa4-d8ad-4d32-83ab-a090c0f77f34 for instance fbfa0825-c7c2-4f04-8c9a-102e238c3816 on user Apr 11 19:39:32 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [req-ce4b8b24-01de-48cd-8389-7a18b2ae3b37 req-ef2beead-ed87-4cc2-a8c8-f70d025144da service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.269610 Apr 11 19:39:32 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 267/814] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:39:32 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:39:32 user devstack@n-api.service[72090]: DEBUG nova.policy [None req-b2bd9a76-efc2-436b-9fc8-2ae601813b5c tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf262cd03f4a41c4956d8784cf37d86d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caba0618fc743e7bfb2dd866a511df9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72090) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:39:32 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [None req-b2bd9a76-efc2-436b-9fc8-2ae601813b5c tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] 10.0.0.210 "GET /compute/v2.1/servers/afc22926-012a-43fe-99e6-063294c593a6" status: 200 len: 1397 microversion: 2.1 time: 0.378877 Apr 11 19:39:32 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 270/815] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 19:39:32 2023] GET /compute/v2.1/servers/afc22926-012a-43fe-99e6-063294c593a6 => generated 1397 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:39:33 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [req-2b842c1e-3b19-4ccb-804c-1c1f692a1fd0 req-b90b05f2-1df7-43da-90ba-653ac8bd1362 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fbfa0825-c7c2-4f04-8c9a-102e238c3816", "name": "network-vif-deleted", "tag": "0be0dfa4-d8ad-4d32-83ab-a090c0f77f34"}]} {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:39:33 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-2b842c1e-3b19-4ccb-804c-1c1f692a1fd0 req-b90b05f2-1df7-43da-90ba-653ac8bd1362 service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:39:33 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-2b842c1e-3b19-4ccb-804c-1c1f692a1fd0 req-b90b05f2-1df7-43da-90ba-653ac8bd1362 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:39:33 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-2b842c1e-3b19-4ccb-804c-1c1f692a1fd0 req-b90b05f2-1df7-43da-90ba-653ac8bd1362 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:39:34 user devstack@n-api.service[72089]: INFO nova.api.openstack.compute.server_external_events [req-2b842c1e-3b19-4ccb-804c-1c1f692a1fd0 req-b90b05f2-1df7-43da-90ba-653ac8bd1362 service nova] Creating event network-vif-deleted:0be0dfa4-d8ad-4d32-83ab-a090c0f77f34 for instance fbfa0825-c7c2-4f04-8c9a-102e238c3816 on user Apr 11 19:39:34 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [req-2b842c1e-3b19-4ccb-804c-1c1f692a1fd0 req-b90b05f2-1df7-43da-90ba-653ac8bd1362 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036198 Apr 11 19:39:34 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 279/816] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:39:33 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:39:34 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [req-2bb9f1b9-8294-4cf7-a362-5294efa6c0cf req-4d0e5d20-0590-42cc-af1f-326b381dd1b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fbfa0825-c7c2-4f04-8c9a-102e238c3816", "name": "network-vif-plugged", "status": "completed", "tag": "0be0dfa4-d8ad-4d32-83ab-a090c0f77f34"}, {"server_uuid": "afc22926-012a-43fe-99e6-063294c593a6", "name": "network-vif-unplugged", "status": "completed", "tag": "8491f5dc-f77b-491b-b24f-19791271647d"}, {"server_uuid": "afc22926-012a-43fe-99e6-063294c593a6", "name": "network-vif-plugged", "status": "completed", "tag": "8491f5dc-f77b-491b-b24f-19791271647d"}, {"server_uuid": "afc22926-012a-43fe-99e6-063294c593a6", "name": "network-vif-plugged", "status": "completed", "tag": "8491f5dc-f77b-491b-b24f-19791271647d"}, {"server_uuid": "afc22926-012a-43fe-99e6-063294c593a6", "name": "network-vif-plugged", "status": "completed", "tag": "8491f5dc-f77b-491b-b24f-19791271647d"}, {"server_uuid": "afc22926-012a-43fe-99e6-063294c593a6", "name": "network-vif-unplugged", "status": "completed", "tag": "8491f5dc-f77b-491b-b24f-19791271647d"}, {"server_uuid": "afc22926-012a-43fe-99e6-063294c593a6", "name": "network-vif-plugged", "status": "completed", "tag": "8491f5dc-f77b-491b-b24f-19791271647d"}]} {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:39:34 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-2bb9f1b9-8294-4cf7-a362-5294efa6c0cf req-4d0e5d20-0590-42cc-af1f-326b381dd1b2 service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:39:34 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-2bb9f1b9-8294-4cf7-a362-5294efa6c0cf req-4d0e5d20-0590-42cc-af1f-326b381dd1b2 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:39:34 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-2bb9f1b9-8294-4cf7-a362-5294efa6c0cf req-4d0e5d20-0590-42cc-af1f-326b381dd1b2 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:39:34 user devstack@n-api.service[72088]: INFO nova.api.openstack.compute.server_external_events [req-2bb9f1b9-8294-4cf7-a362-5294efa6c0cf req-4d0e5d20-0590-42cc-af1f-326b381dd1b2 service nova] Creating event network-vif-plugged:0be0dfa4-d8ad-4d32-83ab-a090c0f77f34 for instance fbfa0825-c7c2-4f04-8c9a-102e238c3816 on user Apr 11 19:39:34 user devstack@n-api.service[72088]: INFO nova.api.openstack.compute.server_external_events [req-2bb9f1b9-8294-4cf7-a362-5294efa6c0cf req-4d0e5d20-0590-42cc-af1f-326b381dd1b2 service nova] Creating event network-vif-unplugged:8491f5dc-f77b-491b-b24f-19791271647d for instance afc22926-012a-43fe-99e6-063294c593a6 on user Apr 11 19:39:34 user devstack@n-api.service[72088]: INFO nova.api.openstack.compute.server_external_events [req-2bb9f1b9-8294-4cf7-a362-5294efa6c0cf req-4d0e5d20-0590-42cc-af1f-326b381dd1b2 service nova] Creating event network-vif-plugged:8491f5dc-f77b-491b-b24f-19791271647d for instance afc22926-012a-43fe-99e6-063294c593a6 on user Apr 11 19:39:34 user devstack@n-api.service[72088]: INFO nova.api.openstack.compute.server_external_events [req-2bb9f1b9-8294-4cf7-a362-5294efa6c0cf req-4d0e5d20-0590-42cc-af1f-326b381dd1b2 service nova] Creating event network-vif-plugged:8491f5dc-f77b-491b-b24f-19791271647d for instance afc22926-012a-43fe-99e6-063294c593a6 on user Apr 11 19:39:34 user devstack@n-api.service[72088]: INFO nova.api.openstack.compute.server_external_events [req-2bb9f1b9-8294-4cf7-a362-5294efa6c0cf req-4d0e5d20-0590-42cc-af1f-326b381dd1b2 service nova] Creating event network-vif-plugged:8491f5dc-f77b-491b-b24f-19791271647d for instance afc22926-012a-43fe-99e6-063294c593a6 on user Apr 11 19:39:34 user devstack@n-api.service[72088]: INFO nova.api.openstack.compute.server_external_events [req-2bb9f1b9-8294-4cf7-a362-5294efa6c0cf req-4d0e5d20-0590-42cc-af1f-326b381dd1b2 service nova] Creating event network-vif-unplugged:8491f5dc-f77b-491b-b24f-19791271647d for instance afc22926-012a-43fe-99e6-063294c593a6 on user Apr 11 19:39:34 user devstack@n-api.service[72088]: INFO nova.api.openstack.compute.server_external_events [req-2bb9f1b9-8294-4cf7-a362-5294efa6c0cf req-4d0e5d20-0590-42cc-af1f-326b381dd1b2 service nova] Creating event network-vif-plugged:8491f5dc-f77b-491b-b24f-19791271647d for instance afc22926-012a-43fe-99e6-063294c593a6 on user Apr 11 19:39:34 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [req-2bb9f1b9-8294-4cf7-a362-5294efa6c0cf req-4d0e5d20-0590-42cc-af1f-326b381dd1b2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 1213 microversion: 2.1 time: 0.038770 Apr 11 19:39:34 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 268/817] 10.0.0.210 () {68 vars in 1395 bytes} [Tue Apr 11 19:39:34 2023] POST /compute/v2.1/os-server-external-events => generated 1213 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:39:36 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [req-47164197-2937-448f-a049-5942be0a8290 req-cbbbfee1-b62b-4eab-bf7e-f245385130dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "afc22926-012a-43fe-99e6-063294c593a6", "name": "network-vif-deleted", "tag": "8491f5dc-f77b-491b-b24f-19791271647d"}]} {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:39:36 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-47164197-2937-448f-a049-5942be0a8290 req-cbbbfee1-b62b-4eab-bf7e-f245385130dc service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:39:36 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-47164197-2937-448f-a049-5942be0a8290 req-cbbbfee1-b62b-4eab-bf7e-f245385130dc service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:39:36 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-47164197-2937-448f-a049-5942be0a8290 req-cbbbfee1-b62b-4eab-bf7e-f245385130dc service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:39:36 user devstack@n-api.service[72090]: INFO nova.api.openstack.compute.server_external_events [req-47164197-2937-448f-a049-5942be0a8290 req-cbbbfee1-b62b-4eab-bf7e-f245385130dc service nova] Creating event network-vif-deleted:8491f5dc-f77b-491b-b24f-19791271647d for instance afc22926-012a-43fe-99e6-063294c593a6 on user Apr 11 19:39:36 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [req-47164197-2937-448f-a049-5942be0a8290 req-cbbbfee1-b62b-4eab-bf7e-f245385130dc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031236 Apr 11 19:39:36 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 271/818] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:39:36 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:39:41 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [None req-8cc8404c-6aa9-410b-92b1-8a7da4fe4914 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Calling method '>' {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:39:41 user devstack@n-api.service[72089]: DEBUG nova.compute.api [None req-8cc8404c-6aa9-410b-92b1-8a7da4fe4914 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] [instance: 8c45de50-92bc-467c-9f3d-7e667e1d0bb3] Fetching instance by UUID {{(pid=72089) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:39:41 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-8cc8404c-6aa9-410b-92b1-8a7da4fe4914 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:39:41 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-8cc8404c-6aa9-410b-92b1-8a7da4fe4914 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:39:41 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-8cc8404c-6aa9-410b-92b1-8a7da4fe4914 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:39:41 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-8cc8404c-6aa9-410b-92b1-8a7da4fe4914 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:39:41 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-8cc8404c-6aa9-410b-92b1-8a7da4fe4914 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:39:41 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-8cc8404c-6aa9-410b-92b1-8a7da4fe4914 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:39:41 user devstack@n-api.service[72089]: DEBUG nova.policy [None req-8cc8404c-6aa9-410b-92b1-8a7da4fe4914 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b3adca432b04d70818a51d1366f5c6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb91586feb3f4a4c84fa8c2183baaf8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72089) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:39:41 user devstack@n-api.service[72089]: DEBUG nova.policy [None req-8cc8404c-6aa9-410b-92b1-8a7da4fe4914 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b3adca432b04d70818a51d1366f5c6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb91586feb3f4a4c84fa8c2183baaf8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72089) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:39:41 user devstack@n-api.service[72089]: DEBUG nova.policy [None req-8cc8404c-6aa9-410b-92b1-8a7da4fe4914 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b3adca432b04d70818a51d1366f5c6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb91586feb3f4a4c84fa8c2183baaf8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72089) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:39:41 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [None req-8cc8404c-6aa9-410b-92b1-8a7da4fe4914 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8c45de50-92bc-467c-9f3d-7e667e1d0bb3" status: 200 len: 1754 microversion: 2.87 time: 0.171821 Apr 11 19:39:41 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 280/819] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 19:39:41 2023] GET /compute/v2.1/servers/8c45de50-92bc-467c-9f3d-7e667e1d0bb3 => generated 1754 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 19:40:01 user devstack@n-api.service[72088]: DEBUG dbcounter [-] [72088] Writing DB stats nova_api:SELECT=8 {{(pid=72088) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:40:01 user devstack@n-api.service[72088]: DEBUG dbcounter [-] [72088] Writing DB stats nova_cell1:SELECT=12 {{(pid=72088) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:40:01 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [None req-3e91c02e-54c8-4b31-a6e9-b590c24851d6 tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:40:01 user devstack@n-api.service[72088]: DEBUG nova.compute.api [None req-3e91c02e-54c8-4b31-a6e9-b590c24851d6 tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] [instance: d42dc0ea-4631-44be-8b58-09877280ba2e] Fetching instance by UUID {{(pid=72088) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:40:01 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-3e91c02e-54c8-4b31-a6e9-b590c24851d6 tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:40:01 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-3e91c02e-54c8-4b31-a6e9-b590c24851d6 tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:40:01 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-3e91c02e-54c8-4b31-a6e9-b590c24851d6 tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:40:01 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-3e91c02e-54c8-4b31-a6e9-b590c24851d6 tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:40:01 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-3e91c02e-54c8-4b31-a6e9-b590c24851d6 tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:40:01 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-3e91c02e-54c8-4b31-a6e9-b590c24851d6 tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:40:01 user devstack@n-api.service[72088]: DEBUG nova.compute.api [None req-3e91c02e-54c8-4b31-a6e9-b590c24851d6 tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] [instance: d42dc0ea-4631-44be-8b58-09877280ba2e] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=72088) unshelve /opt/stack/nova/nova/compute/api.py:4596}} Apr 11 19:40:01 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [None req-3e91c02e-54c8-4b31-a6e9-b590c24851d6 tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] 10.0.0.210 "POST /compute/v2.1/servers/d42dc0ea-4631-44be-8b58-09877280ba2e/action" status: 202 len: 0 microversion: 2.1 time: 0.232163 Apr 11 19:40:01 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 269/820] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Apr 11 19:40:01 2023] POST /compute/v2.1/servers/d42dc0ea-4631-44be-8b58-09877280ba2e/action => generated 0 bytes in 234 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 19:40:01 user devstack@n-api.service[72090]: DEBUG dbcounter [-] [72090] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=72090) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:40:01 user devstack@n-api.service[72090]: DEBUG dbcounter [-] [72090] Writing DB stats nova_cell1:SELECT=23,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=72090) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:40:01 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [None req-25c6a6e8-fe7f-4baf-bac7-d1e4cbde6c6f tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] Calling method '>' {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:40:01 user devstack@n-api.service[72090]: DEBUG nova.compute.api [None req-25c6a6e8-fe7f-4baf-bac7-d1e4cbde6c6f tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] [instance: d42dc0ea-4631-44be-8b58-09877280ba2e] Fetching instance by UUID {{(pid=72090) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:40:01 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-25c6a6e8-fe7f-4baf-bac7-d1e4cbde6c6f tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:40:01 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-25c6a6e8-fe7f-4baf-bac7-d1e4cbde6c6f tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:40:01 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-25c6a6e8-fe7f-4baf-bac7-d1e4cbde6c6f tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:40:01 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-25c6a6e8-fe7f-4baf-bac7-d1e4cbde6c6f tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:40:01 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-25c6a6e8-fe7f-4baf-bac7-d1e4cbde6c6f tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:40:01 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-25c6a6e8-fe7f-4baf-bac7-d1e4cbde6c6f tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:40:01 user devstack@n-api.service[72090]: DEBUG nova.policy [None req-25c6a6e8-fe7f-4baf-bac7-d1e4cbde6c6f tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68fcdcd3af164195bf0c7da3b8dfecb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7b9baa081ca455ea6931b7801c805b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72090) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:40:01 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [None req-25c6a6e8-fe7f-4baf-bac7-d1e4cbde6c6f tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d42dc0ea-4631-44be-8b58-09877280ba2e" status: 200 len: 1504 microversion: 2.1 time: 0.188882 Apr 11 19:40:01 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 272/821] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 19:40:01 2023] GET /compute/v2.1/servers/d42dc0ea-4631-44be-8b58-09877280ba2e => generated 1504 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:40:08 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [req-4174c5f3-51ee-4936-a695-65d28915759b req-3dabe175-7233-435b-b774-dfb707250f6c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d42dc0ea-4631-44be-8b58-09877280ba2e", "tag": "fd43e974-64b6-4605-83cb-11b9cfe58341"}]} {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:40:08 user devstack@n-api.service[72089]: DEBUG dbcounter [-] [72089] Writing DB stats nova_cell1:SELECT=29,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=72089) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:40:08 user devstack@n-api.service[72089]: DEBUG dbcounter [-] [72089] Writing DB stats nova_api:SELECT=15,nova_api:UPDATE=1 {{(pid=72089) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:40:08 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-4174c5f3-51ee-4936-a695-65d28915759b req-3dabe175-7233-435b-b774-dfb707250f6c service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:40:08 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-4174c5f3-51ee-4936-a695-65d28915759b req-3dabe175-7233-435b-b774-dfb707250f6c service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:40:08 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-4174c5f3-51ee-4936-a695-65d28915759b req-3dabe175-7233-435b-b774-dfb707250f6c service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:40:08 user devstack@n-api.service[72089]: INFO nova.api.openstack.compute.server_external_events [req-4174c5f3-51ee-4936-a695-65d28915759b req-3dabe175-7233-435b-b774-dfb707250f6c service nova] Creating event network-changed:fd43e974-64b6-4605-83cb-11b9cfe58341 for instance d42dc0ea-4631-44be-8b58-09877280ba2e on user Apr 11 19:40:08 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [req-4174c5f3-51ee-4936-a695-65d28915759b req-3dabe175-7233-435b-b774-dfb707250f6c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036859 Apr 11 19:40:08 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 281/822] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:40:08 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:40:09 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [None req-624ee797-5f24-41b6-9908-31805ca0a049 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Calling method '>' {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:40:09 user devstack@n-api.service[72088]: DEBUG nova.compute.api [None req-624ee797-5f24-41b6-9908-31805ca0a049 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] [instance: bf0a75f5-2f44-4687-af12-046f6761fee2] Fetching instance by UUID {{(pid=72088) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:40:09 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-624ee797-5f24-41b6-9908-31805ca0a049 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:40:09 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-624ee797-5f24-41b6-9908-31805ca0a049 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:40:09 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-624ee797-5f24-41b6-9908-31805ca0a049 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:40:09 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-624ee797-5f24-41b6-9908-31805ca0a049 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:40:09 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-624ee797-5f24-41b6-9908-31805ca0a049 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:40:09 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-624ee797-5f24-41b6-9908-31805ca0a049 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:40:09 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [None req-624ee797-5f24-41b6-9908-31805ca0a049 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bf0a75f5-2f44-4687-af12-046f6761fee2/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.105980 Apr 11 19:40:09 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 270/823] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Apr 11 19:40:09 2023] GET /compute/v2.1/servers/bf0a75f5-2f44-4687-af12-046f6761fee2/os-interface => generated 283 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:40:09 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [req-f281f65f-ffbe-4aa6-a149-d1e33b4578ad req-4fc151b7-b38e-4674-b13b-4dcdc615b599 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bf0a75f5-2f44-4687-af12-046f6761fee2", "tag": "c662b1b3-b2b3-4502-81af-9afdf3e591dc"}]} {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:40:09 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-f281f65f-ffbe-4aa6-a149-d1e33b4578ad req-4fc151b7-b38e-4674-b13b-4dcdc615b599 service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:40:09 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-f281f65f-ffbe-4aa6-a149-d1e33b4578ad req-4fc151b7-b38e-4674-b13b-4dcdc615b599 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:40:09 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-f281f65f-ffbe-4aa6-a149-d1e33b4578ad req-4fc151b7-b38e-4674-b13b-4dcdc615b599 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:40:09 user devstack@n-api.service[72090]: INFO nova.api.openstack.compute.server_external_events [req-f281f65f-ffbe-4aa6-a149-d1e33b4578ad req-4fc151b7-b38e-4674-b13b-4dcdc615b599 service nova] Creating event network-changed:c662b1b3-b2b3-4502-81af-9afdf3e591dc for instance bf0a75f5-2f44-4687-af12-046f6761fee2 on user Apr 11 19:40:09 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [req-f281f65f-ffbe-4aa6-a149-d1e33b4578ad req-4fc151b7-b38e-4674-b13b-4dcdc615b599 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040988 Apr 11 19:40:09 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 273/824] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:40:09 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:40:10 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [None req-5a15d0ea-d867-47e6-9fb1-1b49575b40c4 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6cb60e75-74d9-4e1f-a22e-40a36780b21b"}} {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:40:10 user devstack@n-api.service[72089]: DEBUG nova.compute.api [None req-5a15d0ea-d867-47e6-9fb1-1b49575b40c4 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] [instance: bf0a75f5-2f44-4687-af12-046f6761fee2] Fetching instance by UUID {{(pid=72089) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:40:10 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-5a15d0ea-d867-47e6-9fb1-1b49575b40c4 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:40:10 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-5a15d0ea-d867-47e6-9fb1-1b49575b40c4 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:40:10 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-5a15d0ea-d867-47e6-9fb1-1b49575b40c4 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:40:10 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-5a15d0ea-d867-47e6-9fb1-1b49575b40c4 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:40:10 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-5a15d0ea-d867-47e6-9fb1-1b49575b40c4 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:40:10 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-5a15d0ea-d867-47e6-9fb1-1b49575b40c4 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:40:10 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [None req-5a15d0ea-d867-47e6-9fb1-1b49575b40c4 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] 10.0.0.210 "POST /compute/v2.1/servers/bf0a75f5-2f44-4687-af12-046f6761fee2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.633306 Apr 11 19:40:10 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 282/825] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Apr 11 19:40:10 2023] POST /compute/v2.1/servers/bf0a75f5-2f44-4687-af12-046f6761fee2/os-volume_attachments => generated 194 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:40:11 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [req-0ecb5a31-9675-4db2-99f5-a961f07c7944 req-438f692d-42c4-421a-8674-63b9e7fc87a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d42dc0ea-4631-44be-8b58-09877280ba2e", "name": "network-vif-plugged", "status": "completed", "tag": "fd43e974-64b6-4605-83cb-11b9cfe58341"}]} {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:40:11 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-0ecb5a31-9675-4db2-99f5-a961f07c7944 req-438f692d-42c4-421a-8674-63b9e7fc87a2 service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:40:11 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-0ecb5a31-9675-4db2-99f5-a961f07c7944 req-438f692d-42c4-421a-8674-63b9e7fc87a2 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:40:11 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-0ecb5a31-9675-4db2-99f5-a961f07c7944 req-438f692d-42c4-421a-8674-63b9e7fc87a2 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:40:11 user devstack@n-api.service[72088]: INFO nova.api.openstack.compute.server_external_events [req-0ecb5a31-9675-4db2-99f5-a961f07c7944 req-438f692d-42c4-421a-8674-63b9e7fc87a2 service nova] Creating event network-vif-plugged:fd43e974-64b6-4605-83cb-11b9cfe58341 for instance d42dc0ea-4631-44be-8b58-09877280ba2e on user Apr 11 19:40:11 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [req-0ecb5a31-9675-4db2-99f5-a961f07c7944 req-438f692d-42c4-421a-8674-63b9e7fc87a2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041020 Apr 11 19:40:11 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 271/826] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:40:11 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:40:13 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [req-7d26910b-fb60-4f3d-90c9-66c309da75e8 req-f98a0c9f-ffe5-49c9-9496-c4062e67e1d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d42dc0ea-4631-44be-8b58-09877280ba2e", "name": "network-vif-plugged", "status": "completed", "tag": "fd43e974-64b6-4605-83cb-11b9cfe58341"}]} {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:40:13 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-7d26910b-fb60-4f3d-90c9-66c309da75e8 req-f98a0c9f-ffe5-49c9-9496-c4062e67e1d1 service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:40:13 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-7d26910b-fb60-4f3d-90c9-66c309da75e8 req-f98a0c9f-ffe5-49c9-9496-c4062e67e1d1 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:40:13 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-7d26910b-fb60-4f3d-90c9-66c309da75e8 req-f98a0c9f-ffe5-49c9-9496-c4062e67e1d1 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:40:13 user devstack@n-api.service[72090]: INFO nova.api.openstack.compute.server_external_events [req-7d26910b-fb60-4f3d-90c9-66c309da75e8 req-f98a0c9f-ffe5-49c9-9496-c4062e67e1d1 service nova] Creating event network-vif-plugged:fd43e974-64b6-4605-83cb-11b9cfe58341 for instance d42dc0ea-4631-44be-8b58-09877280ba2e on user Apr 11 19:40:13 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [req-7d26910b-fb60-4f3d-90c9-66c309da75e8 req-f98a0c9f-ffe5-49c9-9496-c4062e67e1d1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033169 Apr 11 19:40:13 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 274/827] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:40:13 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:40:16 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [None req-fb895d5a-e0bf-4334-92ae-1b777141343a tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Calling method '>' {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:40:16 user devstack@n-api.service[72089]: DEBUG nova.compute.api [None req-fb895d5a-e0bf-4334-92ae-1b777141343a tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] [instance: 647674d8-af53-405a-8116-4b7a01549bdf] Fetching instance by UUID {{(pid=72089) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:40:16 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-fb895d5a-e0bf-4334-92ae-1b777141343a tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:40:16 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-fb895d5a-e0bf-4334-92ae-1b777141343a tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:40:16 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-fb895d5a-e0bf-4334-92ae-1b777141343a tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:40:16 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-fb895d5a-e0bf-4334-92ae-1b777141343a tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:40:16 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-fb895d5a-e0bf-4334-92ae-1b777141343a tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:40:16 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-fb895d5a-e0bf-4334-92ae-1b777141343a tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:40:16 user devstack@n-api.service[72089]: DEBUG nova.compute.api [None req-fb895d5a-e0bf-4334-92ae-1b777141343a tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] [instance: 647674d8-af53-405a-8116-4b7a01549bdf] Going to try to terminate instance {{(pid=72089) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 11 19:40:16 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [None req-fb895d5a-e0bf-4334-92ae-1b777141343a tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/647674d8-af53-405a-8116-4b7a01549bdf" status: 204 len: 0 microversion: 2.1 time: 0.164310 Apr 11 19:40:16 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 283/828] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 19:40:16 2023] DELETE /compute/v2.1/servers/647674d8-af53-405a-8116-4b7a01549bdf => generated 0 bytes in 169 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 11 19:40:16 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [None req-de3ffd3f-2722-4df5-a97e-be3518e1dfaf tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Calling method '>' {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:40:16 user devstack@n-api.service[72088]: DEBUG nova.compute.api [None req-de3ffd3f-2722-4df5-a97e-be3518e1dfaf tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] [instance: 647674d8-af53-405a-8116-4b7a01549bdf] Fetching instance by UUID {{(pid=72088) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:40:16 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-de3ffd3f-2722-4df5-a97e-be3518e1dfaf tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:40:16 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-de3ffd3f-2722-4df5-a97e-be3518e1dfaf tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:40:16 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-de3ffd3f-2722-4df5-a97e-be3518e1dfaf tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:40:16 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-de3ffd3f-2722-4df5-a97e-be3518e1dfaf tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:40:16 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-de3ffd3f-2722-4df5-a97e-be3518e1dfaf tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:40:16 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-de3ffd3f-2722-4df5-a97e-be3518e1dfaf tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:40:16 user devstack@n-api.service[72088]: DEBUG nova.policy [None req-de3ffd3f-2722-4df5-a97e-be3518e1dfaf tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05fb551c320a48f98a4ec00a7f7492d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60a7381a31b84e97a068528f90813773', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72088) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:40:16 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [None req-de3ffd3f-2722-4df5-a97e-be3518e1dfaf tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] 10.0.0.210 "GET /compute/v2.1/servers/647674d8-af53-405a-8116-4b7a01549bdf" status: 200 len: 1729 microversion: 2.1 time: 0.184103 Apr 11 19:40:16 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 272/829] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 19:40:16 2023] GET /compute/v2.1/servers/647674d8-af53-405a-8116-4b7a01549bdf => generated 1729 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:40:16 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [req-465ec605-f64c-457a-8470-b055594ea208 req-454f193a-7d4a-4e50-93e7-8899e867dd2f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "647674d8-af53-405a-8116-4b7a01549bdf", "name": "network-vif-unplugged", "status": "completed", "tag": "e4e4888a-168a-4fe8-a43e-ee683b50a39a"}]} {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:40:16 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-465ec605-f64c-457a-8470-b055594ea208 req-454f193a-7d4a-4e50-93e7-8899e867dd2f service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:40:16 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-465ec605-f64c-457a-8470-b055594ea208 req-454f193a-7d4a-4e50-93e7-8899e867dd2f service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:40:16 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-465ec605-f64c-457a-8470-b055594ea208 req-454f193a-7d4a-4e50-93e7-8899e867dd2f service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:40:16 user devstack@n-api.service[72090]: INFO nova.api.openstack.compute.server_external_events [req-465ec605-f64c-457a-8470-b055594ea208 req-454f193a-7d4a-4e50-93e7-8899e867dd2f service nova] Creating event network-vif-unplugged:e4e4888a-168a-4fe8-a43e-ee683b50a39a for instance 647674d8-af53-405a-8116-4b7a01549bdf on user Apr 11 19:40:16 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [req-465ec605-f64c-457a-8470-b055594ea208 req-454f193a-7d4a-4e50-93e7-8899e867dd2f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.048689 Apr 11 19:40:16 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 275/830] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:40:16 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:40:18 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [None req-b7aefd58-368e-4109-abfe-509402a4e78e tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:40:18 user devstack@n-api.service[72089]: DEBUG nova.compute.api [None req-b7aefd58-368e-4109-abfe-509402a4e78e tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] [instance: bf0a75f5-2f44-4687-af12-046f6761fee2] Fetching instance by UUID {{(pid=72089) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:40:18 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-b7aefd58-368e-4109-abfe-509402a4e78e tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:40:18 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-b7aefd58-368e-4109-abfe-509402a4e78e tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:40:18 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-b7aefd58-368e-4109-abfe-509402a4e78e tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:40:18 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-b7aefd58-368e-4109-abfe-509402a4e78e tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:40:18 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-b7aefd58-368e-4109-abfe-509402a4e78e tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:40:18 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-b7aefd58-368e-4109-abfe-509402a4e78e tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:40:18 user devstack@n-api.service[72089]: DEBUG nova.objects.instance [None req-b7aefd58-368e-4109-abfe-509402a4e78e tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Lazy-loading 'flavor' on Instance uuid bf0a75f5-2f44-4687-af12-046f6761fee2 {{(pid=72089) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 11 19:40:18 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [None req-b7aefd58-368e-4109-abfe-509402a4e78e tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] 10.0.0.210 "POST /compute/v2.1/servers/bf0a75f5-2f44-4687-af12-046f6761fee2/action" status: 200 len: 32 microversion: 2.1 time: 0.228213 Apr 11 19:40:18 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 284/831] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Apr 11 19:40:18 2023] POST /compute/v2.1/servers/bf0a75f5-2f44-4687-af12-046f6761fee2/action => generated 32 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 11 19:40:18 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [None req-bedf6e47-7b25-43d4-a888-05d5bf1494f2 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Calling method '>' {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:40:18 user devstack@n-api.service[72088]: DEBUG nova.compute.api [None req-bedf6e47-7b25-43d4-a888-05d5bf1494f2 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] [instance: bf0a75f5-2f44-4687-af12-046f6761fee2] Fetching instance by UUID {{(pid=72088) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:40:18 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-bedf6e47-7b25-43d4-a888-05d5bf1494f2 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:40:18 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-bedf6e47-7b25-43d4-a888-05d5bf1494f2 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:40:18 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-bedf6e47-7b25-43d4-a888-05d5bf1494f2 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:40:18 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-bedf6e47-7b25-43d4-a888-05d5bf1494f2 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:40:18 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-bedf6e47-7b25-43d4-a888-05d5bf1494f2 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:40:18 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-bedf6e47-7b25-43d4-a888-05d5bf1494f2 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:40:18 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [req-ed2b56ab-b965-4975-8ff7-4d49180fbae0 req-0d895df8-567e-4619-94fb-f69ba67f3de6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "647674d8-af53-405a-8116-4b7a01549bdf", "name": "network-vif-plugged", "status": "completed", "tag": "e4e4888a-168a-4fe8-a43e-ee683b50a39a"}]} {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:40:18 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-ed2b56ab-b965-4975-8ff7-4d49180fbae0 req-0d895df8-567e-4619-94fb-f69ba67f3de6 service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:40:18 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-ed2b56ab-b965-4975-8ff7-4d49180fbae0 req-0d895df8-567e-4619-94fb-f69ba67f3de6 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:40:18 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-ed2b56ab-b965-4975-8ff7-4d49180fbae0 req-0d895df8-567e-4619-94fb-f69ba67f3de6 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:40:18 user devstack@n-api.service[72090]: INFO nova.api.openstack.compute.server_external_events [req-ed2b56ab-b965-4975-8ff7-4d49180fbae0 req-0d895df8-567e-4619-94fb-f69ba67f3de6 service nova] Creating event network-vif-plugged:e4e4888a-168a-4fe8-a43e-ee683b50a39a for instance 647674d8-af53-405a-8116-4b7a01549bdf on user Apr 11 19:40:18 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [req-ed2b56ab-b965-4975-8ff7-4d49180fbae0 req-0d895df8-567e-4619-94fb-f69ba67f3de6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031979 Apr 11 19:40:18 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 276/832] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:40:18 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:40:18 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [req-0d76927d-18b3-4e0c-98d4-ddb5b698629a req-0f235bba-5351-4b23-99ad-77d7fe241fb4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "647674d8-af53-405a-8116-4b7a01549bdf", "name": "network-vif-deleted", "tag": "e4e4888a-168a-4fe8-a43e-ee683b50a39a"}]} {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:40:18 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-0d76927d-18b3-4e0c-98d4-ddb5b698629a req-0f235bba-5351-4b23-99ad-77d7fe241fb4 service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:40:18 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-0d76927d-18b3-4e0c-98d4-ddb5b698629a req-0f235bba-5351-4b23-99ad-77d7fe241fb4 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:40:18 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-0d76927d-18b3-4e0c-98d4-ddb5b698629a req-0f235bba-5351-4b23-99ad-77d7fe241fb4 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:40:18 user devstack@n-api.service[72089]: INFO nova.api.openstack.compute.server_external_events [req-0d76927d-18b3-4e0c-98d4-ddb5b698629a req-0f235bba-5351-4b23-99ad-77d7fe241fb4 service nova] Creating event network-vif-deleted:e4e4888a-168a-4fe8-a43e-ee683b50a39a for instance 647674d8-af53-405a-8116-4b7a01549bdf on user Apr 11 19:40:18 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [req-0d76927d-18b3-4e0c-98d4-ddb5b698629a req-0f235bba-5351-4b23-99ad-77d7fe241fb4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036046 Apr 11 19:40:18 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 285/833] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:40:18 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:40:18 user devstack@n-api.service[72088]: DEBUG nova.policy [None req-bedf6e47-7b25-43d4-a888-05d5bf1494f2 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba7f82b529e74d99838b6264b94d823b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e3a291c54b49db8e12a88ba41865e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72088) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:40:18 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [None req-bedf6e47-7b25-43d4-a888-05d5bf1494f2 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bf0a75f5-2f44-4687-af12-046f6761fee2" status: 200 len: 1725 microversion: 2.1 time: 0.323706 Apr 11 19:40:18 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 273/834] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 19:40:18 2023] GET /compute/v2.1/servers/bf0a75f5-2f44-4687-af12-046f6761fee2 => generated 1725 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:40:20 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [req-1bf55d54-edfe-4374-a775-87abedde8502 req-bc6ca503-23a6-40ce-af6d-171abbcbbe9b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf0a75f5-2f44-4687-af12-046f6761fee2", "name": "network-vif-unplugged", "status": "completed", "tag": "c662b1b3-b2b3-4502-81af-9afdf3e591dc"}, {"server_uuid": "bf0a75f5-2f44-4687-af12-046f6761fee2", "name": "network-vif-plugged", "status": "completed", "tag": "c662b1b3-b2b3-4502-81af-9afdf3e591dc"}]} {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:40:20 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-1bf55d54-edfe-4374-a775-87abedde8502 req-bc6ca503-23a6-40ce-af6d-171abbcbbe9b service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:40:20 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-1bf55d54-edfe-4374-a775-87abedde8502 req-bc6ca503-23a6-40ce-af6d-171abbcbbe9b service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:40:20 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-1bf55d54-edfe-4374-a775-87abedde8502 req-bc6ca503-23a6-40ce-af6d-171abbcbbe9b service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:40:20 user devstack@n-api.service[72090]: INFO nova.api.openstack.compute.server_external_events [req-1bf55d54-edfe-4374-a775-87abedde8502 req-bc6ca503-23a6-40ce-af6d-171abbcbbe9b service nova] Creating event network-vif-unplugged:c662b1b3-b2b3-4502-81af-9afdf3e591dc for instance bf0a75f5-2f44-4687-af12-046f6761fee2 on user Apr 11 19:40:20 user devstack@n-api.service[72090]: INFO nova.api.openstack.compute.server_external_events [req-1bf55d54-edfe-4374-a775-87abedde8502 req-bc6ca503-23a6-40ce-af6d-171abbcbbe9b service nova] Creating event network-vif-plugged:c662b1b3-b2b3-4502-81af-9afdf3e591dc for instance bf0a75f5-2f44-4687-af12-046f6761fee2 on user Apr 11 19:40:20 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [req-1bf55d54-edfe-4374-a775-87abedde8502 req-bc6ca503-23a6-40ce-af6d-171abbcbbe9b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.056490 Apr 11 19:40:20 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 277/835] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:40:20 2023] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:40:22 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [None req-0b99253a-3d4b-4ee8-8cd5-8eb64005c6df tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Calling method '>' {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:40:22 user devstack@n-api.service[72089]: DEBUG nova.compute.api [None req-0b99253a-3d4b-4ee8-8cd5-8eb64005c6df tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] [instance: fbfa0825-c7c2-4f04-8c9a-102e238c3816] Fetching instance by UUID {{(pid=72089) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:40:22 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-0b99253a-3d4b-4ee8-8cd5-8eb64005c6df tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:40:22 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-0b99253a-3d4b-4ee8-8cd5-8eb64005c6df tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:40:22 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-0b99253a-3d4b-4ee8-8cd5-8eb64005c6df tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:40:22 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-0b99253a-3d4b-4ee8-8cd5-8eb64005c6df tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:40:22 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-0b99253a-3d4b-4ee8-8cd5-8eb64005c6df tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:40:22 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-0b99253a-3d4b-4ee8-8cd5-8eb64005c6df tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:40:22 user devstack@n-api.service[72089]: INFO nova.api.openstack.wsgi [None req-0b99253a-3d4b-4ee8-8cd5-8eb64005c6df tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] HTTP exception thrown: Instance fbfa0825-c7c2-4f04-8c9a-102e238c3816 could not be found. Apr 11 19:40:22 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [None req-0b99253a-3d4b-4ee8-8cd5-8eb64005c6df tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Request method failure captured: Apr 11 19:40:22 user devstack@n-api.service[72089]: request: GET /compute/v2.1/servers/fbfa0825-c7c2-4f04-8c9a-102e238c3816 HTTP/1.1 Apr 11 19:40:22 user devstack@n-api.service[72089]: Accept: application/json Apr 11 19:40:22 user devstack@n-api.service[72089]: Accept-Encoding: identity Apr 11 19:40:22 user devstack@n-api.service[72089]: Connection: close Apr 11 19:40:22 user devstack@n-api.service[72089]: Content-Length: 0 Apr 11 19:40:22 user devstack@n-api.service[72089]: Content-Type: application/json Apr 11 19:40:22 user devstack@n-api.service[72089]: Host: 10.0.0.210 Apr 11 19:40:22 user devstack@n-api.service[72089]: Openstack-System-Scope: None Apr 11 19:40:22 user devstack@n-api.service[72089]: User-Agent: python-urllib3/1.26.15 Apr 11 19:40:22 user devstack@n-api.service[72089]: X-Auth-Token: gAAAAABkNbRo6INLHGJ-FCpv0R8iTq15NRyXrCaZyB4elcR5LG0Nk6-bMCi5rNIeVdoPHHcD8ZB_4iB72kb-2Ue0k8TYx-9LMGkMAHU2x9eZVwN2smD8CJWUfTZvH8wvldsxkuE9fC9VmRhdCryMAv4uVPMG3wvq6LMuFg7oqVTdqSX0j3JCRq0 Apr 11 19:40:22 user devstack@n-api.service[72089]: X-Domain-Id: None Apr 11 19:40:22 user devstack@n-api.service[72089]: X-Domain-Name: None Apr 11 19:40:22 user devstack@n-api.service[72089]: X-Identity-Status: Confirmed Apr 11 19:40:22 user devstack@n-api.service[72089]: X-Is-Admin-Project: True Apr 11 19:40:22 user devstack@n-api.service[72089]: X-Openstack-Nova-Api-Version: 2.20 Apr 11 19:40:22 user devstack@n-api.service[72089]: X-Project-Domain-Id: default Apr 11 19:40:22 user devstack@n-api.service[72089]: X-Project-Domain-Name: Default Apr 11 19:40:22 user devstack@n-api.service[72089]: X-Project-Id: 8d8b189667e34931aa36149620a036e1 Apr 11 19:40:22 user devstack@n-api.service[72089]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-427928846 Apr 11 19:40:22 user devstack@n-api.service[72089]: X-Role: reader,member Apr 11 19:40:22 user devstack@n-api.service[72089]: X-Roles: reader,member Apr 11 19:40:22 user devstack@n-api.service[72089]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8d8b189667e34931aa36149620a036e1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/8d8b189667e34931aa36149620a036e1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8d8b189667e34931aa36149620a036e1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 11 19:40:22 user devstack@n-api.service[72089]: X-Tenant: tempest-AttachVolumeShelveTestJSON-427928846 Apr 11 19:40:22 user devstack@n-api.service[72089]: X-Tenant-Id: 8d8b189667e34931aa36149620a036e1 Apr 11 19:40:22 user devstack@n-api.service[72089]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-427928846 Apr 11 19:40:22 user devstack@n-api.service[72089]: X-User: tempest-AttachVolumeShelveTestJSON-427928846-project-member Apr 11 19:40:22 user devstack@n-api.service[72089]: X-User-Domain-Id: default Apr 11 19:40:22 user devstack@n-api.service[72089]: X-User-Domain-Name: Default Apr 11 19:40:22 user devstack@n-api.service[72089]: X-User-Id: e0558ba5a2b04d36ba2f2411090cc4e4 Apr 11 19:40:22 user devstack@n-api.service[72089]: X-User-Name: tempest-AttachVolumeShelveTestJSON-427928846-project-member Apr 11 19:40:22 user devstack@n-api.service[72089]: method: > Apr 11 19:40:22 user devstack@n-api.service[72089]: exception: Instance fbfa0825-c7c2-4f04-8c9a-102e238c3816 could not be found. Apr 11 19:40:22 user devstack@n-api.service[72089]: action_args: {'id': 'fbfa0825-c7c2-4f04-8c9a-102e238c3816'} Apr 11 19:40:22 user devstack@n-api.service[72089]: {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 19:40:22 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:40:22 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 19:40:22 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 19:40:22 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 19:40:22 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 19:40:22 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 19:40:22 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 19:40:22 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 19:40:22 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 19:40:22 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fbfa0825-c7c2-4f04-8c9a-102e238c3816 could not be found. Apr 11 19:40:22 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi Apr 11 19:40:22 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 19:40:22 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi Apr 11 19:40:22 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:40:22 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 19:40:22 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 19:40:22 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 19:40:22 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 19:40:22 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 19:40:22 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 19:40:22 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 19:40:22 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 19:40:22 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 19:40:22 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 19:40:22 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 19:40:22 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 19:40:22 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fbfa0825-c7c2-4f04-8c9a-102e238c3816 could not be found. Apr 11 19:40:22 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi Apr 11 19:40:22 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 19:40:22 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi Apr 11 19:40:22 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:40:22 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 19:40:22 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 19:40:22 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 19:40:22 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 19:40:22 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fbfa0825-c7c2-4f04-8c9a-102e238c3816 could not be found. Apr 11 19:40:22 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi Apr 11 19:40:22 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [None req-0b99253a-3d4b-4ee8-8cd5-8eb64005c6df tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Returning 404 to user: Instance fbfa0825-c7c2-4f04-8c9a-102e238c3816 could not be found. {{(pid=72089) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 19:40:22 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [None req-0b99253a-3d4b-4ee8-8cd5-8eb64005c6df tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fbfa0825-c7c2-4f04-8c9a-102e238c3816" status: 404 len: 111 microversion: 2.20 time: 0.065559 Apr 11 19:40:22 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 286/836] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 19:40:22 2023] GET /compute/v2.1/servers/fbfa0825-c7c2-4f04-8c9a-102e238c3816 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 11 19:40:22 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [None req-a774f761-83a0-46f9-9bc9-38ebb2de5479 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Calling method '.version_select at 0x7f119d98de10>' {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:40:22 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [None req-a774f761-83a0-46f9-9bc9-38ebb2de5479 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1296340783" status: 204 len: 0 microversion: 2.20 time: 0.046432 Apr 11 19:40:22 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 274/837] 10.0.0.210 () {64 vars in 1339 bytes} [Tue Apr 11 19:40:22 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1296340783 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 11 19:40:22 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [None req-375ce753-1d5d-44a0-86d5-6766c429510b tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Calling method '>' {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:40:22 user devstack@n-api.service[72090]: DEBUG nova.compute.api [None req-375ce753-1d5d-44a0-86d5-6766c429510b tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] [instance: afc22926-012a-43fe-99e6-063294c593a6] Fetching instance by UUID {{(pid=72090) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:40:22 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-375ce753-1d5d-44a0-86d5-6766c429510b tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:40:22 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-375ce753-1d5d-44a0-86d5-6766c429510b tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:40:22 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-375ce753-1d5d-44a0-86d5-6766c429510b tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:40:22 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-375ce753-1d5d-44a0-86d5-6766c429510b tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:40:22 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-375ce753-1d5d-44a0-86d5-6766c429510b tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:40:22 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-375ce753-1d5d-44a0-86d5-6766c429510b tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:40:22 user devstack@n-api.service[72090]: INFO nova.api.openstack.wsgi [None req-375ce753-1d5d-44a0-86d5-6766c429510b tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] HTTP exception thrown: Instance afc22926-012a-43fe-99e6-063294c593a6 could not be found. Apr 11 19:40:22 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [None req-375ce753-1d5d-44a0-86d5-6766c429510b tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Request method failure captured: Apr 11 19:40:22 user devstack@n-api.service[72090]: request: GET /compute/v2.1/servers/afc22926-012a-43fe-99e6-063294c593a6 HTTP/1.1 Apr 11 19:40:22 user devstack@n-api.service[72090]: Accept: application/json Apr 11 19:40:22 user devstack@n-api.service[72090]: Accept-Encoding: identity Apr 11 19:40:22 user devstack@n-api.service[72090]: Connection: close Apr 11 19:40:22 user devstack@n-api.service[72090]: Content-Length: 0 Apr 11 19:40:22 user devstack@n-api.service[72090]: Content-Type: application/json Apr 11 19:40:22 user devstack@n-api.service[72090]: Host: 10.0.0.210 Apr 11 19:40:22 user devstack@n-api.service[72090]: Openstack-System-Scope: None Apr 11 19:40:22 user devstack@n-api.service[72090]: User-Agent: python-urllib3/1.26.15 Apr 11 19:40:22 user devstack@n-api.service[72090]: X-Auth-Token: gAAAAABkNbWuPL7tpG6O55jvFSGO371AELCQlFZHf6FrRxh7vClaI6XXjuETFNQG4Gook2-ws7z2jCWcd2rLpcqQWtWmqjJ0M2xKefxUzDSsHikQ381w5ena7_2Zjp6vyHkrh7PG-gVY2vEL8dYAJIJ3D9B2mOuFBAai8zWGdpQnauKzi-Qcl_M Apr 11 19:40:22 user devstack@n-api.service[72090]: X-Domain-Id: None Apr 11 19:40:22 user devstack@n-api.service[72090]: X-Domain-Name: None Apr 11 19:40:22 user devstack@n-api.service[72090]: X-Identity-Status: Confirmed Apr 11 19:40:22 user devstack@n-api.service[72090]: X-Is-Admin-Project: True Apr 11 19:40:22 user devstack@n-api.service[72090]: X-Project-Domain-Id: default Apr 11 19:40:22 user devstack@n-api.service[72090]: X-Project-Domain-Name: Default Apr 11 19:40:22 user devstack@n-api.service[72090]: X-Project-Id: 2caba0618fc743e7bfb2dd866a511df9 Apr 11 19:40:22 user devstack@n-api.service[72090]: X-Project-Name: tempest-TestVolumeBootPattern-935343500 Apr 11 19:40:22 user devstack@n-api.service[72090]: X-Role: reader,member Apr 11 19:40:22 user devstack@n-api.service[72090]: X-Roles: reader,member Apr 11 19:40:22 user devstack@n-api.service[72090]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2caba0618fc743e7bfb2dd866a511df9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/2caba0618fc743e7bfb2dd866a511df9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2caba0618fc743e7bfb2dd866a511df9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 11 19:40:22 user devstack@n-api.service[72090]: X-Tenant: tempest-TestVolumeBootPattern-935343500 Apr 11 19:40:22 user devstack@n-api.service[72090]: X-Tenant-Id: 2caba0618fc743e7bfb2dd866a511df9 Apr 11 19:40:22 user devstack@n-api.service[72090]: X-Tenant-Name: tempest-TestVolumeBootPattern-935343500 Apr 11 19:40:22 user devstack@n-api.service[72090]: X-User: tempest-TestVolumeBootPattern-935343500-project-member Apr 11 19:40:22 user devstack@n-api.service[72090]: X-User-Domain-Id: default Apr 11 19:40:22 user devstack@n-api.service[72090]: X-User-Domain-Name: Default Apr 11 19:40:22 user devstack@n-api.service[72090]: X-User-Id: cf262cd03f4a41c4956d8784cf37d86d Apr 11 19:40:22 user devstack@n-api.service[72090]: X-User-Name: tempest-TestVolumeBootPattern-935343500-project-member Apr 11 19:40:22 user devstack@n-api.service[72090]: method: > Apr 11 19:40:22 user devstack@n-api.service[72090]: exception: Instance afc22926-012a-43fe-99e6-063294c593a6 could not be found. Apr 11 19:40:22 user devstack@n-api.service[72090]: action_args: {'id': 'afc22926-012a-43fe-99e6-063294c593a6'} Apr 11 19:40:22 user devstack@n-api.service[72090]: {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 19:40:22 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:40:22 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 19:40:22 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 19:40:22 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 19:40:22 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 19:40:22 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 19:40:22 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 19:40:22 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 19:40:22 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 19:40:22 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance afc22926-012a-43fe-99e6-063294c593a6 could not be found. Apr 11 19:40:22 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi Apr 11 19:40:22 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 19:40:22 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi Apr 11 19:40:22 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:40:22 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 19:40:22 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 19:40:22 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 19:40:22 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 19:40:22 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 19:40:22 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 19:40:22 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 19:40:22 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 19:40:22 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 19:40:22 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 19:40:22 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 19:40:22 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 19:40:22 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance afc22926-012a-43fe-99e6-063294c593a6 could not be found. Apr 11 19:40:22 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi Apr 11 19:40:22 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 19:40:22 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi Apr 11 19:40:22 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:40:22 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 19:40:22 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 19:40:22 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 19:40:22 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 19:40:22 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance afc22926-012a-43fe-99e6-063294c593a6 could not be found. Apr 11 19:40:22 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi Apr 11 19:40:22 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [None req-375ce753-1d5d-44a0-86d5-6766c429510b tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Returning 404 to user: Instance afc22926-012a-43fe-99e6-063294c593a6 could not be found. {{(pid=72090) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 19:40:22 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [None req-375ce753-1d5d-44a0-86d5-6766c429510b tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] 10.0.0.210 "GET /compute/v2.1/servers/afc22926-012a-43fe-99e6-063294c593a6" status: 404 len: 111 microversion: 2.1 time: 0.050779 Apr 11 19:40:22 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 278/838] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 19:40:22 2023] GET /compute/v2.1/servers/afc22926-012a-43fe-99e6-063294c593a6 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 19:40:22 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [None req-bd3f89da-f2dd-42a9-b51f-449eb55f1cf2 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Calling method '>' {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:40:22 user devstack@n-api.service[72089]: DEBUG nova.compute.api [None req-bd3f89da-f2dd-42a9-b51f-449eb55f1cf2 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] [instance: 781f3398-3d54-49a4-a751-60f4fbc5e49a] Fetching instance by UUID {{(pid=72089) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:40:22 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-bd3f89da-f2dd-42a9-b51f-449eb55f1cf2 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:40:22 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-bd3f89da-f2dd-42a9-b51f-449eb55f1cf2 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:40:22 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-bd3f89da-f2dd-42a9-b51f-449eb55f1cf2 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:40:22 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-bd3f89da-f2dd-42a9-b51f-449eb55f1cf2 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:40:22 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-bd3f89da-f2dd-42a9-b51f-449eb55f1cf2 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:40:22 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-bd3f89da-f2dd-42a9-b51f-449eb55f1cf2 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:40:22 user devstack@n-api.service[72089]: INFO nova.api.openstack.wsgi [None req-bd3f89da-f2dd-42a9-b51f-449eb55f1cf2 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] HTTP exception thrown: Instance 781f3398-3d54-49a4-a751-60f4fbc5e49a could not be found. Apr 11 19:40:22 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [None req-bd3f89da-f2dd-42a9-b51f-449eb55f1cf2 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Request method failure captured: Apr 11 19:40:22 user devstack@n-api.service[72089]: request: DELETE /compute/v2.1/servers/781f3398-3d54-49a4-a751-60f4fbc5e49a HTTP/1.1 Apr 11 19:40:22 user devstack@n-api.service[72089]: Accept: application/json Apr 11 19:40:22 user devstack@n-api.service[72089]: Accept-Encoding: identity Apr 11 19:40:22 user devstack@n-api.service[72089]: Connection: close Apr 11 19:40:22 user devstack@n-api.service[72089]: Content-Length: 0 Apr 11 19:40:22 user devstack@n-api.service[72089]: Content-Type: application/json Apr 11 19:40:22 user devstack@n-api.service[72089]: Host: 10.0.0.210 Apr 11 19:40:22 user devstack@n-api.service[72089]: Openstack-System-Scope: None Apr 11 19:40:22 user devstack@n-api.service[72089]: User-Agent: python-urllib3/1.26.15 Apr 11 19:40:22 user devstack@n-api.service[72089]: X-Auth-Token: gAAAAABkNbWuPL7tpG6O55jvFSGO371AELCQlFZHf6FrRxh7vClaI6XXjuETFNQG4Gook2-ws7z2jCWcd2rLpcqQWtWmqjJ0M2xKefxUzDSsHikQ381w5ena7_2Zjp6vyHkrh7PG-gVY2vEL8dYAJIJ3D9B2mOuFBAai8zWGdpQnauKzi-Qcl_M Apr 11 19:40:22 user devstack@n-api.service[72089]: X-Domain-Id: None Apr 11 19:40:22 user devstack@n-api.service[72089]: X-Domain-Name: None Apr 11 19:40:22 user devstack@n-api.service[72089]: X-Identity-Status: Confirmed Apr 11 19:40:22 user devstack@n-api.service[72089]: X-Is-Admin-Project: True Apr 11 19:40:22 user devstack@n-api.service[72089]: X-Project-Domain-Id: default Apr 11 19:40:22 user devstack@n-api.service[72089]: X-Project-Domain-Name: Default Apr 11 19:40:22 user devstack@n-api.service[72089]: X-Project-Id: 2caba0618fc743e7bfb2dd866a511df9 Apr 11 19:40:22 user devstack@n-api.service[72089]: X-Project-Name: tempest-TestVolumeBootPattern-935343500 Apr 11 19:40:22 user devstack@n-api.service[72089]: X-Role: reader,member Apr 11 19:40:22 user devstack@n-api.service[72089]: X-Roles: reader,member Apr 11 19:40:22 user devstack@n-api.service[72089]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2caba0618fc743e7bfb2dd866a511df9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/2caba0618fc743e7bfb2dd866a511df9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2caba0618fc743e7bfb2dd866a511df9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 11 19:40:22 user devstack@n-api.service[72089]: X-Tenant: tempest-TestVolumeBootPattern-935343500 Apr 11 19:40:22 user devstack@n-api.service[72089]: X-Tenant-Id: 2caba0618fc743e7bfb2dd866a511df9 Apr 11 19:40:22 user devstack@n-api.service[72089]: X-Tenant-Name: tempest-TestVolumeBootPattern-935343500 Apr 11 19:40:22 user devstack@n-api.service[72089]: X-User: tempest-TestVolumeBootPattern-935343500-project-member Apr 11 19:40:22 user devstack@n-api.service[72089]: X-User-Domain-Id: default Apr 11 19:40:22 user devstack@n-api.service[72089]: X-User-Domain-Name: Default Apr 11 19:40:22 user devstack@n-api.service[72089]: X-User-Id: cf262cd03f4a41c4956d8784cf37d86d Apr 11 19:40:22 user devstack@n-api.service[72089]: X-User-Name: tempest-TestVolumeBootPattern-935343500-project-member Apr 11 19:40:22 user devstack@n-api.service[72089]: method: > Apr 11 19:40:22 user devstack@n-api.service[72089]: exception: Instance 781f3398-3d54-49a4-a751-60f4fbc5e49a could not be found. Apr 11 19:40:22 user devstack@n-api.service[72089]: action_args: {'id': '781f3398-3d54-49a4-a751-60f4fbc5e49a'} Apr 11 19:40:22 user devstack@n-api.service[72089]: {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 19:40:22 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:40:22 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 19:40:22 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 19:40:22 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 19:40:22 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 19:40:22 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 19:40:22 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 19:40:22 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 19:40:22 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 19:40:22 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 781f3398-3d54-49a4-a751-60f4fbc5e49a could not be found. Apr 11 19:40:22 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi Apr 11 19:40:22 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 19:40:22 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi Apr 11 19:40:22 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:40:22 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 19:40:22 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 19:40:22 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 19:40:22 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 19:40:22 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 19:40:22 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 19:40:22 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 11 19:40:22 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 11 19:40:22 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 11 19:40:22 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 11 19:40:22 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 19:40:22 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 19:40:22 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 19:40:22 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 19:40:22 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 781f3398-3d54-49a4-a751-60f4fbc5e49a could not be found. Apr 11 19:40:22 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi Apr 11 19:40:22 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 19:40:22 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi Apr 11 19:40:22 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:40:22 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 19:40:22 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 19:40:22 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 19:40:22 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 19:40:22 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 781f3398-3d54-49a4-a751-60f4fbc5e49a could not be found. Apr 11 19:40:22 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi Apr 11 19:40:22 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [None req-bd3f89da-f2dd-42a9-b51f-449eb55f1cf2 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Returning 404 to user: Instance 781f3398-3d54-49a4-a751-60f4fbc5e49a could not be found. {{(pid=72089) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 19:40:22 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [None req-bd3f89da-f2dd-42a9-b51f-449eb55f1cf2 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/781f3398-3d54-49a4-a751-60f4fbc5e49a" status: 404 len: 111 microversion: 2.1 time: 0.063004 Apr 11 19:40:22 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 287/839] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 19:40:22 2023] DELETE /compute/v2.1/servers/781f3398-3d54-49a4-a751-60f4fbc5e49a => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 19:40:22 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [None req-c34d78cd-790b-45c7-838f-e533edb7c950 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Calling method '>' {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:40:22 user devstack@n-api.service[72088]: DEBUG nova.compute.api [None req-c34d78cd-790b-45c7-838f-e533edb7c950 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] [instance: 781f3398-3d54-49a4-a751-60f4fbc5e49a] Fetching instance by UUID {{(pid=72088) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:40:22 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-c34d78cd-790b-45c7-838f-e533edb7c950 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:40:22 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-c34d78cd-790b-45c7-838f-e533edb7c950 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:40:22 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-c34d78cd-790b-45c7-838f-e533edb7c950 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:40:22 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-c34d78cd-790b-45c7-838f-e533edb7c950 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:40:22 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-c34d78cd-790b-45c7-838f-e533edb7c950 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:40:22 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-c34d78cd-790b-45c7-838f-e533edb7c950 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:40:22 user devstack@n-api.service[72088]: INFO nova.api.openstack.wsgi [None req-c34d78cd-790b-45c7-838f-e533edb7c950 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] HTTP exception thrown: Instance 781f3398-3d54-49a4-a751-60f4fbc5e49a could not be found. Apr 11 19:40:22 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [None req-c34d78cd-790b-45c7-838f-e533edb7c950 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Request method failure captured: Apr 11 19:40:22 user devstack@n-api.service[72088]: request: GET /compute/v2.1/servers/781f3398-3d54-49a4-a751-60f4fbc5e49a HTTP/1.1 Apr 11 19:40:22 user devstack@n-api.service[72088]: Accept: application/json Apr 11 19:40:22 user devstack@n-api.service[72088]: Accept-Encoding: identity Apr 11 19:40:22 user devstack@n-api.service[72088]: Connection: close Apr 11 19:40:22 user devstack@n-api.service[72088]: Content-Length: 0 Apr 11 19:40:22 user devstack@n-api.service[72088]: Content-Type: application/json Apr 11 19:40:22 user devstack@n-api.service[72088]: Host: 10.0.0.210 Apr 11 19:40:22 user devstack@n-api.service[72088]: Openstack-System-Scope: None Apr 11 19:40:22 user devstack@n-api.service[72088]: User-Agent: python-urllib3/1.26.15 Apr 11 19:40:22 user devstack@n-api.service[72088]: X-Auth-Token: gAAAAABkNbWuPL7tpG6O55jvFSGO371AELCQlFZHf6FrRxh7vClaI6XXjuETFNQG4Gook2-ws7z2jCWcd2rLpcqQWtWmqjJ0M2xKefxUzDSsHikQ381w5ena7_2Zjp6vyHkrh7PG-gVY2vEL8dYAJIJ3D9B2mOuFBAai8zWGdpQnauKzi-Qcl_M Apr 11 19:40:22 user devstack@n-api.service[72088]: X-Domain-Id: None Apr 11 19:40:22 user devstack@n-api.service[72088]: X-Domain-Name: None Apr 11 19:40:22 user devstack@n-api.service[72088]: X-Identity-Status: Confirmed Apr 11 19:40:22 user devstack@n-api.service[72088]: X-Is-Admin-Project: True Apr 11 19:40:22 user devstack@n-api.service[72088]: X-Project-Domain-Id: default Apr 11 19:40:22 user devstack@n-api.service[72088]: X-Project-Domain-Name: Default Apr 11 19:40:22 user devstack@n-api.service[72088]: X-Project-Id: 2caba0618fc743e7bfb2dd866a511df9 Apr 11 19:40:22 user devstack@n-api.service[72088]: X-Project-Name: tempest-TestVolumeBootPattern-935343500 Apr 11 19:40:22 user devstack@n-api.service[72088]: X-Role: reader,member Apr 11 19:40:22 user devstack@n-api.service[72088]: X-Roles: reader,member Apr 11 19:40:22 user devstack@n-api.service[72088]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2caba0618fc743e7bfb2dd866a511df9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/2caba0618fc743e7bfb2dd866a511df9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2caba0618fc743e7bfb2dd866a511df9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 11 19:40:22 user devstack@n-api.service[72088]: X-Tenant: tempest-TestVolumeBootPattern-935343500 Apr 11 19:40:22 user devstack@n-api.service[72088]: X-Tenant-Id: 2caba0618fc743e7bfb2dd866a511df9 Apr 11 19:40:22 user devstack@n-api.service[72088]: X-Tenant-Name: tempest-TestVolumeBootPattern-935343500 Apr 11 19:40:22 user devstack@n-api.service[72088]: X-User: tempest-TestVolumeBootPattern-935343500-project-member Apr 11 19:40:22 user devstack@n-api.service[72088]: X-User-Domain-Id: default Apr 11 19:40:22 user devstack@n-api.service[72088]: X-User-Domain-Name: Default Apr 11 19:40:22 user devstack@n-api.service[72088]: X-User-Id: cf262cd03f4a41c4956d8784cf37d86d Apr 11 19:40:22 user devstack@n-api.service[72088]: X-User-Name: tempest-TestVolumeBootPattern-935343500-project-member Apr 11 19:40:22 user devstack@n-api.service[72088]: method: > Apr 11 19:40:22 user devstack@n-api.service[72088]: exception: Instance 781f3398-3d54-49a4-a751-60f4fbc5e49a could not be found. Apr 11 19:40:22 user devstack@n-api.service[72088]: action_args: {'id': '781f3398-3d54-49a4-a751-60f4fbc5e49a'} Apr 11 19:40:22 user devstack@n-api.service[72088]: {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 19:40:22 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:40:22 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 19:40:22 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 19:40:22 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 19:40:22 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 19:40:22 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 19:40:22 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 19:40:22 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 19:40:22 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 19:40:22 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 781f3398-3d54-49a4-a751-60f4fbc5e49a could not be found. Apr 11 19:40:22 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi Apr 11 19:40:22 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 19:40:22 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi Apr 11 19:40:22 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:40:22 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 19:40:22 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 19:40:22 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 19:40:22 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 19:40:22 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 19:40:22 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 19:40:22 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 19:40:22 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 19:40:22 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 19:40:22 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 19:40:22 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 19:40:22 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 19:40:22 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 781f3398-3d54-49a4-a751-60f4fbc5e49a could not be found. Apr 11 19:40:22 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi Apr 11 19:40:22 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 19:40:22 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi Apr 11 19:40:22 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:40:22 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 19:40:22 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 19:40:22 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 19:40:22 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 19:40:22 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 781f3398-3d54-49a4-a751-60f4fbc5e49a could not be found. Apr 11 19:40:22 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi Apr 11 19:40:22 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [None req-c34d78cd-790b-45c7-838f-e533edb7c950 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Returning 404 to user: Instance 781f3398-3d54-49a4-a751-60f4fbc5e49a could not be found. {{(pid=72088) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 19:40:22 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [None req-c34d78cd-790b-45c7-838f-e533edb7c950 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] 10.0.0.210 "GET /compute/v2.1/servers/781f3398-3d54-49a4-a751-60f4fbc5e49a" status: 404 len: 111 microversion: 2.1 time: 0.035803 Apr 11 19:40:22 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 275/840] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 19:40:22 2023] GET /compute/v2.1/servers/781f3398-3d54-49a4-a751-60f4fbc5e49a => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 19:40:22 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [req-3cf76fd3-601a-4549-b5e4-3c3073f6d5b1 req-1c4ba7cb-3bc3-45d6-b945-19c29ed6296b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf0a75f5-2f44-4687-af12-046f6761fee2", "name": "network-vif-plugged", "status": "completed", "tag": "c662b1b3-b2b3-4502-81af-9afdf3e591dc"}, {"server_uuid": "bf0a75f5-2f44-4687-af12-046f6761fee2", "name": "network-vif-plugged", "status": "completed", "tag": "c662b1b3-b2b3-4502-81af-9afdf3e591dc"}]} {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:40:22 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-3cf76fd3-601a-4549-b5e4-3c3073f6d5b1 req-1c4ba7cb-3bc3-45d6-b945-19c29ed6296b service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:40:22 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-3cf76fd3-601a-4549-b5e4-3c3073f6d5b1 req-1c4ba7cb-3bc3-45d6-b945-19c29ed6296b service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:40:22 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-3cf76fd3-601a-4549-b5e4-3c3073f6d5b1 req-1c4ba7cb-3bc3-45d6-b945-19c29ed6296b service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:40:22 user devstack@n-api.service[72090]: INFO nova.api.openstack.compute.server_external_events [req-3cf76fd3-601a-4549-b5e4-3c3073f6d5b1 req-1c4ba7cb-3bc3-45d6-b945-19c29ed6296b service nova] Creating event network-vif-plugged:c662b1b3-b2b3-4502-81af-9afdf3e591dc for instance bf0a75f5-2f44-4687-af12-046f6761fee2 on user Apr 11 19:40:22 user devstack@n-api.service[72090]: INFO nova.api.openstack.compute.server_external_events [req-3cf76fd3-601a-4549-b5e4-3c3073f6d5b1 req-1c4ba7cb-3bc3-45d6-b945-19c29ed6296b service nova] Creating event network-vif-plugged:c662b1b3-b2b3-4502-81af-9afdf3e591dc for instance bf0a75f5-2f44-4687-af12-046f6761fee2 on user Apr 11 19:40:22 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [req-3cf76fd3-601a-4549-b5e4-3c3073f6d5b1 req-1c4ba7cb-3bc3-45d6-b945-19c29ed6296b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.048334 Apr 11 19:40:22 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 279/841] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:40:22 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:40:23 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [None req-61e58255-a312-4b43-856e-bb4862c25c17 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Calling method '>' {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:40:23 user devstack@n-api.service[72089]: DEBUG nova.compute.api [None req-61e58255-a312-4b43-856e-bb4862c25c17 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] [instance: afc22926-012a-43fe-99e6-063294c593a6] Fetching instance by UUID {{(pid=72089) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:40:23 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-61e58255-a312-4b43-856e-bb4862c25c17 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:40:23 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-61e58255-a312-4b43-856e-bb4862c25c17 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:40:23 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-61e58255-a312-4b43-856e-bb4862c25c17 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:40:23 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-61e58255-a312-4b43-856e-bb4862c25c17 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:40:23 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-61e58255-a312-4b43-856e-bb4862c25c17 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:40:23 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-61e58255-a312-4b43-856e-bb4862c25c17 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:40:23 user devstack@n-api.service[72089]: INFO nova.api.openstack.wsgi [None req-61e58255-a312-4b43-856e-bb4862c25c17 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] HTTP exception thrown: Instance afc22926-012a-43fe-99e6-063294c593a6 could not be found. Apr 11 19:40:23 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [None req-61e58255-a312-4b43-856e-bb4862c25c17 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Request method failure captured: Apr 11 19:40:23 user devstack@n-api.service[72089]: request: DELETE /compute/v2.1/servers/afc22926-012a-43fe-99e6-063294c593a6 HTTP/1.1 Apr 11 19:40:23 user devstack@n-api.service[72089]: Accept: application/json Apr 11 19:40:23 user devstack@n-api.service[72089]: Accept-Encoding: identity Apr 11 19:40:23 user devstack@n-api.service[72089]: Connection: close Apr 11 19:40:23 user devstack@n-api.service[72089]: Content-Length: 0 Apr 11 19:40:23 user devstack@n-api.service[72089]: Content-Type: application/json Apr 11 19:40:23 user devstack@n-api.service[72089]: Host: 10.0.0.210 Apr 11 19:40:23 user devstack@n-api.service[72089]: Openstack-System-Scope: None Apr 11 19:40:23 user devstack@n-api.service[72089]: User-Agent: python-urllib3/1.26.15 Apr 11 19:40:23 user devstack@n-api.service[72089]: X-Auth-Token: gAAAAABkNbWuPL7tpG6O55jvFSGO371AELCQlFZHf6FrRxh7vClaI6XXjuETFNQG4Gook2-ws7z2jCWcd2rLpcqQWtWmqjJ0M2xKefxUzDSsHikQ381w5ena7_2Zjp6vyHkrh7PG-gVY2vEL8dYAJIJ3D9B2mOuFBAai8zWGdpQnauKzi-Qcl_M Apr 11 19:40:23 user devstack@n-api.service[72089]: X-Domain-Id: None Apr 11 19:40:23 user devstack@n-api.service[72089]: X-Domain-Name: None Apr 11 19:40:23 user devstack@n-api.service[72089]: X-Identity-Status: Confirmed Apr 11 19:40:23 user devstack@n-api.service[72089]: X-Is-Admin-Project: True Apr 11 19:40:23 user devstack@n-api.service[72089]: X-Project-Domain-Id: default Apr 11 19:40:23 user devstack@n-api.service[72089]: X-Project-Domain-Name: Default Apr 11 19:40:23 user devstack@n-api.service[72089]: X-Project-Id: 2caba0618fc743e7bfb2dd866a511df9 Apr 11 19:40:23 user devstack@n-api.service[72089]: X-Project-Name: tempest-TestVolumeBootPattern-935343500 Apr 11 19:40:23 user devstack@n-api.service[72089]: X-Role: reader,member Apr 11 19:40:23 user devstack@n-api.service[72089]: X-Roles: reader,member Apr 11 19:40:23 user devstack@n-api.service[72089]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2caba0618fc743e7bfb2dd866a511df9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/2caba0618fc743e7bfb2dd866a511df9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2caba0618fc743e7bfb2dd866a511df9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 11 19:40:23 user devstack@n-api.service[72089]: X-Tenant: tempest-TestVolumeBootPattern-935343500 Apr 11 19:40:23 user devstack@n-api.service[72089]: X-Tenant-Id: 2caba0618fc743e7bfb2dd866a511df9 Apr 11 19:40:23 user devstack@n-api.service[72089]: X-Tenant-Name: tempest-TestVolumeBootPattern-935343500 Apr 11 19:40:23 user devstack@n-api.service[72089]: X-User: tempest-TestVolumeBootPattern-935343500-project-member Apr 11 19:40:23 user devstack@n-api.service[72089]: X-User-Domain-Id: default Apr 11 19:40:23 user devstack@n-api.service[72089]: X-User-Domain-Name: Default Apr 11 19:40:23 user devstack@n-api.service[72089]: X-User-Id: cf262cd03f4a41c4956d8784cf37d86d Apr 11 19:40:23 user devstack@n-api.service[72089]: X-User-Name: tempest-TestVolumeBootPattern-935343500-project-member Apr 11 19:40:23 user devstack@n-api.service[72089]: method: > Apr 11 19:40:23 user devstack@n-api.service[72089]: exception: Instance afc22926-012a-43fe-99e6-063294c593a6 could not be found. Apr 11 19:40:23 user devstack@n-api.service[72089]: action_args: {'id': 'afc22926-012a-43fe-99e6-063294c593a6'} Apr 11 19:40:23 user devstack@n-api.service[72089]: {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 19:40:23 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:40:23 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 19:40:23 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 19:40:23 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 19:40:23 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 19:40:23 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 19:40:23 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 19:40:23 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 19:40:23 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 19:40:23 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance afc22926-012a-43fe-99e6-063294c593a6 could not be found. Apr 11 19:40:23 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi Apr 11 19:40:23 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 19:40:23 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi Apr 11 19:40:23 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:40:23 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 19:40:23 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 19:40:23 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 19:40:23 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 19:40:23 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 19:40:23 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 19:40:23 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 11 19:40:23 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 11 19:40:23 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 11 19:40:23 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 11 19:40:23 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 19:40:23 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 19:40:23 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 19:40:23 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 19:40:23 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance afc22926-012a-43fe-99e6-063294c593a6 could not be found. Apr 11 19:40:23 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi Apr 11 19:40:23 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 19:40:23 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi Apr 11 19:40:23 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:40:23 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 19:40:23 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 19:40:23 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 19:40:23 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 19:40:23 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance afc22926-012a-43fe-99e6-063294c593a6 could not be found. Apr 11 19:40:23 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi Apr 11 19:40:23 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [None req-61e58255-a312-4b43-856e-bb4862c25c17 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Returning 404 to user: Instance afc22926-012a-43fe-99e6-063294c593a6 could not be found. {{(pid=72089) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 19:40:23 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [None req-61e58255-a312-4b43-856e-bb4862c25c17 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/afc22926-012a-43fe-99e6-063294c593a6" status: 404 len: 111 microversion: 2.1 time: 0.036627 Apr 11 19:40:23 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 288/842] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 19:40:23 2023] DELETE /compute/v2.1/servers/afc22926-012a-43fe-99e6-063294c593a6 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 19:40:23 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [None req-cc32a22b-3e86-42df-9b1b-b7854ae22975 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Calling method '>' {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:40:23 user devstack@n-api.service[72088]: DEBUG nova.compute.api [None req-cc32a22b-3e86-42df-9b1b-b7854ae22975 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] [instance: afc22926-012a-43fe-99e6-063294c593a6] Fetching instance by UUID {{(pid=72088) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:40:23 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-cc32a22b-3e86-42df-9b1b-b7854ae22975 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:40:23 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-cc32a22b-3e86-42df-9b1b-b7854ae22975 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:40:23 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-cc32a22b-3e86-42df-9b1b-b7854ae22975 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:40:23 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-cc32a22b-3e86-42df-9b1b-b7854ae22975 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:40:23 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-cc32a22b-3e86-42df-9b1b-b7854ae22975 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:40:23 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-cc32a22b-3e86-42df-9b1b-b7854ae22975 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:40:23 user devstack@n-api.service[72088]: INFO nova.api.openstack.wsgi [None req-cc32a22b-3e86-42df-9b1b-b7854ae22975 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] HTTP exception thrown: Instance afc22926-012a-43fe-99e6-063294c593a6 could not be found. Apr 11 19:40:23 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [None req-cc32a22b-3e86-42df-9b1b-b7854ae22975 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Request method failure captured: Apr 11 19:40:23 user devstack@n-api.service[72088]: request: GET /compute/v2.1/servers/afc22926-012a-43fe-99e6-063294c593a6 HTTP/1.1 Apr 11 19:40:23 user devstack@n-api.service[72088]: Accept: application/json Apr 11 19:40:23 user devstack@n-api.service[72088]: Accept-Encoding: identity Apr 11 19:40:23 user devstack@n-api.service[72088]: Connection: close Apr 11 19:40:23 user devstack@n-api.service[72088]: Content-Length: 0 Apr 11 19:40:23 user devstack@n-api.service[72088]: Content-Type: application/json Apr 11 19:40:23 user devstack@n-api.service[72088]: Host: 10.0.0.210 Apr 11 19:40:23 user devstack@n-api.service[72088]: Openstack-System-Scope: None Apr 11 19:40:23 user devstack@n-api.service[72088]: User-Agent: python-urllib3/1.26.15 Apr 11 19:40:23 user devstack@n-api.service[72088]: X-Auth-Token: gAAAAABkNbWuPL7tpG6O55jvFSGO371AELCQlFZHf6FrRxh7vClaI6XXjuETFNQG4Gook2-ws7z2jCWcd2rLpcqQWtWmqjJ0M2xKefxUzDSsHikQ381w5ena7_2Zjp6vyHkrh7PG-gVY2vEL8dYAJIJ3D9B2mOuFBAai8zWGdpQnauKzi-Qcl_M Apr 11 19:40:23 user devstack@n-api.service[72088]: X-Domain-Id: None Apr 11 19:40:23 user devstack@n-api.service[72088]: X-Domain-Name: None Apr 11 19:40:23 user devstack@n-api.service[72088]: X-Identity-Status: Confirmed Apr 11 19:40:23 user devstack@n-api.service[72088]: X-Is-Admin-Project: True Apr 11 19:40:23 user devstack@n-api.service[72088]: X-Project-Domain-Id: default Apr 11 19:40:23 user devstack@n-api.service[72088]: X-Project-Domain-Name: Default Apr 11 19:40:23 user devstack@n-api.service[72088]: X-Project-Id: 2caba0618fc743e7bfb2dd866a511df9 Apr 11 19:40:23 user devstack@n-api.service[72088]: X-Project-Name: tempest-TestVolumeBootPattern-935343500 Apr 11 19:40:23 user devstack@n-api.service[72088]: X-Role: reader,member Apr 11 19:40:23 user devstack@n-api.service[72088]: X-Roles: reader,member Apr 11 19:40:23 user devstack@n-api.service[72088]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2caba0618fc743e7bfb2dd866a511df9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/2caba0618fc743e7bfb2dd866a511df9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2caba0618fc743e7bfb2dd866a511df9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 11 19:40:23 user devstack@n-api.service[72088]: X-Tenant: tempest-TestVolumeBootPattern-935343500 Apr 11 19:40:23 user devstack@n-api.service[72088]: X-Tenant-Id: 2caba0618fc743e7bfb2dd866a511df9 Apr 11 19:40:23 user devstack@n-api.service[72088]: X-Tenant-Name: tempest-TestVolumeBootPattern-935343500 Apr 11 19:40:23 user devstack@n-api.service[72088]: X-User: tempest-TestVolumeBootPattern-935343500-project-member Apr 11 19:40:23 user devstack@n-api.service[72088]: X-User-Domain-Id: default Apr 11 19:40:23 user devstack@n-api.service[72088]: X-User-Domain-Name: Default Apr 11 19:40:23 user devstack@n-api.service[72088]: X-User-Id: cf262cd03f4a41c4956d8784cf37d86d Apr 11 19:40:23 user devstack@n-api.service[72088]: X-User-Name: tempest-TestVolumeBootPattern-935343500-project-member Apr 11 19:40:23 user devstack@n-api.service[72088]: method: > Apr 11 19:40:23 user devstack@n-api.service[72088]: exception: Instance afc22926-012a-43fe-99e6-063294c593a6 could not be found. Apr 11 19:40:23 user devstack@n-api.service[72088]: action_args: {'id': 'afc22926-012a-43fe-99e6-063294c593a6'} Apr 11 19:40:23 user devstack@n-api.service[72088]: {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 19:40:23 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:40:23 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 19:40:23 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 19:40:23 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 19:40:23 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 19:40:23 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 19:40:23 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 19:40:23 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 19:40:23 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 19:40:23 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance afc22926-012a-43fe-99e6-063294c593a6 could not be found. Apr 11 19:40:23 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi Apr 11 19:40:23 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 19:40:23 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi Apr 11 19:40:23 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:40:23 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 19:40:23 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 19:40:23 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 19:40:23 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 19:40:23 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 19:40:23 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 19:40:23 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 19:40:23 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 19:40:23 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 19:40:23 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 19:40:23 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 19:40:23 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 19:40:23 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance afc22926-012a-43fe-99e6-063294c593a6 could not be found. Apr 11 19:40:23 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi Apr 11 19:40:23 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 19:40:23 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi Apr 11 19:40:23 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:40:23 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 19:40:23 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 19:40:23 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 19:40:23 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 19:40:23 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance afc22926-012a-43fe-99e6-063294c593a6 could not be found. Apr 11 19:40:23 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi Apr 11 19:40:23 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [None req-cc32a22b-3e86-42df-9b1b-b7854ae22975 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Returning 404 to user: Instance afc22926-012a-43fe-99e6-063294c593a6 could not be found. {{(pid=72088) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 19:40:23 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [None req-cc32a22b-3e86-42df-9b1b-b7854ae22975 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] 10.0.0.210 "GET /compute/v2.1/servers/afc22926-012a-43fe-99e6-063294c593a6" status: 404 len: 111 microversion: 2.1 time: 0.029691 Apr 11 19:40:23 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 276/843] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 19:40:23 2023] GET /compute/v2.1/servers/afc22926-012a-43fe-99e6-063294c593a6 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 19:40:23 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [None req-a18b4d4f-392a-4234-8f71-c2fd7f9072b2 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Action: 'create', calling method: .version_select at 0x7f119d905900>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1844027973", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPal5dIOOTQX1AtimGkw05FO0Z9eaerqpiFYTxmlD5RcLLewnhLN4pAKWK7d0rX0zQgFYrr+JvrnM8AxIhiJUbrvnXCoFiGl5kaOegYnss1VivHpq7rMu1EVV1XJIRedHg=="}} {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:40:23 user devstack@n-api.service[72090]: DEBUG nova.quota [None req-a18b4d4f-392a-4234-8f71-c2fd7f9072b2 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Getting quotas for project 2caba0618fc743e7bfb2dd866a511df9. Resources: {'key_pairs'} {{(pid=72090) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 19:40:23 user devstack@n-api.service[72090]: DEBUG nova.quota [None req-a18b4d4f-392a-4234-8f71-c2fd7f9072b2 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Getting quotas for user cf262cd03f4a41c4956d8784cf37d86d and project 2caba0618fc743e7bfb2dd866a511df9. Resources: {'key_pairs'} {{(pid=72090) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 19:40:23 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [None req-a18b4d4f-392a-4234-8f71-c2fd7f9072b2 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.451813 Apr 11 19:40:23 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 280/844] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Apr 11 19:40:23 2023] POST /compute/v2.1/os-keypairs => generated 400 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:40:26 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [None req-37a5a548-95cc-468f-8d67-b01531eab31f tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Calling method '>' {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:40:26 user devstack@n-api.service[72089]: DEBUG nova.compute.api [None req-37a5a548-95cc-468f-8d67-b01531eab31f tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] [instance: fbfa0825-c7c2-4f04-8c9a-102e238c3816] Fetching instance by UUID {{(pid=72089) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:40:26 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-37a5a548-95cc-468f-8d67-b01531eab31f tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:40:26 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-37a5a548-95cc-468f-8d67-b01531eab31f tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:40:26 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-37a5a548-95cc-468f-8d67-b01531eab31f tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:40:26 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-37a5a548-95cc-468f-8d67-b01531eab31f tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:40:26 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-37a5a548-95cc-468f-8d67-b01531eab31f tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:40:26 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-37a5a548-95cc-468f-8d67-b01531eab31f tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:40:26 user devstack@n-api.service[72089]: INFO nova.api.openstack.wsgi [None req-37a5a548-95cc-468f-8d67-b01531eab31f tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] HTTP exception thrown: Instance fbfa0825-c7c2-4f04-8c9a-102e238c3816 could not be found. Apr 11 19:40:26 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [None req-37a5a548-95cc-468f-8d67-b01531eab31f tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Request method failure captured: Apr 11 19:40:26 user devstack@n-api.service[72089]: request: DELETE /compute/v2.1/servers/fbfa0825-c7c2-4f04-8c9a-102e238c3816 HTTP/1.1 Apr 11 19:40:26 user devstack@n-api.service[72089]: Accept: application/json Apr 11 19:40:26 user devstack@n-api.service[72089]: Accept-Encoding: identity Apr 11 19:40:26 user devstack@n-api.service[72089]: Connection: close Apr 11 19:40:26 user devstack@n-api.service[72089]: Content-Length: 0 Apr 11 19:40:26 user devstack@n-api.service[72089]: Content-Type: application/json Apr 11 19:40:26 user devstack@n-api.service[72089]: Host: 10.0.0.210 Apr 11 19:40:26 user devstack@n-api.service[72089]: Openstack-System-Scope: None Apr 11 19:40:26 user devstack@n-api.service[72089]: User-Agent: python-urllib3/1.26.15 Apr 11 19:40:26 user devstack@n-api.service[72089]: X-Auth-Token: gAAAAABkNbRo6INLHGJ-FCpv0R8iTq15NRyXrCaZyB4elcR5LG0Nk6-bMCi5rNIeVdoPHHcD8ZB_4iB72kb-2Ue0k8TYx-9LMGkMAHU2x9eZVwN2smD8CJWUfTZvH8wvldsxkuE9fC9VmRhdCryMAv4uVPMG3wvq6LMuFg7oqVTdqSX0j3JCRq0 Apr 11 19:40:26 user devstack@n-api.service[72089]: X-Domain-Id: None Apr 11 19:40:26 user devstack@n-api.service[72089]: X-Domain-Name: None Apr 11 19:40:26 user devstack@n-api.service[72089]: X-Identity-Status: Confirmed Apr 11 19:40:26 user devstack@n-api.service[72089]: X-Is-Admin-Project: True Apr 11 19:40:26 user devstack@n-api.service[72089]: X-Openstack-Nova-Api-Version: 2.20 Apr 11 19:40:26 user devstack@n-api.service[72089]: X-Project-Domain-Id: default Apr 11 19:40:26 user devstack@n-api.service[72089]: X-Project-Domain-Name: Default Apr 11 19:40:26 user devstack@n-api.service[72089]: X-Project-Id: 8d8b189667e34931aa36149620a036e1 Apr 11 19:40:26 user devstack@n-api.service[72089]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-427928846 Apr 11 19:40:26 user devstack@n-api.service[72089]: X-Role: reader,member Apr 11 19:40:26 user devstack@n-api.service[72089]: X-Roles: reader,member Apr 11 19:40:26 user devstack@n-api.service[72089]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8d8b189667e34931aa36149620a036e1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/8d8b189667e34931aa36149620a036e1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8d8b189667e34931aa36149620a036e1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 11 19:40:26 user devstack@n-api.service[72089]: X-Tenant: tempest-AttachVolumeShelveTestJSON-427928846 Apr 11 19:40:26 user devstack@n-api.service[72089]: X-Tenant-Id: 8d8b189667e34931aa36149620a036e1 Apr 11 19:40:26 user devstack@n-api.service[72089]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-427928846 Apr 11 19:40:26 user devstack@n-api.service[72089]: X-User: tempest-AttachVolumeShelveTestJSON-427928846-project-member Apr 11 19:40:26 user devstack@n-api.service[72089]: X-User-Domain-Id: default Apr 11 19:40:26 user devstack@n-api.service[72089]: X-User-Domain-Name: Default Apr 11 19:40:26 user devstack@n-api.service[72089]: X-User-Id: e0558ba5a2b04d36ba2f2411090cc4e4 Apr 11 19:40:26 user devstack@n-api.service[72089]: X-User-Name: tempest-AttachVolumeShelveTestJSON-427928846-project-member Apr 11 19:40:26 user devstack@n-api.service[72089]: method: > Apr 11 19:40:26 user devstack@n-api.service[72089]: exception: Instance fbfa0825-c7c2-4f04-8c9a-102e238c3816 could not be found. Apr 11 19:40:26 user devstack@n-api.service[72089]: action_args: {'id': 'fbfa0825-c7c2-4f04-8c9a-102e238c3816'} Apr 11 19:40:26 user devstack@n-api.service[72089]: {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 19:40:26 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:40:26 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 19:40:26 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 19:40:26 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 19:40:26 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 19:40:26 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 19:40:26 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 19:40:26 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 19:40:26 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 19:40:26 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fbfa0825-c7c2-4f04-8c9a-102e238c3816 could not be found. Apr 11 19:40:26 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi Apr 11 19:40:26 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 19:40:26 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi Apr 11 19:40:26 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:40:26 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 19:40:26 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 19:40:26 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 19:40:26 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 19:40:26 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 19:40:26 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 19:40:26 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 11 19:40:26 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 11 19:40:26 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 11 19:40:26 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 11 19:40:26 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 19:40:26 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 19:40:26 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 19:40:26 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 19:40:26 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fbfa0825-c7c2-4f04-8c9a-102e238c3816 could not be found. Apr 11 19:40:26 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi Apr 11 19:40:26 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 19:40:26 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi Apr 11 19:40:26 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:40:26 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 19:40:26 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 19:40:26 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 19:40:26 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 19:40:26 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fbfa0825-c7c2-4f04-8c9a-102e238c3816 could not be found. Apr 11 19:40:26 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi Apr 11 19:40:26 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [None req-37a5a548-95cc-468f-8d67-b01531eab31f tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Returning 404 to user: Instance fbfa0825-c7c2-4f04-8c9a-102e238c3816 could not be found. {{(pid=72089) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 19:40:26 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [None req-37a5a548-95cc-468f-8d67-b01531eab31f tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/fbfa0825-c7c2-4f04-8c9a-102e238c3816" status: 404 len: 111 microversion: 2.20 time: 0.034730 Apr 11 19:40:26 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 289/845] 10.0.0.210 () {64 vars in 1357 bytes} [Tue Apr 11 19:40:26 2023] DELETE /compute/v2.1/servers/fbfa0825-c7c2-4f04-8c9a-102e238c3816 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 11 19:40:26 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [None req-37e2bedb-1eca-4af9-bc63-75fd6f2de651 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Calling method '>' {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:40:26 user devstack@n-api.service[72088]: DEBUG nova.compute.api [None req-37e2bedb-1eca-4af9-bc63-75fd6f2de651 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] [instance: fbfa0825-c7c2-4f04-8c9a-102e238c3816] Fetching instance by UUID {{(pid=72088) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:40:26 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-37e2bedb-1eca-4af9-bc63-75fd6f2de651 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:40:26 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-37e2bedb-1eca-4af9-bc63-75fd6f2de651 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:40:26 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-37e2bedb-1eca-4af9-bc63-75fd6f2de651 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:40:26 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-37e2bedb-1eca-4af9-bc63-75fd6f2de651 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:40:26 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-37e2bedb-1eca-4af9-bc63-75fd6f2de651 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:40:26 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-37e2bedb-1eca-4af9-bc63-75fd6f2de651 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:40:26 user devstack@n-api.service[72088]: INFO nova.api.openstack.wsgi [None req-37e2bedb-1eca-4af9-bc63-75fd6f2de651 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] HTTP exception thrown: Instance fbfa0825-c7c2-4f04-8c9a-102e238c3816 could not be found. Apr 11 19:40:26 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [None req-37e2bedb-1eca-4af9-bc63-75fd6f2de651 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Request method failure captured: Apr 11 19:40:26 user devstack@n-api.service[72088]: request: GET /compute/v2.1/servers/fbfa0825-c7c2-4f04-8c9a-102e238c3816 HTTP/1.1 Apr 11 19:40:26 user devstack@n-api.service[72088]: Accept: application/json Apr 11 19:40:26 user devstack@n-api.service[72088]: Accept-Encoding: identity Apr 11 19:40:26 user devstack@n-api.service[72088]: Connection: close Apr 11 19:40:26 user devstack@n-api.service[72088]: Content-Length: 0 Apr 11 19:40:26 user devstack@n-api.service[72088]: Content-Type: application/json Apr 11 19:40:26 user devstack@n-api.service[72088]: Host: 10.0.0.210 Apr 11 19:40:26 user devstack@n-api.service[72088]: Openstack-System-Scope: None Apr 11 19:40:26 user devstack@n-api.service[72088]: User-Agent: python-urllib3/1.26.15 Apr 11 19:40:26 user devstack@n-api.service[72088]: X-Auth-Token: gAAAAABkNbRo6INLHGJ-FCpv0R8iTq15NRyXrCaZyB4elcR5LG0Nk6-bMCi5rNIeVdoPHHcD8ZB_4iB72kb-2Ue0k8TYx-9LMGkMAHU2x9eZVwN2smD8CJWUfTZvH8wvldsxkuE9fC9VmRhdCryMAv4uVPMG3wvq6LMuFg7oqVTdqSX0j3JCRq0 Apr 11 19:40:26 user devstack@n-api.service[72088]: X-Domain-Id: None Apr 11 19:40:26 user devstack@n-api.service[72088]: X-Domain-Name: None Apr 11 19:40:26 user devstack@n-api.service[72088]: X-Identity-Status: Confirmed Apr 11 19:40:26 user devstack@n-api.service[72088]: X-Is-Admin-Project: True Apr 11 19:40:26 user devstack@n-api.service[72088]: X-Openstack-Nova-Api-Version: 2.20 Apr 11 19:40:26 user devstack@n-api.service[72088]: X-Project-Domain-Id: default Apr 11 19:40:26 user devstack@n-api.service[72088]: X-Project-Domain-Name: Default Apr 11 19:40:26 user devstack@n-api.service[72088]: X-Project-Id: 8d8b189667e34931aa36149620a036e1 Apr 11 19:40:26 user devstack@n-api.service[72088]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-427928846 Apr 11 19:40:26 user devstack@n-api.service[72088]: X-Role: reader,member Apr 11 19:40:26 user devstack@n-api.service[72088]: X-Roles: reader,member Apr 11 19:40:26 user devstack@n-api.service[72088]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8d8b189667e34931aa36149620a036e1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/8d8b189667e34931aa36149620a036e1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8d8b189667e34931aa36149620a036e1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 11 19:40:26 user devstack@n-api.service[72088]: X-Tenant: tempest-AttachVolumeShelveTestJSON-427928846 Apr 11 19:40:26 user devstack@n-api.service[72088]: X-Tenant-Id: 8d8b189667e34931aa36149620a036e1 Apr 11 19:40:26 user devstack@n-api.service[72088]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-427928846 Apr 11 19:40:26 user devstack@n-api.service[72088]: X-User: tempest-AttachVolumeShelveTestJSON-427928846-project-member Apr 11 19:40:26 user devstack@n-api.service[72088]: X-User-Domain-Id: default Apr 11 19:40:26 user devstack@n-api.service[72088]: X-User-Domain-Name: Default Apr 11 19:40:26 user devstack@n-api.service[72088]: X-User-Id: e0558ba5a2b04d36ba2f2411090cc4e4 Apr 11 19:40:26 user devstack@n-api.service[72088]: X-User-Name: tempest-AttachVolumeShelveTestJSON-427928846-project-member Apr 11 19:40:26 user devstack@n-api.service[72088]: method: > Apr 11 19:40:26 user devstack@n-api.service[72088]: exception: Instance fbfa0825-c7c2-4f04-8c9a-102e238c3816 could not be found. Apr 11 19:40:26 user devstack@n-api.service[72088]: action_args: {'id': 'fbfa0825-c7c2-4f04-8c9a-102e238c3816'} Apr 11 19:40:26 user devstack@n-api.service[72088]: {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 19:40:26 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:40:26 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 19:40:26 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 19:40:26 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 19:40:26 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 19:40:26 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 19:40:26 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 19:40:26 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 19:40:26 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 19:40:26 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fbfa0825-c7c2-4f04-8c9a-102e238c3816 could not be found. Apr 11 19:40:26 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi Apr 11 19:40:26 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 19:40:26 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi Apr 11 19:40:26 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:40:26 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 19:40:26 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 19:40:26 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 19:40:26 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 19:40:26 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 19:40:26 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 19:40:26 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 19:40:26 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 19:40:26 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 19:40:26 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 19:40:26 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 19:40:26 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 19:40:26 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fbfa0825-c7c2-4f04-8c9a-102e238c3816 could not be found. Apr 11 19:40:26 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi Apr 11 19:40:26 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 19:40:26 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi Apr 11 19:40:26 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:40:26 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 19:40:26 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 19:40:26 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 19:40:26 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 19:40:26 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fbfa0825-c7c2-4f04-8c9a-102e238c3816 could not be found. Apr 11 19:40:26 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi Apr 11 19:40:26 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [None req-37e2bedb-1eca-4af9-bc63-75fd6f2de651 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Returning 404 to user: Instance fbfa0825-c7c2-4f04-8c9a-102e238c3816 could not be found. {{(pid=72088) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 19:40:26 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [None req-37e2bedb-1eca-4af9-bc63-75fd6f2de651 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fbfa0825-c7c2-4f04-8c9a-102e238c3816" status: 404 len: 111 microversion: 2.20 time: 0.028851 Apr 11 19:40:26 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 277/846] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 19:40:26 2023] GET /compute/v2.1/servers/fbfa0825-c7c2-4f04-8c9a-102e238c3816 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 11 19:40:27 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [None req-08ba2d65-f82e-4f1c-a353-6be0c8d40cba tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Calling method '>' {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:40:27 user devstack@n-api.service[72090]: DEBUG nova.compute.api [None req-08ba2d65-f82e-4f1c-a353-6be0c8d40cba tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] [instance: 720c683f-c03a-444c-92a8-daf97c9f524b] Fetching instance by UUID {{(pid=72090) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:40:27 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-08ba2d65-f82e-4f1c-a353-6be0c8d40cba tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:40:27 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-08ba2d65-f82e-4f1c-a353-6be0c8d40cba tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:40:27 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-08ba2d65-f82e-4f1c-a353-6be0c8d40cba tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:40:27 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-08ba2d65-f82e-4f1c-a353-6be0c8d40cba tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:40:27 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-08ba2d65-f82e-4f1c-a353-6be0c8d40cba tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:40:27 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-08ba2d65-f82e-4f1c-a353-6be0c8d40cba tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:40:27 user devstack@n-api.service[72090]: INFO nova.api.openstack.wsgi [None req-08ba2d65-f82e-4f1c-a353-6be0c8d40cba tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] HTTP exception thrown: Instance 720c683f-c03a-444c-92a8-daf97c9f524b could not be found. Apr 11 19:40:27 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [None req-08ba2d65-f82e-4f1c-a353-6be0c8d40cba tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Request method failure captured: Apr 11 19:40:27 user devstack@n-api.service[72090]: request: DELETE /compute/v2.1/servers/720c683f-c03a-444c-92a8-daf97c9f524b HTTP/1.1 Apr 11 19:40:27 user devstack@n-api.service[72090]: Accept: application/json Apr 11 19:40:27 user devstack@n-api.service[72090]: Accept-Encoding: identity Apr 11 19:40:27 user devstack@n-api.service[72090]: Connection: close Apr 11 19:40:27 user devstack@n-api.service[72090]: Content-Length: 0 Apr 11 19:40:27 user devstack@n-api.service[72090]: Content-Type: application/json Apr 11 19:40:27 user devstack@n-api.service[72090]: Host: 10.0.0.210 Apr 11 19:40:27 user devstack@n-api.service[72090]: Openstack-System-Scope: None Apr 11 19:40:27 user devstack@n-api.service[72090]: User-Agent: python-urllib3/1.26.15 Apr 11 19:40:27 user devstack@n-api.service[72090]: X-Auth-Token: gAAAAABkNbRo6INLHGJ-FCpv0R8iTq15NRyXrCaZyB4elcR5LG0Nk6-bMCi5rNIeVdoPHHcD8ZB_4iB72kb-2Ue0k8TYx-9LMGkMAHU2x9eZVwN2smD8CJWUfTZvH8wvldsxkuE9fC9VmRhdCryMAv4uVPMG3wvq6LMuFg7oqVTdqSX0j3JCRq0 Apr 11 19:40:27 user devstack@n-api.service[72090]: X-Domain-Id: None Apr 11 19:40:27 user devstack@n-api.service[72090]: X-Domain-Name: None Apr 11 19:40:27 user devstack@n-api.service[72090]: X-Identity-Status: Confirmed Apr 11 19:40:27 user devstack@n-api.service[72090]: X-Is-Admin-Project: True Apr 11 19:40:27 user devstack@n-api.service[72090]: X-Openstack-Nova-Api-Version: 2.20 Apr 11 19:40:27 user devstack@n-api.service[72090]: X-Project-Domain-Id: default Apr 11 19:40:27 user devstack@n-api.service[72090]: X-Project-Domain-Name: Default Apr 11 19:40:27 user devstack@n-api.service[72090]: X-Project-Id: 8d8b189667e34931aa36149620a036e1 Apr 11 19:40:27 user devstack@n-api.service[72090]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-427928846 Apr 11 19:40:27 user devstack@n-api.service[72090]: X-Role: reader,member Apr 11 19:40:27 user devstack@n-api.service[72090]: X-Roles: reader,member Apr 11 19:40:27 user devstack@n-api.service[72090]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8d8b189667e34931aa36149620a036e1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/8d8b189667e34931aa36149620a036e1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8d8b189667e34931aa36149620a036e1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 11 19:40:27 user devstack@n-api.service[72090]: X-Tenant: tempest-AttachVolumeShelveTestJSON-427928846 Apr 11 19:40:27 user devstack@n-api.service[72090]: X-Tenant-Id: 8d8b189667e34931aa36149620a036e1 Apr 11 19:40:27 user devstack@n-api.service[72090]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-427928846 Apr 11 19:40:27 user devstack@n-api.service[72090]: X-User: tempest-AttachVolumeShelveTestJSON-427928846-project-member Apr 11 19:40:27 user devstack@n-api.service[72090]: X-User-Domain-Id: default Apr 11 19:40:27 user devstack@n-api.service[72090]: X-User-Domain-Name: Default Apr 11 19:40:27 user devstack@n-api.service[72090]: X-User-Id: e0558ba5a2b04d36ba2f2411090cc4e4 Apr 11 19:40:27 user devstack@n-api.service[72090]: X-User-Name: tempest-AttachVolumeShelveTestJSON-427928846-project-member Apr 11 19:40:27 user devstack@n-api.service[72090]: method: > Apr 11 19:40:27 user devstack@n-api.service[72090]: exception: Instance 720c683f-c03a-444c-92a8-daf97c9f524b could not be found. Apr 11 19:40:27 user devstack@n-api.service[72090]: action_args: {'id': '720c683f-c03a-444c-92a8-daf97c9f524b'} Apr 11 19:40:27 user devstack@n-api.service[72090]: {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 19:40:27 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:40:27 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 19:40:27 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 19:40:27 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 19:40:27 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 19:40:27 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 19:40:27 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 19:40:27 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 19:40:27 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 19:40:27 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 720c683f-c03a-444c-92a8-daf97c9f524b could not be found. Apr 11 19:40:27 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi Apr 11 19:40:27 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 19:40:27 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi Apr 11 19:40:27 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:40:27 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 19:40:27 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 19:40:27 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 19:40:27 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 19:40:27 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 19:40:27 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 19:40:27 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 11 19:40:27 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 11 19:40:27 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 11 19:40:27 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 11 19:40:27 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 19:40:27 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 19:40:27 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 19:40:27 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 19:40:27 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 720c683f-c03a-444c-92a8-daf97c9f524b could not be found. Apr 11 19:40:27 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi Apr 11 19:40:27 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 19:40:27 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi Apr 11 19:40:27 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:40:27 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 19:40:27 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 19:40:27 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 19:40:27 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 19:40:27 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 720c683f-c03a-444c-92a8-daf97c9f524b could not be found. Apr 11 19:40:27 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi Apr 11 19:40:27 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [None req-08ba2d65-f82e-4f1c-a353-6be0c8d40cba tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Returning 404 to user: Instance 720c683f-c03a-444c-92a8-daf97c9f524b could not be found. {{(pid=72090) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 19:40:27 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [None req-08ba2d65-f82e-4f1c-a353-6be0c8d40cba tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/720c683f-c03a-444c-92a8-daf97c9f524b" status: 404 len: 111 microversion: 2.20 time: 0.030282 Apr 11 19:40:27 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 281/847] 10.0.0.210 () {64 vars in 1357 bytes} [Tue Apr 11 19:40:27 2023] DELETE /compute/v2.1/servers/720c683f-c03a-444c-92a8-daf97c9f524b => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Apr 11 19:40:27 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [None req-2a1abd81-2835-4d93-bdbe-7fbbf8ba8086 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Calling method '>' {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:40:27 user devstack@n-api.service[72089]: DEBUG nova.compute.api [None req-2a1abd81-2835-4d93-bdbe-7fbbf8ba8086 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] [instance: 720c683f-c03a-444c-92a8-daf97c9f524b] Fetching instance by UUID {{(pid=72089) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:40:27 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-2a1abd81-2835-4d93-bdbe-7fbbf8ba8086 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:40:27 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-2a1abd81-2835-4d93-bdbe-7fbbf8ba8086 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:40:27 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-2a1abd81-2835-4d93-bdbe-7fbbf8ba8086 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:40:27 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-2a1abd81-2835-4d93-bdbe-7fbbf8ba8086 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:40:27 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-2a1abd81-2835-4d93-bdbe-7fbbf8ba8086 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:40:27 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-2a1abd81-2835-4d93-bdbe-7fbbf8ba8086 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:40:27 user devstack@n-api.service[72089]: INFO nova.api.openstack.wsgi [None req-2a1abd81-2835-4d93-bdbe-7fbbf8ba8086 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] HTTP exception thrown: Instance 720c683f-c03a-444c-92a8-daf97c9f524b could not be found. Apr 11 19:40:27 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [None req-2a1abd81-2835-4d93-bdbe-7fbbf8ba8086 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Request method failure captured: Apr 11 19:40:27 user devstack@n-api.service[72089]: request: GET /compute/v2.1/servers/720c683f-c03a-444c-92a8-daf97c9f524b HTTP/1.1 Apr 11 19:40:27 user devstack@n-api.service[72089]: Accept: application/json Apr 11 19:40:27 user devstack@n-api.service[72089]: Accept-Encoding: identity Apr 11 19:40:27 user devstack@n-api.service[72089]: Connection: close Apr 11 19:40:27 user devstack@n-api.service[72089]: Content-Length: 0 Apr 11 19:40:27 user devstack@n-api.service[72089]: Content-Type: application/json Apr 11 19:40:27 user devstack@n-api.service[72089]: Host: 10.0.0.210 Apr 11 19:40:27 user devstack@n-api.service[72089]: Openstack-System-Scope: None Apr 11 19:40:27 user devstack@n-api.service[72089]: User-Agent: python-urllib3/1.26.15 Apr 11 19:40:27 user devstack@n-api.service[72089]: X-Auth-Token: gAAAAABkNbRo6INLHGJ-FCpv0R8iTq15NRyXrCaZyB4elcR5LG0Nk6-bMCi5rNIeVdoPHHcD8ZB_4iB72kb-2Ue0k8TYx-9LMGkMAHU2x9eZVwN2smD8CJWUfTZvH8wvldsxkuE9fC9VmRhdCryMAv4uVPMG3wvq6LMuFg7oqVTdqSX0j3JCRq0 Apr 11 19:40:27 user devstack@n-api.service[72089]: X-Domain-Id: None Apr 11 19:40:27 user devstack@n-api.service[72089]: X-Domain-Name: None Apr 11 19:40:27 user devstack@n-api.service[72089]: X-Identity-Status: Confirmed Apr 11 19:40:27 user devstack@n-api.service[72089]: X-Is-Admin-Project: True Apr 11 19:40:27 user devstack@n-api.service[72089]: X-Openstack-Nova-Api-Version: 2.20 Apr 11 19:40:27 user devstack@n-api.service[72089]: X-Project-Domain-Id: default Apr 11 19:40:27 user devstack@n-api.service[72089]: X-Project-Domain-Name: Default Apr 11 19:40:27 user devstack@n-api.service[72089]: X-Project-Id: 8d8b189667e34931aa36149620a036e1 Apr 11 19:40:27 user devstack@n-api.service[72089]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-427928846 Apr 11 19:40:27 user devstack@n-api.service[72089]: X-Role: reader,member Apr 11 19:40:27 user devstack@n-api.service[72089]: X-Roles: reader,member Apr 11 19:40:27 user devstack@n-api.service[72089]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8d8b189667e34931aa36149620a036e1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/8d8b189667e34931aa36149620a036e1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8d8b189667e34931aa36149620a036e1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 11 19:40:27 user devstack@n-api.service[72089]: X-Tenant: tempest-AttachVolumeShelveTestJSON-427928846 Apr 11 19:40:27 user devstack@n-api.service[72089]: X-Tenant-Id: 8d8b189667e34931aa36149620a036e1 Apr 11 19:40:27 user devstack@n-api.service[72089]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-427928846 Apr 11 19:40:27 user devstack@n-api.service[72089]: X-User: tempest-AttachVolumeShelveTestJSON-427928846-project-member Apr 11 19:40:27 user devstack@n-api.service[72089]: X-User-Domain-Id: default Apr 11 19:40:27 user devstack@n-api.service[72089]: X-User-Domain-Name: Default Apr 11 19:40:27 user devstack@n-api.service[72089]: X-User-Id: e0558ba5a2b04d36ba2f2411090cc4e4 Apr 11 19:40:27 user devstack@n-api.service[72089]: X-User-Name: tempest-AttachVolumeShelveTestJSON-427928846-project-member Apr 11 19:40:27 user devstack@n-api.service[72089]: method: > Apr 11 19:40:27 user devstack@n-api.service[72089]: exception: Instance 720c683f-c03a-444c-92a8-daf97c9f524b could not be found. Apr 11 19:40:27 user devstack@n-api.service[72089]: action_args: {'id': '720c683f-c03a-444c-92a8-daf97c9f524b'} Apr 11 19:40:27 user devstack@n-api.service[72089]: {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 19:40:27 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:40:27 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 19:40:27 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 19:40:27 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 19:40:27 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 19:40:27 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 19:40:27 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 19:40:27 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 19:40:27 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 19:40:27 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 720c683f-c03a-444c-92a8-daf97c9f524b could not be found. Apr 11 19:40:27 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi Apr 11 19:40:27 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 19:40:27 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi Apr 11 19:40:27 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:40:27 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 19:40:27 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 19:40:27 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 19:40:27 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 19:40:27 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 19:40:27 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 19:40:27 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 19:40:27 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 19:40:27 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 19:40:27 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 19:40:27 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 19:40:27 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 19:40:27 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 720c683f-c03a-444c-92a8-daf97c9f524b could not be found. Apr 11 19:40:27 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi Apr 11 19:40:27 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 19:40:27 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi Apr 11 19:40:27 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:40:27 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 19:40:27 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 19:40:27 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 19:40:27 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 19:40:27 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 720c683f-c03a-444c-92a8-daf97c9f524b could not be found. Apr 11 19:40:27 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi Apr 11 19:40:27 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [None req-2a1abd81-2835-4d93-bdbe-7fbbf8ba8086 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Returning 404 to user: Instance 720c683f-c03a-444c-92a8-daf97c9f524b could not be found. {{(pid=72089) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 19:40:27 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [None req-2a1abd81-2835-4d93-bdbe-7fbbf8ba8086 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] 10.0.0.210 "GET /compute/v2.1/servers/720c683f-c03a-444c-92a8-daf97c9f524b" status: 404 len: 111 microversion: 2.20 time: 0.045970 Apr 11 19:40:27 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 290/848] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 19:40:27 2023] GET /compute/v2.1/servers/720c683f-c03a-444c-92a8-daf97c9f524b => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 11 19:40:28 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [None req-2de1d275-bcee-45a8-bec3-eb3241e52b4c tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1799082805", "imageRef": "", "flavorRef": "42", "key_name": "tempest-TestVolumeBootPattern-1844027973", "security_groups": [{"name": "tempest-secgroup-smoke-49720192"}], "block_device_mapping_v2": [{"uuid": "af3920bc-0034-4875-be3a-b25fe27ee037", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "f22e45e9-cc15-401e-aed7-3506278d3d0d"}]}} {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:40:28 user devstack@n-api.service[72088]: DEBUG nova.network.neutron [None req-2de1d275-bcee-45a8-bec3-eb3241e52b4c tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] validate_networks() for [('f22e45e9-cc15-401e-aed7-3506278d3d0d', None, None, None, None, None)] {{(pid=72088) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 11 19:40:28 user devstack@n-api.service[72088]: DEBUG nova.virt.hardware [None req-2de1d275-bcee-45a8-bec3-eb3241e52b4c tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Flavor limits 0:0:0 {{(pid=72088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 19:40:28 user devstack@n-api.service[72088]: DEBUG nova.virt.hardware [None req-2de1d275-bcee-45a8-bec3-eb3241e52b4c tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Image limits 0:0:0 {{(pid=72088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 19:40:28 user devstack@n-api.service[72088]: DEBUG nova.virt.hardware [None req-2de1d275-bcee-45a8-bec3-eb3241e52b4c tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Flavor pref 0:0:0 {{(pid=72088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 19:40:28 user devstack@n-api.service[72088]: DEBUG nova.virt.hardware [None req-2de1d275-bcee-45a8-bec3-eb3241e52b4c tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Image pref 0:0:0 {{(pid=72088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 19:40:28 user devstack@n-api.service[72088]: DEBUG nova.virt.hardware [None req-2de1d275-bcee-45a8-bec3-eb3241e52b4c tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 19:40:28 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-2de1d275-bcee-45a8-bec3-eb3241e52b4c tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:40:28 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-2de1d275-bcee-45a8-bec3-eb3241e52b4c tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:40:28 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-2de1d275-bcee-45a8-bec3-eb3241e52b4c tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:40:28 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-2de1d275-bcee-45a8-bec3-eb3241e52b4c tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:40:28 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-2de1d275-bcee-45a8-bec3-eb3241e52b4c tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:40:28 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-2de1d275-bcee-45a8-bec3-eb3241e52b4c tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:40:28 user devstack@n-api.service[72088]: DEBUG nova.quota [None req-2de1d275-bcee-45a8-bec3-eb3241e52b4c tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Getting quotas for project 2caba0618fc743e7bfb2dd866a511df9. Resources: {'ram', 'instances', 'cores'} {{(pid=72088) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 19:40:28 user devstack@n-api.service[72088]: DEBUG nova.quota [None req-2de1d275-bcee-45a8-bec3-eb3241e52b4c tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Getting quotas for user cf262cd03f4a41c4956d8784cf37d86d and project 2caba0618fc743e7bfb2dd866a511df9. Resources: {'ram', 'instances', 'cores'} {{(pid=72088) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 19:40:28 user devstack@n-api.service[72088]: DEBUG nova.compute.api [None req-2de1d275-bcee-45a8-bec3-eb3241e52b4c tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Going to run 1 instances... {{(pid=72088) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 11 19:40:28 user devstack@n-api.service[72088]: DEBUG nova.compute.api [None req-2de1d275-bcee-45a8-bec3-eb3241e52b4c tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] [instance: 0a59d114-20ac-448e-a95a-d3501c914833] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='af3920bc-0034-4875-be3a-b25fe27ee037',volume_size=None,volume_type=None)] {{(pid=72088) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 11 19:40:28 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [None req-2de1d275-bcee-45a8-bec3-eb3241e52b4c tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.738920 Apr 11 19:40:28 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 278/849] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 11 19:40:28 2023] POST /compute/v2.1/servers => generated 402 bytes in 741 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 11 19:40:28 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [None req-e98f1e84-5277-4a6c-ad6e-201f0dfa18ce tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Calling method '>' {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:40:28 user devstack@n-api.service[72090]: DEBUG nova.compute.api [None req-e98f1e84-5277-4a6c-ad6e-201f0dfa18ce tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] [instance: 0a59d114-20ac-448e-a95a-d3501c914833] Fetching instance by UUID {{(pid=72090) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:40:28 user devstack@n-api.service[72090]: DEBUG nova.policy [None req-e98f1e84-5277-4a6c-ad6e-201f0dfa18ce tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf262cd03f4a41c4956d8784cf37d86d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caba0618fc743e7bfb2dd866a511df9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72090) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:40:28 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [None req-e98f1e84-5277-4a6c-ad6e-201f0dfa18ce tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0a59d114-20ac-448e-a95a-d3501c914833" status: 200 len: 1090 microversion: 2.1 time: 0.082198 Apr 11 19:40:28 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 282/850] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 19:40:28 2023] GET /compute/v2.1/servers/0a59d114-20ac-448e-a95a-d3501c914833 => generated 1090 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 19:40:31 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [req-74c5c7a1-0e31-4a64-bb3c-7f40de5589f9 req-45cd4a1a-b18d-47d3-959e-c1e0cf9226e0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0a59d114-20ac-448e-a95a-d3501c914833", "tag": "41122899-3bba-4bdd-a114-61f342be91ae"}]} {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:40:31 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-74c5c7a1-0e31-4a64-bb3c-7f40de5589f9 req-45cd4a1a-b18d-47d3-959e-c1e0cf9226e0 service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:40:31 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-74c5c7a1-0e31-4a64-bb3c-7f40de5589f9 req-45cd4a1a-b18d-47d3-959e-c1e0cf9226e0 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:40:31 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-74c5c7a1-0e31-4a64-bb3c-7f40de5589f9 req-45cd4a1a-b18d-47d3-959e-c1e0cf9226e0 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:40:31 user devstack@n-api.service[72089]: INFO nova.api.openstack.compute.server_external_events [req-74c5c7a1-0e31-4a64-bb3c-7f40de5589f9 req-45cd4a1a-b18d-47d3-959e-c1e0cf9226e0 service nova] Creating event network-changed:41122899-3bba-4bdd-a114-61f342be91ae for instance 0a59d114-20ac-448e-a95a-d3501c914833 on user Apr 11 19:40:31 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [req-74c5c7a1-0e31-4a64-bb3c-7f40de5589f9 req-45cd4a1a-b18d-47d3-959e-c1e0cf9226e0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037084 Apr 11 19:40:31 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 291/851] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:40:31 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:40:38 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [req-33f4e516-0ed0-48f8-b287-7981ede361a7 req-73a7fae1-17de-418b-8f8f-8d048dd64055 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a59d114-20ac-448e-a95a-d3501c914833", "name": "network-vif-plugged", "status": "completed", "tag": "41122899-3bba-4bdd-a114-61f342be91ae"}]} {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:40:38 user devstack@n-api.service[72088]: DEBUG dbcounter [-] [72088] Writing DB stats nova_api:SELECT=39,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=72088) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:40:38 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-33f4e516-0ed0-48f8-b287-7981ede361a7 req-73a7fae1-17de-418b-8f8f-8d048dd64055 service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:40:38 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-33f4e516-0ed0-48f8-b287-7981ede361a7 req-73a7fae1-17de-418b-8f8f-8d048dd64055 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:40:38 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-33f4e516-0ed0-48f8-b287-7981ede361a7 req-73a7fae1-17de-418b-8f8f-8d048dd64055 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:40:38 user devstack@n-api.service[72088]: DEBUG dbcounter [-] [72088] Writing DB stats nova_cell1:SELECT=37,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=72088) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:40:38 user devstack@n-api.service[72088]: INFO nova.api.openstack.compute.server_external_events [req-33f4e516-0ed0-48f8-b287-7981ede361a7 req-73a7fae1-17de-418b-8f8f-8d048dd64055 service nova] Creating event network-vif-plugged:41122899-3bba-4bdd-a114-61f342be91ae for instance 0a59d114-20ac-448e-a95a-d3501c914833 on user Apr 11 19:40:38 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [req-33f4e516-0ed0-48f8-b287-7981ede361a7 req-73a7fae1-17de-418b-8f8f-8d048dd64055 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042168 Apr 11 19:40:38 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 279/852] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:40:38 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:40:40 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [req-4e60aeaf-171a-4451-b33e-80c34f9f0203 req-18b2214c-88f4-4c1d-b87c-e7e7432574d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a59d114-20ac-448e-a95a-d3501c914833", "name": "network-vif-plugged", "status": "completed", "tag": "41122899-3bba-4bdd-a114-61f342be91ae"}]} {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:40:40 user devstack@n-api.service[72090]: DEBUG dbcounter [-] [72090] Writing DB stats nova_cell1:SELECT=22 {{(pid=72090) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:40:40 user devstack@n-api.service[72090]: DEBUG dbcounter [-] [72090] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=1 {{(pid=72090) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:40:40 user devstack@n-api.service[72090]: DEBUG dbcounter [-] [72090] Writing DB stats nova_cell0:SELECT=6 {{(pid=72090) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:40:40 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-4e60aeaf-171a-4451-b33e-80c34f9f0203 req-18b2214c-88f4-4c1d-b87c-e7e7432574d7 service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:40:40 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-4e60aeaf-171a-4451-b33e-80c34f9f0203 req-18b2214c-88f4-4c1d-b87c-e7e7432574d7 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:40:40 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-4e60aeaf-171a-4451-b33e-80c34f9f0203 req-18b2214c-88f4-4c1d-b87c-e7e7432574d7 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:40:40 user devstack@n-api.service[72090]: INFO nova.api.openstack.compute.server_external_events [req-4e60aeaf-171a-4451-b33e-80c34f9f0203 req-18b2214c-88f4-4c1d-b87c-e7e7432574d7 service nova] Creating event network-vif-plugged:41122899-3bba-4bdd-a114-61f342be91ae for instance 0a59d114-20ac-448e-a95a-d3501c914833 on user Apr 11 19:40:40 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [req-4e60aeaf-171a-4451-b33e-80c34f9f0203 req-18b2214c-88f4-4c1d-b87c-e7e7432574d7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063795 Apr 11 19:40:40 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 283/853] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:40:40 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:40:41 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [None req-eae414e5-b561-4117-a5a5-4cb8be9c6346 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:40:41 user devstack@n-api.service[72089]: DEBUG nova.compute.api [None req-eae414e5-b561-4117-a5a5-4cb8be9c6346 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] [instance: 8c45de50-92bc-467c-9f3d-7e667e1d0bb3] Fetching instance by UUID {{(pid=72089) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:40:41 user devstack@n-api.service[72089]: DEBUG dbcounter [-] [72089] Writing DB stats nova_api:SELECT=28,nova_api:UPDATE=1 {{(pid=72089) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:40:41 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-eae414e5-b561-4117-a5a5-4cb8be9c6346 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:40:41 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-eae414e5-b561-4117-a5a5-4cb8be9c6346 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:40:41 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-eae414e5-b561-4117-a5a5-4cb8be9c6346 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:40:41 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-eae414e5-b561-4117-a5a5-4cb8be9c6346 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:40:41 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-eae414e5-b561-4117-a5a5-4cb8be9c6346 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:40:41 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-eae414e5-b561-4117-a5a5-4cb8be9c6346 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:40:41 user devstack@n-api.service[72089]: DEBUG dbcounter [-] [72089] Writing DB stats nova_cell1:SELECT=58,nova_cell1:UPDATE=6,nova_cell1:INSERT=3 {{(pid=72089) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:40:41 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [None req-eae414e5-b561-4117-a5a5-4cb8be9c6346 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] 10.0.0.210 "POST /compute/v2.1/servers/8c45de50-92bc-467c-9f3d-7e667e1d0bb3/action" status: 202 len: 0 microversion: 2.87 time: 0.095195 Apr 11 19:40:41 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 292/854] 10.0.0.210 () {66 vars in 1396 bytes} [Tue Apr 11 19:40:41 2023] POST /compute/v2.1/servers/8c45de50-92bc-467c-9f3d-7e667e1d0bb3/action => generated 0 bytes in 98 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 11 19:40:41 user devstack@n-api.service[72088]: DEBUG dbcounter [-] [72088] Writing DB stats nova_cell0:SELECT=2 {{(pid=72088) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:40:41 user devstack@n-api.service[72088]: DEBUG dbcounter [-] [72088] Writing DB stats nova_cell0:SELECT=6 {{(pid=72088) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:40:41 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [None req-819abbf2-a079-4d40-8ef8-f65e3124722c tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Calling method '>' {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:40:41 user devstack@n-api.service[72088]: DEBUG nova.compute.api [None req-819abbf2-a079-4d40-8ef8-f65e3124722c tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] [instance: 8c45de50-92bc-467c-9f3d-7e667e1d0bb3] Fetching instance by UUID {{(pid=72088) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:40:41 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-819abbf2-a079-4d40-8ef8-f65e3124722c tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:40:41 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-819abbf2-a079-4d40-8ef8-f65e3124722c tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:40:41 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-819abbf2-a079-4d40-8ef8-f65e3124722c tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:40:41 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-819abbf2-a079-4d40-8ef8-f65e3124722c tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:40:41 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-819abbf2-a079-4d40-8ef8-f65e3124722c tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:40:41 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-819abbf2-a079-4d40-8ef8-f65e3124722c tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:40:41 user devstack@n-api.service[72088]: DEBUG nova.policy [None req-819abbf2-a079-4d40-8ef8-f65e3124722c tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b3adca432b04d70818a51d1366f5c6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb91586feb3f4a4c84fa8c2183baaf8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72088) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:40:41 user devstack@n-api.service[72088]: DEBUG nova.policy [None req-819abbf2-a079-4d40-8ef8-f65e3124722c tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b3adca432b04d70818a51d1366f5c6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb91586feb3f4a4c84fa8c2183baaf8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72088) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:40:41 user devstack@n-api.service[72088]: DEBUG nova.policy [None req-819abbf2-a079-4d40-8ef8-f65e3124722c tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b3adca432b04d70818a51d1366f5c6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb91586feb3f4a4c84fa8c2183baaf8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72088) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:40:41 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [None req-819abbf2-a079-4d40-8ef8-f65e3124722c tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8c45de50-92bc-467c-9f3d-7e667e1d0bb3" status: 200 len: 1762 microversion: 2.87 time: 0.351941 Apr 11 19:40:41 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 280/855] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 19:40:41 2023] GET /compute/v2.1/servers/8c45de50-92bc-467c-9f3d-7e667e1d0bb3 => generated 1762 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 19:40:42 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [req-55419859-768b-4a8e-89d5-f1d72c0ca14d req-a173d3da-f395-4f88-981d-1a67ef3a4bb6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c45de50-92bc-467c-9f3d-7e667e1d0bb3", "name": "network-vif-unplugged", "status": "completed", "tag": "82ee2878-c477-419c-97ba-9ac4b36dacab"}]} {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:40:42 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-55419859-768b-4a8e-89d5-f1d72c0ca14d req-a173d3da-f395-4f88-981d-1a67ef3a4bb6 service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:40:42 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-55419859-768b-4a8e-89d5-f1d72c0ca14d req-a173d3da-f395-4f88-981d-1a67ef3a4bb6 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:40:42 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-55419859-768b-4a8e-89d5-f1d72c0ca14d req-a173d3da-f395-4f88-981d-1a67ef3a4bb6 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:40:42 user devstack@n-api.service[72090]: INFO nova.api.openstack.compute.server_external_events [req-55419859-768b-4a8e-89d5-f1d72c0ca14d req-a173d3da-f395-4f88-981d-1a67ef3a4bb6 service nova] Creating event network-vif-unplugged:82ee2878-c477-419c-97ba-9ac4b36dacab for instance 8c45de50-92bc-467c-9f3d-7e667e1d0bb3 on user Apr 11 19:40:42 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [req-55419859-768b-4a8e-89d5-f1d72c0ca14d req-a173d3da-f395-4f88-981d-1a67ef3a4bb6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035348 Apr 11 19:40:42 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 284/856] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:40:42 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:40:44 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [req-9df88d5b-645c-469e-9208-c96e71dd2db8 req-5d8ea6e7-31dc-4e5a-85a6-024933f4e95f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c45de50-92bc-467c-9f3d-7e667e1d0bb3", "name": "network-vif-plugged", "status": "completed", "tag": "82ee2878-c477-419c-97ba-9ac4b36dacab"}, {"server_uuid": "8c45de50-92bc-467c-9f3d-7e667e1d0bb3", "name": "network-vif-plugged", "status": "completed", "tag": "82ee2878-c477-419c-97ba-9ac4b36dacab"}]} {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:40:44 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-9df88d5b-645c-469e-9208-c96e71dd2db8 req-5d8ea6e7-31dc-4e5a-85a6-024933f4e95f service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:40:44 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-9df88d5b-645c-469e-9208-c96e71dd2db8 req-5d8ea6e7-31dc-4e5a-85a6-024933f4e95f service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:40:44 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-9df88d5b-645c-469e-9208-c96e71dd2db8 req-5d8ea6e7-31dc-4e5a-85a6-024933f4e95f service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:40:44 user devstack@n-api.service[72089]: INFO nova.api.openstack.compute.server_external_events [req-9df88d5b-645c-469e-9208-c96e71dd2db8 req-5d8ea6e7-31dc-4e5a-85a6-024933f4e95f service nova] Creating event network-vif-plugged:82ee2878-c477-419c-97ba-9ac4b36dacab for instance 8c45de50-92bc-467c-9f3d-7e667e1d0bb3 on user Apr 11 19:40:44 user devstack@n-api.service[72089]: INFO nova.api.openstack.compute.server_external_events [req-9df88d5b-645c-469e-9208-c96e71dd2db8 req-5d8ea6e7-31dc-4e5a-85a6-024933f4e95f service nova] Creating event network-vif-plugged:82ee2878-c477-419c-97ba-9ac4b36dacab for instance 8c45de50-92bc-467c-9f3d-7e667e1d0bb3 on user Apr 11 19:40:44 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [req-9df88d5b-645c-469e-9208-c96e71dd2db8 req-5d8ea6e7-31dc-4e5a-85a6-024933f4e95f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.042422 Apr 11 19:40:44 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 293/857] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:40:44 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:40:46 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [req-83dcacf4-9c7c-4200-b999-7d458e01531a req-21fe5f58-ad16-4c48-aac0-bed1280a575a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c45de50-92bc-467c-9f3d-7e667e1d0bb3", "name": "network-vif-plugged", "status": "completed", "tag": "82ee2878-c477-419c-97ba-9ac4b36dacab"}]} {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:40:46 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-83dcacf4-9c7c-4200-b999-7d458e01531a req-21fe5f58-ad16-4c48-aac0-bed1280a575a service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:40:46 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-83dcacf4-9c7c-4200-b999-7d458e01531a req-21fe5f58-ad16-4c48-aac0-bed1280a575a service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:40:46 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-83dcacf4-9c7c-4200-b999-7d458e01531a req-21fe5f58-ad16-4c48-aac0-bed1280a575a service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:40:46 user devstack@n-api.service[72088]: INFO nova.api.openstack.compute.server_external_events [req-83dcacf4-9c7c-4200-b999-7d458e01531a req-21fe5f58-ad16-4c48-aac0-bed1280a575a service nova] Creating event network-vif-plugged:82ee2878-c477-419c-97ba-9ac4b36dacab for instance 8c45de50-92bc-467c-9f3d-7e667e1d0bb3 on user Apr 11 19:40:46 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [req-83dcacf4-9c7c-4200-b999-7d458e01531a req-21fe5f58-ad16-4c48-aac0-bed1280a575a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069800 Apr 11 19:40:46 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 281/858] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:40:46 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:40:51 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [None req-e78f53f2-240b-44f1-928a-598073e2eb5a tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] Calling method '>' {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:40:51 user devstack@n-api.service[72090]: DEBUG nova.compute.api [None req-e78f53f2-240b-44f1-928a-598073e2eb5a tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] [instance: d42dc0ea-4631-44be-8b58-09877280ba2e] Fetching instance by UUID {{(pid=72090) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:40:51 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-e78f53f2-240b-44f1-928a-598073e2eb5a tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:40:51 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-e78f53f2-240b-44f1-928a-598073e2eb5a tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:40:51 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-e78f53f2-240b-44f1-928a-598073e2eb5a tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:40:51 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-e78f53f2-240b-44f1-928a-598073e2eb5a tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:40:51 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-e78f53f2-240b-44f1-928a-598073e2eb5a tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:40:51 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-e78f53f2-240b-44f1-928a-598073e2eb5a tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:40:51 user devstack@n-api.service[72090]: DEBUG nova.policy [None req-e78f53f2-240b-44f1-928a-598073e2eb5a tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68fcdcd3af164195bf0c7da3b8dfecb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7b9baa081ca455ea6931b7801c805b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72090) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:40:51 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [None req-e78f53f2-240b-44f1-928a-598073e2eb5a tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d42dc0ea-4631-44be-8b58-09877280ba2e" status: 200 len: 1549 microversion: 2.1 time: 0.174611 Apr 11 19:40:51 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 285/859] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 19:40:51 2023] GET /compute/v2.1/servers/d42dc0ea-4631-44be-8b58-09877280ba2e => generated 1549 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:41:06 user devstack@n-api.service[72089]: DEBUG dbcounter [-] [72089] Writing DB stats nova_api:SELECT=3 {{(pid=72089) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:41:06 user devstack@n-api.service[72089]: DEBUG dbcounter [-] [72089] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=72089) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:41:06 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [None req-139535b3-bb4d-4fbb-950b-9c7987db9658 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Calling method '>' {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:41:06 user devstack@n-api.service[72089]: DEBUG nova.compute.api [None req-139535b3-bb4d-4fbb-950b-9c7987db9658 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] [instance: 647674d8-af53-405a-8116-4b7a01549bdf] Fetching instance by UUID {{(pid=72089) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:41:06 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-139535b3-bb4d-4fbb-950b-9c7987db9658 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:41:06 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-139535b3-bb4d-4fbb-950b-9c7987db9658 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:41:06 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-139535b3-bb4d-4fbb-950b-9c7987db9658 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:41:06 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-139535b3-bb4d-4fbb-950b-9c7987db9658 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:41:06 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-139535b3-bb4d-4fbb-950b-9c7987db9658 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:41:06 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-139535b3-bb4d-4fbb-950b-9c7987db9658 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:41:06 user devstack@n-api.service[72089]: INFO nova.api.openstack.wsgi [None req-139535b3-bb4d-4fbb-950b-9c7987db9658 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] HTTP exception thrown: Instance 647674d8-af53-405a-8116-4b7a01549bdf could not be found. Apr 11 19:41:06 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [None req-139535b3-bb4d-4fbb-950b-9c7987db9658 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Request method failure captured: Apr 11 19:41:06 user devstack@n-api.service[72089]: request: GET /compute/v2.1/servers/647674d8-af53-405a-8116-4b7a01549bdf HTTP/1.1 Apr 11 19:41:06 user devstack@n-api.service[72089]: Accept: application/json Apr 11 19:41:06 user devstack@n-api.service[72089]: Accept-Encoding: identity Apr 11 19:41:06 user devstack@n-api.service[72089]: Connection: close Apr 11 19:41:06 user devstack@n-api.service[72089]: Content-Length: 0 Apr 11 19:41:06 user devstack@n-api.service[72089]: Content-Type: application/json Apr 11 19:41:06 user devstack@n-api.service[72089]: Host: 10.0.0.210 Apr 11 19:41:06 user devstack@n-api.service[72089]: Openstack-System-Scope: None Apr 11 19:41:06 user devstack@n-api.service[72089]: User-Agent: python-urllib3/1.26.15 Apr 11 19:41:06 user devstack@n-api.service[72089]: X-Auth-Token: gAAAAABkNbR4bCdkWtJpeyTsYZLFONPnT_zinIH4x1SzpVTs_DUY92yHhUdZ1Be5ca42ne_MV0QfkvMTUzrjmQhXISCBCO99II9OZKv9BampoJ3QG4FhhPTvET8iKhYbJ7Ipqcffw1qgQYkqrkjqNHSIVG9eRSX49OVMWaaVKfSqTXnjihDuVyI Apr 11 19:41:06 user devstack@n-api.service[72089]: X-Domain-Id: None Apr 11 19:41:06 user devstack@n-api.service[72089]: X-Domain-Name: None Apr 11 19:41:06 user devstack@n-api.service[72089]: X-Identity-Status: Confirmed Apr 11 19:41:06 user devstack@n-api.service[72089]: X-Is-Admin-Project: True Apr 11 19:41:06 user devstack@n-api.service[72089]: X-Project-Domain-Id: default Apr 11 19:41:06 user devstack@n-api.service[72089]: X-Project-Domain-Name: Default Apr 11 19:41:06 user devstack@n-api.service[72089]: X-Project-Id: 60a7381a31b84e97a068528f90813773 Apr 11 19:41:06 user devstack@n-api.service[72089]: X-Project-Name: tempest-ServerActionsTestJSON-37730514 Apr 11 19:41:06 user devstack@n-api.service[72089]: X-Role: reader,member Apr 11 19:41:06 user devstack@n-api.service[72089]: X-Roles: reader,member Apr 11 19:41:06 user devstack@n-api.service[72089]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/60a7381a31b84e97a068528f90813773"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/60a7381a31b84e97a068528f90813773"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/60a7381a31b84e97a068528f90813773"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 11 19:41:06 user devstack@n-api.service[72089]: X-Tenant: tempest-ServerActionsTestJSON-37730514 Apr 11 19:41:06 user devstack@n-api.service[72089]: X-Tenant-Id: 60a7381a31b84e97a068528f90813773 Apr 11 19:41:06 user devstack@n-api.service[72089]: X-Tenant-Name: tempest-ServerActionsTestJSON-37730514 Apr 11 19:41:06 user devstack@n-api.service[72089]: X-User: tempest-ServerActionsTestJSON-37730514-project-member Apr 11 19:41:06 user devstack@n-api.service[72089]: X-User-Domain-Id: default Apr 11 19:41:06 user devstack@n-api.service[72089]: X-User-Domain-Name: Default Apr 11 19:41:06 user devstack@n-api.service[72089]: X-User-Id: 05fb551c320a48f98a4ec00a7f7492d7 Apr 11 19:41:06 user devstack@n-api.service[72089]: X-User-Name: tempest-ServerActionsTestJSON-37730514-project-member Apr 11 19:41:06 user devstack@n-api.service[72089]: method: > Apr 11 19:41:06 user devstack@n-api.service[72089]: exception: Instance 647674d8-af53-405a-8116-4b7a01549bdf could not be found. Apr 11 19:41:06 user devstack@n-api.service[72089]: action_args: {'id': '647674d8-af53-405a-8116-4b7a01549bdf'} Apr 11 19:41:06 user devstack@n-api.service[72089]: {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 19:41:06 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:41:06 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 19:41:06 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 19:41:06 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 19:41:06 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 19:41:06 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 19:41:06 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 19:41:06 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 19:41:06 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 19:41:06 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 647674d8-af53-405a-8116-4b7a01549bdf could not be found. Apr 11 19:41:06 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi Apr 11 19:41:06 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 19:41:06 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi Apr 11 19:41:06 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:41:06 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 19:41:06 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 19:41:06 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 19:41:06 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 19:41:06 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 19:41:06 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 19:41:06 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 19:41:06 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 19:41:06 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 19:41:06 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 19:41:06 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 19:41:06 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 19:41:06 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 647674d8-af53-405a-8116-4b7a01549bdf could not be found. Apr 11 19:41:06 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi Apr 11 19:41:06 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 19:41:06 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi Apr 11 19:41:06 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:41:06 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 19:41:06 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 19:41:06 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 19:41:06 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 19:41:06 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 647674d8-af53-405a-8116-4b7a01549bdf could not be found. Apr 11 19:41:06 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi Apr 11 19:41:06 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [None req-139535b3-bb4d-4fbb-950b-9c7987db9658 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Returning 404 to user: Instance 647674d8-af53-405a-8116-4b7a01549bdf could not be found. {{(pid=72089) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 19:41:06 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [None req-139535b3-bb4d-4fbb-950b-9c7987db9658 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] 10.0.0.210 "GET /compute/v2.1/servers/647674d8-af53-405a-8116-4b7a01549bdf" status: 404 len: 111 microversion: 2.1 time: 0.045088 Apr 11 19:41:06 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 294/860] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 19:41:06 2023] GET /compute/v2.1/servers/647674d8-af53-405a-8116-4b7a01549bdf => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 19:41:06 user devstack@n-api.service[72088]: DEBUG dbcounter [-] [72088] Writing DB stats nova_api:SELECT=7 {{(pid=72088) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:41:06 user devstack@n-api.service[72088]: DEBUG dbcounter [-] [72088] Writing DB stats nova_cell1:SELECT=9 {{(pid=72088) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:41:06 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [None req-a09ee842-0ab1-430d-b56a-f36b8f07d158 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Calling method '>' {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:41:06 user devstack@n-api.service[72088]: DEBUG nova.compute.api [None req-a09ee842-0ab1-430d-b56a-f36b8f07d158 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] [instance: 647674d8-af53-405a-8116-4b7a01549bdf] Fetching instance by UUID {{(pid=72088) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:41:06 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-a09ee842-0ab1-430d-b56a-f36b8f07d158 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:41:06 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-a09ee842-0ab1-430d-b56a-f36b8f07d158 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:41:06 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-a09ee842-0ab1-430d-b56a-f36b8f07d158 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:41:06 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-a09ee842-0ab1-430d-b56a-f36b8f07d158 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:41:06 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-a09ee842-0ab1-430d-b56a-f36b8f07d158 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:41:06 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-a09ee842-0ab1-430d-b56a-f36b8f07d158 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:41:06 user devstack@n-api.service[72088]: INFO nova.api.openstack.wsgi [None req-a09ee842-0ab1-430d-b56a-f36b8f07d158 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] HTTP exception thrown: Instance 647674d8-af53-405a-8116-4b7a01549bdf could not be found. Apr 11 19:41:06 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [None req-a09ee842-0ab1-430d-b56a-f36b8f07d158 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Request method failure captured: Apr 11 19:41:06 user devstack@n-api.service[72088]: request: GET /compute/v2.1/servers/647674d8-af53-405a-8116-4b7a01549bdf/os-volume_attachments HTTP/1.1 Apr 11 19:41:06 user devstack@n-api.service[72088]: Accept: application/json Apr 11 19:41:06 user devstack@n-api.service[72088]: Accept-Encoding: identity Apr 11 19:41:06 user devstack@n-api.service[72088]: Connection: close Apr 11 19:41:06 user devstack@n-api.service[72088]: Content-Length: 0 Apr 11 19:41:06 user devstack@n-api.service[72088]: Content-Type: application/json Apr 11 19:41:06 user devstack@n-api.service[72088]: Host: 10.0.0.210 Apr 11 19:41:06 user devstack@n-api.service[72088]: Openstack-System-Scope: None Apr 11 19:41:06 user devstack@n-api.service[72088]: User-Agent: python-urllib3/1.26.15 Apr 11 19:41:06 user devstack@n-api.service[72088]: X-Auth-Token: gAAAAABkNbR4bCdkWtJpeyTsYZLFONPnT_zinIH4x1SzpVTs_DUY92yHhUdZ1Be5ca42ne_MV0QfkvMTUzrjmQhXISCBCO99II9OZKv9BampoJ3QG4FhhPTvET8iKhYbJ7Ipqcffw1qgQYkqrkjqNHSIVG9eRSX49OVMWaaVKfSqTXnjihDuVyI Apr 11 19:41:06 user devstack@n-api.service[72088]: X-Domain-Id: None Apr 11 19:41:06 user devstack@n-api.service[72088]: X-Domain-Name: None Apr 11 19:41:06 user devstack@n-api.service[72088]: X-Identity-Status: Confirmed Apr 11 19:41:06 user devstack@n-api.service[72088]: X-Is-Admin-Project: True Apr 11 19:41:06 user devstack@n-api.service[72088]: X-Project-Domain-Id: default Apr 11 19:41:06 user devstack@n-api.service[72088]: X-Project-Domain-Name: Default Apr 11 19:41:06 user devstack@n-api.service[72088]: X-Project-Id: 60a7381a31b84e97a068528f90813773 Apr 11 19:41:06 user devstack@n-api.service[72088]: X-Project-Name: tempest-ServerActionsTestJSON-37730514 Apr 11 19:41:06 user devstack@n-api.service[72088]: X-Role: reader,member Apr 11 19:41:06 user devstack@n-api.service[72088]: X-Roles: reader,member Apr 11 19:41:06 user devstack@n-api.service[72088]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/60a7381a31b84e97a068528f90813773"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/60a7381a31b84e97a068528f90813773"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/60a7381a31b84e97a068528f90813773"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 11 19:41:06 user devstack@n-api.service[72088]: X-Tenant: tempest-ServerActionsTestJSON-37730514 Apr 11 19:41:06 user devstack@n-api.service[72088]: X-Tenant-Id: 60a7381a31b84e97a068528f90813773 Apr 11 19:41:06 user devstack@n-api.service[72088]: X-Tenant-Name: tempest-ServerActionsTestJSON-37730514 Apr 11 19:41:06 user devstack@n-api.service[72088]: X-User: tempest-ServerActionsTestJSON-37730514-project-member Apr 11 19:41:06 user devstack@n-api.service[72088]: X-User-Domain-Id: default Apr 11 19:41:06 user devstack@n-api.service[72088]: X-User-Domain-Name: Default Apr 11 19:41:06 user devstack@n-api.service[72088]: X-User-Id: 05fb551c320a48f98a4ec00a7f7492d7 Apr 11 19:41:06 user devstack@n-api.service[72088]: X-User-Name: tempest-ServerActionsTestJSON-37730514-project-member Apr 11 19:41:06 user devstack@n-api.service[72088]: method: > Apr 11 19:41:06 user devstack@n-api.service[72088]: exception: Instance 647674d8-af53-405a-8116-4b7a01549bdf could not be found. Apr 11 19:41:06 user devstack@n-api.service[72088]: action_args: {'server_id': '647674d8-af53-405a-8116-4b7a01549bdf'} Apr 11 19:41:06 user devstack@n-api.service[72088]: {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 19:41:06 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:41:06 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 19:41:06 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 19:41:06 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 19:41:06 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 19:41:06 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 19:41:06 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 19:41:06 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 19:41:06 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 19:41:06 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 647674d8-af53-405a-8116-4b7a01549bdf could not be found. Apr 11 19:41:06 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi Apr 11 19:41:06 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 19:41:06 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi Apr 11 19:41:06 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:41:06 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 19:41:06 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 19:41:06 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 19:41:06 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 19:41:06 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 19:41:06 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 19:41:06 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Apr 11 19:41:06 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 11 19:41:06 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Apr 11 19:41:06 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 11 19:41:06 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Apr 11 19:41:06 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Apr 11 19:41:06 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 19:41:06 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 19:41:06 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 647674d8-af53-405a-8116-4b7a01549bdf could not be found. Apr 11 19:41:06 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi Apr 11 19:41:06 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 19:41:06 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi Apr 11 19:41:06 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:41:06 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 19:41:06 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 19:41:06 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 19:41:06 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 19:41:06 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 647674d8-af53-405a-8116-4b7a01549bdf could not be found. Apr 11 19:41:06 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi Apr 11 19:41:06 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [None req-a09ee842-0ab1-430d-b56a-f36b8f07d158 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Returning 404 to user: Instance 647674d8-af53-405a-8116-4b7a01549bdf could not be found. {{(pid=72088) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 19:41:06 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [None req-a09ee842-0ab1-430d-b56a-f36b8f07d158 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] 10.0.0.210 "GET /compute/v2.1/servers/647674d8-af53-405a-8116-4b7a01549bdf/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.049408 Apr 11 19:41:06 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 282/861] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Apr 11 19:41:06 2023] GET /compute/v2.1/servers/647674d8-af53-405a-8116-4b7a01549bdf/os-volume_attachments => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 19:41:06 user devstack@n-api.service[72090]: DEBUG dbcounter [-] [72090] Writing DB stats nova_api:SELECT=6 {{(pid=72090) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:41:06 user devstack@n-api.service[72090]: DEBUG dbcounter [-] [72090] Writing DB stats nova_cell1:SELECT=10 {{(pid=72090) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:41:06 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [None req-3358111f-4ee9-4071-bf76-575a7552fcd2 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Calling method '>' {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:41:06 user devstack@n-api.service[72090]: DEBUG nova.compute.api [None req-3358111f-4ee9-4071-bf76-575a7552fcd2 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] [instance: 647674d8-af53-405a-8116-4b7a01549bdf] Fetching instance by UUID {{(pid=72090) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:41:06 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-3358111f-4ee9-4071-bf76-575a7552fcd2 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:41:06 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-3358111f-4ee9-4071-bf76-575a7552fcd2 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:41:06 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-3358111f-4ee9-4071-bf76-575a7552fcd2 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:41:06 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-3358111f-4ee9-4071-bf76-575a7552fcd2 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:41:06 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-3358111f-4ee9-4071-bf76-575a7552fcd2 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:41:06 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-3358111f-4ee9-4071-bf76-575a7552fcd2 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:41:06 user devstack@n-api.service[72090]: INFO nova.api.openstack.wsgi [None req-3358111f-4ee9-4071-bf76-575a7552fcd2 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] HTTP exception thrown: Instance 647674d8-af53-405a-8116-4b7a01549bdf could not be found. Apr 11 19:41:06 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [None req-3358111f-4ee9-4071-bf76-575a7552fcd2 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Request method failure captured: Apr 11 19:41:06 user devstack@n-api.service[72090]: request: GET /compute/v2.1/servers/647674d8-af53-405a-8116-4b7a01549bdf HTTP/1.1 Apr 11 19:41:06 user devstack@n-api.service[72090]: Accept: application/json Apr 11 19:41:06 user devstack@n-api.service[72090]: Accept-Encoding: identity Apr 11 19:41:06 user devstack@n-api.service[72090]: Connection: close Apr 11 19:41:06 user devstack@n-api.service[72090]: Content-Length: 0 Apr 11 19:41:06 user devstack@n-api.service[72090]: Content-Type: application/json Apr 11 19:41:06 user devstack@n-api.service[72090]: Host: 10.0.0.210 Apr 11 19:41:06 user devstack@n-api.service[72090]: Openstack-System-Scope: None Apr 11 19:41:06 user devstack@n-api.service[72090]: User-Agent: python-urllib3/1.26.15 Apr 11 19:41:06 user devstack@n-api.service[72090]: X-Auth-Token: gAAAAABkNbR4bCdkWtJpeyTsYZLFONPnT_zinIH4x1SzpVTs_DUY92yHhUdZ1Be5ca42ne_MV0QfkvMTUzrjmQhXISCBCO99II9OZKv9BampoJ3QG4FhhPTvET8iKhYbJ7Ipqcffw1qgQYkqrkjqNHSIVG9eRSX49OVMWaaVKfSqTXnjihDuVyI Apr 11 19:41:06 user devstack@n-api.service[72090]: X-Domain-Id: None Apr 11 19:41:06 user devstack@n-api.service[72090]: X-Domain-Name: None Apr 11 19:41:06 user devstack@n-api.service[72090]: X-Identity-Status: Confirmed Apr 11 19:41:06 user devstack@n-api.service[72090]: X-Is-Admin-Project: True Apr 11 19:41:06 user devstack@n-api.service[72090]: X-Project-Domain-Id: default Apr 11 19:41:06 user devstack@n-api.service[72090]: X-Project-Domain-Name: Default Apr 11 19:41:06 user devstack@n-api.service[72090]: X-Project-Id: 60a7381a31b84e97a068528f90813773 Apr 11 19:41:06 user devstack@n-api.service[72090]: X-Project-Name: tempest-ServerActionsTestJSON-37730514 Apr 11 19:41:06 user devstack@n-api.service[72090]: X-Role: reader,member Apr 11 19:41:06 user devstack@n-api.service[72090]: X-Roles: reader,member Apr 11 19:41:06 user devstack@n-api.service[72090]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/60a7381a31b84e97a068528f90813773"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/60a7381a31b84e97a068528f90813773"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/60a7381a31b84e97a068528f90813773"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 11 19:41:06 user devstack@n-api.service[72090]: X-Tenant: tempest-ServerActionsTestJSON-37730514 Apr 11 19:41:06 user devstack@n-api.service[72090]: X-Tenant-Id: 60a7381a31b84e97a068528f90813773 Apr 11 19:41:06 user devstack@n-api.service[72090]: X-Tenant-Name: tempest-ServerActionsTestJSON-37730514 Apr 11 19:41:06 user devstack@n-api.service[72090]: X-User: tempest-ServerActionsTestJSON-37730514-project-member Apr 11 19:41:06 user devstack@n-api.service[72090]: X-User-Domain-Id: default Apr 11 19:41:06 user devstack@n-api.service[72090]: X-User-Domain-Name: Default Apr 11 19:41:06 user devstack@n-api.service[72090]: X-User-Id: 05fb551c320a48f98a4ec00a7f7492d7 Apr 11 19:41:06 user devstack@n-api.service[72090]: X-User-Name: tempest-ServerActionsTestJSON-37730514-project-member Apr 11 19:41:06 user devstack@n-api.service[72090]: method: > Apr 11 19:41:06 user devstack@n-api.service[72090]: exception: Instance 647674d8-af53-405a-8116-4b7a01549bdf could not be found. Apr 11 19:41:06 user devstack@n-api.service[72090]: action_args: {'id': '647674d8-af53-405a-8116-4b7a01549bdf'} Apr 11 19:41:06 user devstack@n-api.service[72090]: {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 19:41:06 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:41:06 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 19:41:06 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 19:41:06 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 19:41:06 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 19:41:06 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 19:41:06 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 19:41:06 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 19:41:06 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 19:41:06 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 647674d8-af53-405a-8116-4b7a01549bdf could not be found. Apr 11 19:41:06 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi Apr 11 19:41:06 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 19:41:06 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi Apr 11 19:41:06 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:41:06 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 19:41:06 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 19:41:06 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 19:41:06 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 19:41:06 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 19:41:06 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 19:41:06 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 19:41:06 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 19:41:06 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 19:41:06 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 19:41:06 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 19:41:06 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 19:41:06 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 647674d8-af53-405a-8116-4b7a01549bdf could not be found. Apr 11 19:41:06 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi Apr 11 19:41:06 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 19:41:06 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi Apr 11 19:41:06 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:41:06 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 19:41:06 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 19:41:06 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 19:41:06 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 19:41:06 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 647674d8-af53-405a-8116-4b7a01549bdf could not be found. Apr 11 19:41:06 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi Apr 11 19:41:06 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [None req-3358111f-4ee9-4071-bf76-575a7552fcd2 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Returning 404 to user: Instance 647674d8-af53-405a-8116-4b7a01549bdf could not be found. {{(pid=72090) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 19:41:06 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [None req-3358111f-4ee9-4071-bf76-575a7552fcd2 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] 10.0.0.210 "GET /compute/v2.1/servers/647674d8-af53-405a-8116-4b7a01549bdf" status: 404 len: 111 microversion: 2.1 time: 0.032559 Apr 11 19:41:06 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 286/862] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 19:41:06 2023] GET /compute/v2.1/servers/647674d8-af53-405a-8116-4b7a01549bdf => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 19:41:07 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [None req-bdaf6d42-ccff-4770-a2ec-32fbc12c48a5 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1690661928", "imageRef": "4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b", "flavorRef": "42", "networks": [{"uuid": "8694f053-fd47-47b5-8463-d21b35fbe7ac"}], "security_groups": [{"name": "tempest-securitygroup--641665583"}], "key_name": "tempest-keypair-185807874", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:41:07 user devstack@n-api.service[72089]: DEBUG nova.network.neutron [None req-bdaf6d42-ccff-4770-a2ec-32fbc12c48a5 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] validate_networks() for [('8694f053-fd47-47b5-8463-d21b35fbe7ac', None, None, None, None, None)] {{(pid=72089) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 11 19:41:07 user devstack@n-api.service[72089]: DEBUG nova.virt.hardware [None req-bdaf6d42-ccff-4770-a2ec-32fbc12c48a5 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Flavor limits 0:0:0 {{(pid=72089) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 19:41:07 user devstack@n-api.service[72089]: DEBUG nova.virt.hardware [None req-bdaf6d42-ccff-4770-a2ec-32fbc12c48a5 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Image limits 0:0:0 {{(pid=72089) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 19:41:07 user devstack@n-api.service[72089]: DEBUG nova.virt.hardware [None req-bdaf6d42-ccff-4770-a2ec-32fbc12c48a5 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Flavor pref 0:0:0 {{(pid=72089) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 19:41:07 user devstack@n-api.service[72089]: DEBUG nova.virt.hardware [None req-bdaf6d42-ccff-4770-a2ec-32fbc12c48a5 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Image pref 0:0:0 {{(pid=72089) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 19:41:07 user devstack@n-api.service[72089]: DEBUG nova.virt.hardware [None req-bdaf6d42-ccff-4770-a2ec-32fbc12c48a5 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72089) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 19:41:07 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-bdaf6d42-ccff-4770-a2ec-32fbc12c48a5 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:41:07 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-bdaf6d42-ccff-4770-a2ec-32fbc12c48a5 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:41:07 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-bdaf6d42-ccff-4770-a2ec-32fbc12c48a5 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:41:07 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-bdaf6d42-ccff-4770-a2ec-32fbc12c48a5 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:41:07 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-bdaf6d42-ccff-4770-a2ec-32fbc12c48a5 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:41:07 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-bdaf6d42-ccff-4770-a2ec-32fbc12c48a5 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:41:07 user devstack@n-api.service[72089]: DEBUG nova.quota [None req-bdaf6d42-ccff-4770-a2ec-32fbc12c48a5 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Getting quotas for project 60a7381a31b84e97a068528f90813773. Resources: {'ram', 'instances', 'cores'} {{(pid=72089) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 19:41:07 user devstack@n-api.service[72089]: DEBUG nova.quota [None req-bdaf6d42-ccff-4770-a2ec-32fbc12c48a5 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Getting quotas for user 05fb551c320a48f98a4ec00a7f7492d7 and project 60a7381a31b84e97a068528f90813773. Resources: {'ram', 'instances', 'cores'} {{(pid=72089) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 19:41:07 user devstack@n-api.service[72089]: DEBUG nova.compute.api [None req-bdaf6d42-ccff-4770-a2ec-32fbc12c48a5 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Going to run 1 instances... {{(pid=72089) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 11 19:41:07 user devstack@n-api.service[72089]: DEBUG nova.compute.api [None req-bdaf6d42-ccff-4770-a2ec-32fbc12c48a5 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] [instance: 478eb884-ba19-4a4b-b1eb-a2e59d6beef0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=72089) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 11 19:41:07 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [None req-bdaf6d42-ccff-4770-a2ec-32fbc12c48a5 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 0.698705 Apr 11 19:41:07 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 295/863] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 11 19:41:07 2023] POST /compute/v2.1/servers => generated 403 bytes in 700 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 11 19:41:07 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [None req-8c8133e6-490a-404e-8e81-60862032ceb5 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Calling method '>' {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:41:07 user devstack@n-api.service[72088]: DEBUG nova.compute.api [None req-8c8133e6-490a-404e-8e81-60862032ceb5 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] [instance: 478eb884-ba19-4a4b-b1eb-a2e59d6beef0] Fetching instance by UUID {{(pid=72088) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:41:07 user devstack@n-api.service[72088]: DEBUG nova.policy [None req-8c8133e6-490a-404e-8e81-60862032ceb5 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05fb551c320a48f98a4ec00a7f7492d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60a7381a31b84e97a068528f90813773', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72088) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:41:07 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [None req-8c8133e6-490a-404e-8e81-60862032ceb5 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] 10.0.0.210 "GET /compute/v2.1/servers/478eb884-ba19-4a4b-b1eb-a2e59d6beef0" status: 200 len: 1232 microversion: 2.1 time: 0.082085 Apr 11 19:41:07 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 283/864] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 19:41:07 2023] GET /compute/v2.1/servers/478eb884-ba19-4a4b-b1eb-a2e59d6beef0 => generated 1232 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:41:09 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [None req-4aa1bf8f-350a-4fb9-abc3-08bd289e9ac4 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Calling method '>' {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:41:09 user devstack@n-api.service[72090]: DEBUG nova.compute.api [None req-4aa1bf8f-350a-4fb9-abc3-08bd289e9ac4 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] [instance: bf0a75f5-2f44-4687-af12-046f6761fee2] Fetching instance by UUID {{(pid=72090) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:41:09 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-4aa1bf8f-350a-4fb9-abc3-08bd289e9ac4 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:41:09 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-4aa1bf8f-350a-4fb9-abc3-08bd289e9ac4 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:41:09 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-4aa1bf8f-350a-4fb9-abc3-08bd289e9ac4 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:41:09 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-4aa1bf8f-350a-4fb9-abc3-08bd289e9ac4 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:41:09 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-4aa1bf8f-350a-4fb9-abc3-08bd289e9ac4 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:41:09 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-4aa1bf8f-350a-4fb9-abc3-08bd289e9ac4 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:41:09 user devstack@n-api.service[72090]: DEBUG nova.policy [None req-4aa1bf8f-350a-4fb9-abc3-08bd289e9ac4 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba7f82b529e74d99838b6264b94d823b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e3a291c54b49db8e12a88ba41865e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72090) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:41:09 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [None req-4aa1bf8f-350a-4fb9-abc3-08bd289e9ac4 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bf0a75f5-2f44-4687-af12-046f6761fee2" status: 200 len: 1705 microversion: 2.1 time: 0.354157 Apr 11 19:41:09 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 287/865] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 19:41:08 2023] GET /compute/v2.1/servers/bf0a75f5-2f44-4687-af12-046f6761fee2 => generated 1705 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:41:10 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [req-531d27c5-c528-40b6-a575-7e217b23e8c7 req-4817b483-ebff-4ee5-be45-b9f4d3003665 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "478eb884-ba19-4a4b-b1eb-a2e59d6beef0", "tag": "91ef79db-4548-423d-9022-b88dd7608438"}]} {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:41:10 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-531d27c5-c528-40b6-a575-7e217b23e8c7 req-4817b483-ebff-4ee5-be45-b9f4d3003665 service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:41:10 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-531d27c5-c528-40b6-a575-7e217b23e8c7 req-4817b483-ebff-4ee5-be45-b9f4d3003665 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:41:10 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-531d27c5-c528-40b6-a575-7e217b23e8c7 req-4817b483-ebff-4ee5-be45-b9f4d3003665 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:41:10 user devstack@n-api.service[72089]: INFO nova.api.openstack.compute.server_external_events [req-531d27c5-c528-40b6-a575-7e217b23e8c7 req-4817b483-ebff-4ee5-be45-b9f4d3003665 service nova] Creating event network-changed:91ef79db-4548-423d-9022-b88dd7608438 for instance 478eb884-ba19-4a4b-b1eb-a2e59d6beef0 on user Apr 11 19:41:10 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [req-531d27c5-c528-40b6-a575-7e217b23e8c7 req-4817b483-ebff-4ee5-be45-b9f4d3003665 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031410 Apr 11 19:41:10 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 296/866] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:41:10 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:41:13 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [req-e631579f-b40b-46b6-99b2-20a4b9dd7d56 req-82482822-00de-4703-9df9-9da611f902cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "478eb884-ba19-4a4b-b1eb-a2e59d6beef0", "name": "network-vif-plugged", "status": "completed", "tag": "91ef79db-4548-423d-9022-b88dd7608438"}]} {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:41:13 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-e631579f-b40b-46b6-99b2-20a4b9dd7d56 req-82482822-00de-4703-9df9-9da611f902cd service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:41:13 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-e631579f-b40b-46b6-99b2-20a4b9dd7d56 req-82482822-00de-4703-9df9-9da611f902cd service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:41:13 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-e631579f-b40b-46b6-99b2-20a4b9dd7d56 req-82482822-00de-4703-9df9-9da611f902cd service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:41:13 user devstack@n-api.service[72088]: INFO nova.api.openstack.compute.server_external_events [req-e631579f-b40b-46b6-99b2-20a4b9dd7d56 req-82482822-00de-4703-9df9-9da611f902cd service nova] Creating event network-vif-plugged:91ef79db-4548-423d-9022-b88dd7608438 for instance 478eb884-ba19-4a4b-b1eb-a2e59d6beef0 on user Apr 11 19:41:13 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [req-e631579f-b40b-46b6-99b2-20a4b9dd7d56 req-82482822-00de-4703-9df9-9da611f902cd service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073743 Apr 11 19:41:13 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 284/867] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:41:13 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:41:15 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [req-f68bdacd-4eab-49df-b28e-acfe63162375 req-0aed1a2d-d619-4e9c-b075-e291a381466d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "478eb884-ba19-4a4b-b1eb-a2e59d6beef0", "name": "network-vif-plugged", "status": "completed", "tag": "91ef79db-4548-423d-9022-b88dd7608438"}]} {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:41:15 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-f68bdacd-4eab-49df-b28e-acfe63162375 req-0aed1a2d-d619-4e9c-b075-e291a381466d service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:41:15 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-f68bdacd-4eab-49df-b28e-acfe63162375 req-0aed1a2d-d619-4e9c-b075-e291a381466d service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:41:15 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-f68bdacd-4eab-49df-b28e-acfe63162375 req-0aed1a2d-d619-4e9c-b075-e291a381466d service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:41:15 user devstack@n-api.service[72090]: INFO nova.api.openstack.compute.server_external_events [req-f68bdacd-4eab-49df-b28e-acfe63162375 req-0aed1a2d-d619-4e9c-b075-e291a381466d service nova] Creating event network-vif-plugged:91ef79db-4548-423d-9022-b88dd7608438 for instance 478eb884-ba19-4a4b-b1eb-a2e59d6beef0 on user Apr 11 19:41:15 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [req-f68bdacd-4eab-49df-b28e-acfe63162375 req-0aed1a2d-d619-4e9c-b075-e291a381466d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043670 Apr 11 19:41:15 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 288/868] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:41:15 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:41:18 user devstack@n-api.service[72089]: DEBUG dbcounter [-] [72089] Writing DB stats nova_cell0:SELECT=2 {{(pid=72089) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:41:18 user devstack@n-api.service[72089]: DEBUG dbcounter [-] [72089] Writing DB stats nova_cell0:SELECT=6 {{(pid=72089) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:41:18 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [None req-24a2017f-7f84-4710-84e9-af3c0763cc64 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Calling method '>' {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:41:18 user devstack@n-api.service[72089]: DEBUG nova.compute.api [None req-24a2017f-7f84-4710-84e9-af3c0763cc64 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] [instance: 0a59d114-20ac-448e-a95a-d3501c914833] Fetching instance by UUID {{(pid=72089) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:41:18 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-24a2017f-7f84-4710-84e9-af3c0763cc64 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:41:18 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-24a2017f-7f84-4710-84e9-af3c0763cc64 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:41:18 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-24a2017f-7f84-4710-84e9-af3c0763cc64 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:41:18 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-24a2017f-7f84-4710-84e9-af3c0763cc64 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:41:18 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-24a2017f-7f84-4710-84e9-af3c0763cc64 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:41:18 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-24a2017f-7f84-4710-84e9-af3c0763cc64 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:41:19 user devstack@n-api.service[72089]: DEBUG nova.policy [None req-24a2017f-7f84-4710-84e9-af3c0763cc64 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf262cd03f4a41c4956d8784cf37d86d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caba0618fc743e7bfb2dd866a511df9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72089) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:41:19 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [None req-24a2017f-7f84-4710-84e9-af3c0763cc64 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0a59d114-20ac-448e-a95a-d3501c914833" status: 200 len: 1442 microversion: 2.1 time: 0.186017 Apr 11 19:41:19 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 297/869] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 19:41:18 2023] GET /compute/v2.1/servers/0a59d114-20ac-448e-a95a-d3501c914833 => generated 1442 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:41:31 user devstack@n-api.service[72088]: DEBUG dbcounter [-] [72088] Writing DB stats nova_cell0:SELECT=2 {{(pid=72088) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:41:31 user devstack@n-api.service[72088]: DEBUG dbcounter [-] [72088] Writing DB stats nova_api:SELECT=8 {{(pid=72088) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:41:31 user devstack@n-api.service[72088]: DEBUG dbcounter [-] [72088] Writing DB stats nova_cell1:SELECT=4 {{(pid=72088) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:41:31 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [None req-d53fb528-069c-4136-ae82-7a825310a6f0 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Calling method '>' {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:41:31 user devstack@n-api.service[72088]: DEBUG nova.compute.api [None req-d53fb528-069c-4136-ae82-7a825310a6f0 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] [instance: 8c45de50-92bc-467c-9f3d-7e667e1d0bb3] Fetching instance by UUID {{(pid=72088) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:41:31 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-d53fb528-069c-4136-ae82-7a825310a6f0 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:41:31 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-d53fb528-069c-4136-ae82-7a825310a6f0 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:41:31 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-d53fb528-069c-4136-ae82-7a825310a6f0 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:41:31 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-d53fb528-069c-4136-ae82-7a825310a6f0 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:41:31 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-d53fb528-069c-4136-ae82-7a825310a6f0 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:41:31 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-d53fb528-069c-4136-ae82-7a825310a6f0 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:41:31 user devstack@n-api.service[72088]: DEBUG nova.policy [None req-d53fb528-069c-4136-ae82-7a825310a6f0 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b3adca432b04d70818a51d1366f5c6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb91586feb3f4a4c84fa8c2183baaf8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72088) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:41:31 user devstack@n-api.service[72088]: DEBUG nova.policy [None req-d53fb528-069c-4136-ae82-7a825310a6f0 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b3adca432b04d70818a51d1366f5c6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb91586feb3f4a4c84fa8c2183baaf8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72088) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:41:31 user devstack@n-api.service[72088]: DEBUG nova.policy [None req-d53fb528-069c-4136-ae82-7a825310a6f0 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b3adca432b04d70818a51d1366f5c6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb91586feb3f4a4c84fa8c2183baaf8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72088) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:41:31 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [None req-d53fb528-069c-4136-ae82-7a825310a6f0 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8c45de50-92bc-467c-9f3d-7e667e1d0bb3" status: 200 len: 1768 microversion: 2.87 time: 0.197324 Apr 11 19:41:31 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 285/870] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 19:41:31 2023] GET /compute/v2.1/servers/8c45de50-92bc-467c-9f3d-7e667e1d0bb3 => generated 1768 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 19:41:50 user devstack@n-api.service[72090]: DEBUG dbcounter [-] [72090] Writing DB stats nova_api:SELECT=6 {{(pid=72090) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:41:50 user devstack@n-api.service[72090]: DEBUG dbcounter [-] [72090] Writing DB stats nova_cell1:SELECT=10 {{(pid=72090) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:41:50 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [None req-976bdd8c-2a46-4ebe-86cf-01ee16999953 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Action: 'create', calling method: .version_select at 0x7f119d904430>, body: {"keypair": {"name": "tempest-SnapshotDataIntegrityTests-234136439", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJgEnKjXODkrVP1I9vap7nSk4UwAXw+9cEJPR3Eefq/qUJABtSOM4npeL0Yt2cWOu+Tp/Uq09/jE2WIlZvjGNjfzD5vmuG/JOIfRKdnSH0rl79lcIxVns70WcKMtDpBn1g=="}} {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:41:50 user devstack@n-api.service[72090]: DEBUG nova.quota [None req-976bdd8c-2a46-4ebe-86cf-01ee16999953 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Getting quotas for project 27f0373f7bf54eb8845340bd4e931ab2. Resources: {'key_pairs'} {{(pid=72090) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 19:41:50 user devstack@n-api.service[72090]: DEBUG nova.quota [None req-976bdd8c-2a46-4ebe-86cf-01ee16999953 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Getting quotas for user 9b2a4a06b5354121ae49d85be8b02458 and project 27f0373f7bf54eb8845340bd4e931ab2. Resources: {'key_pairs'} {{(pid=72090) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 19:41:50 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [None req-976bdd8c-2a46-4ebe-86cf-01ee16999953 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.261803 Apr 11 19:41:50 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 289/871] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Apr 11 19:41:50 2023] POST /compute/v2.1/os-keypairs => generated 404 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:41:51 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [None req-f6de08be-f9ac-4e55-884a-d0ee71f21d9b tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SnapshotDataIntegrityTests-server-1913437665", "imageRef": "4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b", "flavorRef": "42", "key_name": "tempest-SnapshotDataIntegrityTests-234136439", "security_groups": [{"name": "tempest-secgroup-smoke-2058429096"}], "networks": [{"uuid": "41cb581c-8f02-42e0-ab09-bcc05d4aa23c"}]}} {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:41:51 user devstack@n-api.service[72089]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 11 19:41:51 user devstack@n-api.service[72089]: Tue Apr 11 19:41:51 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.0.0.210) !!! Apr 11 19:41:51 user devstack@n-api.service[72089]: DEBUG dbcounter [-] [72089] Writing DB stats nova_api:SELECT=21,nova_api:INSERT=3 {{(pid=72089) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:41:51 user devstack@n-api.service[72089]: DEBUG dbcounter [-] [72089] Writing DB stats nova_cell1:SELECT=12 {{(pid=72089) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:41:52 user devstack@n-api.service[72089]: DEBUG nova.network.neutron [None req-f6de08be-f9ac-4e55-884a-d0ee71f21d9b tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] validate_networks() for [('41cb581c-8f02-42e0-ab09-bcc05d4aa23c', None, None, None, None, None)] {{(pid=72089) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 11 19:41:52 user devstack@n-api.service[72089]: DEBUG nova.virt.hardware [None req-f6de08be-f9ac-4e55-884a-d0ee71f21d9b tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Flavor limits 0:0:0 {{(pid=72089) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 19:41:52 user devstack@n-api.service[72089]: DEBUG nova.virt.hardware [None req-f6de08be-f9ac-4e55-884a-d0ee71f21d9b tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Image limits 0:0:0 {{(pid=72089) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 19:41:52 user devstack@n-api.service[72089]: DEBUG nova.virt.hardware [None req-f6de08be-f9ac-4e55-884a-d0ee71f21d9b tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Flavor pref 0:0:0 {{(pid=72089) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 19:41:52 user devstack@n-api.service[72089]: DEBUG nova.virt.hardware [None req-f6de08be-f9ac-4e55-884a-d0ee71f21d9b tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Image pref 0:0:0 {{(pid=72089) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 19:41:52 user devstack@n-api.service[72089]: DEBUG nova.virt.hardware [None req-f6de08be-f9ac-4e55-884a-d0ee71f21d9b tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72089) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 19:41:52 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-f6de08be-f9ac-4e55-884a-d0ee71f21d9b tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:41:52 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-f6de08be-f9ac-4e55-884a-d0ee71f21d9b tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:41:52 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-f6de08be-f9ac-4e55-884a-d0ee71f21d9b tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:41:52 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-f6de08be-f9ac-4e55-884a-d0ee71f21d9b tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:41:52 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-f6de08be-f9ac-4e55-884a-d0ee71f21d9b tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:41:52 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-f6de08be-f9ac-4e55-884a-d0ee71f21d9b tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:41:52 user devstack@n-api.service[72089]: DEBUG nova.quota [None req-f6de08be-f9ac-4e55-884a-d0ee71f21d9b tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Getting quotas for project 27f0373f7bf54eb8845340bd4e931ab2. Resources: {'ram', 'instances', 'cores'} {{(pid=72089) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 19:41:52 user devstack@n-api.service[72089]: DEBUG nova.quota [None req-f6de08be-f9ac-4e55-884a-d0ee71f21d9b tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Getting quotas for user 9b2a4a06b5354121ae49d85be8b02458 and project 27f0373f7bf54eb8845340bd4e931ab2. Resources: {'ram', 'instances', 'cores'} {{(pid=72089) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 19:41:52 user devstack@n-api.service[72089]: DEBUG nova.compute.api [None req-f6de08be-f9ac-4e55-884a-d0ee71f21d9b tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Going to run 1 instances... {{(pid=72089) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 11 19:41:52 user devstack@n-api.service[72089]: DEBUG nova.compute.api [None req-f6de08be-f9ac-4e55-884a-d0ee71f21d9b tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] [instance: 6b110aaa-0f26-4bab-8f3e-d22edb5a5072] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=72089) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 11 19:41:52 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [None req-f6de08be-f9ac-4e55-884a-d0ee71f21d9b tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.833265 Apr 11 19:41:52 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 298/872] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 11 19:41:51 2023] POST /compute/v2.1/servers => generated 404 bytes in 836 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 11 19:41:52 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [None req-502b56c7-3a96-4cc6-9c3d-f56a80722016 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Calling method '>' {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:41:52 user devstack@n-api.service[72088]: DEBUG nova.compute.api [None req-502b56c7-3a96-4cc6-9c3d-f56a80722016 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] [instance: 6b110aaa-0f26-4bab-8f3e-d22edb5a5072] Fetching instance by UUID {{(pid=72088) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:41:52 user devstack@n-api.service[72088]: DEBUG dbcounter [-] [72088] Writing DB stats nova_cell1:SELECT=6 {{(pid=72088) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:41:52 user devstack@n-api.service[72088]: DEBUG dbcounter [-] [72088] Writing DB stats nova_api:SELECT=4 {{(pid=72088) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:41:52 user devstack@n-api.service[72088]: DEBUG nova.policy [None req-502b56c7-3a96-4cc6-9c3d-f56a80722016 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b2a4a06b5354121ae49d85be8b02458', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f0373f7bf54eb8845340bd4e931ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72088) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:41:52 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [None req-502b56c7-3a96-4cc6-9c3d-f56a80722016 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6b110aaa-0f26-4bab-8f3e-d22edb5a5072" status: 200 len: 1256 microversion: 2.1 time: 0.161660 Apr 11 19:41:52 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 286/873] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 19:41:52 2023] GET /compute/v2.1/servers/6b110aaa-0f26-4bab-8f3e-d22edb5a5072 => generated 1256 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:41:52 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [None req-7d39492d-066d-4ede-9c3a-15acc4451032 tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] Calling method '>' {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:41:52 user devstack@n-api.service[72090]: DEBUG nova.compute.api [None req-7d39492d-066d-4ede-9c3a-15acc4451032 tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] [instance: d42dc0ea-4631-44be-8b58-09877280ba2e] Fetching instance by UUID {{(pid=72090) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:41:52 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-7d39492d-066d-4ede-9c3a-15acc4451032 tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:41:52 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-7d39492d-066d-4ede-9c3a-15acc4451032 tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:41:52 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-7d39492d-066d-4ede-9c3a-15acc4451032 tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:41:52 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [req-1afaaa41-de56-4adb-86f6-42474ba55389 req-0f206523-499f-48b0-8ce8-3b0317268a7f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d42dc0ea-4631-44be-8b58-09877280ba2e", "tag": "fd43e974-64b6-4605-83cb-11b9cfe58341"}]} {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:41:52 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-7d39492d-066d-4ede-9c3a-15acc4451032 tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:41:52 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-7d39492d-066d-4ede-9c3a-15acc4451032 tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:41:52 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-7d39492d-066d-4ede-9c3a-15acc4451032 tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:41:52 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-1afaaa41-de56-4adb-86f6-42474ba55389 req-0f206523-499f-48b0-8ce8-3b0317268a7f service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:41:52 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-1afaaa41-de56-4adb-86f6-42474ba55389 req-0f206523-499f-48b0-8ce8-3b0317268a7f service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:41:52 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-1afaaa41-de56-4adb-86f6-42474ba55389 req-0f206523-499f-48b0-8ce8-3b0317268a7f service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:41:52 user devstack@n-api.service[72090]: DEBUG nova.compute.api [None req-7d39492d-066d-4ede-9c3a-15acc4451032 tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] [instance: d42dc0ea-4631-44be-8b58-09877280ba2e] Going to try to terminate instance {{(pid=72090) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 11 19:41:52 user devstack@n-api.service[72089]: INFO nova.api.openstack.compute.server_external_events [req-1afaaa41-de56-4adb-86f6-42474ba55389 req-0f206523-499f-48b0-8ce8-3b0317268a7f service nova] Creating event network-changed:fd43e974-64b6-4605-83cb-11b9cfe58341 for instance d42dc0ea-4631-44be-8b58-09877280ba2e on user Apr 11 19:41:52 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [req-1afaaa41-de56-4adb-86f6-42474ba55389 req-0f206523-499f-48b0-8ce8-3b0317268a7f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046275 Apr 11 19:41:52 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 299/874] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:41:52 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:41:53 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [None req-7d39492d-066d-4ede-9c3a-15acc4451032 tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/d42dc0ea-4631-44be-8b58-09877280ba2e" status: 204 len: 0 microversion: 2.1 time: 0.121445 Apr 11 19:41:53 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 290/875] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 19:41:52 2023] DELETE /compute/v2.1/servers/d42dc0ea-4631-44be-8b58-09877280ba2e => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 11 19:41:53 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [None req-59a9830c-2c67-4460-9dc0-851db432ec79 tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] Calling method '>' {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:41:53 user devstack@n-api.service[72088]: DEBUG nova.compute.api [None req-59a9830c-2c67-4460-9dc0-851db432ec79 tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] [instance: d42dc0ea-4631-44be-8b58-09877280ba2e] Fetching instance by UUID {{(pid=72088) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:41:53 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-59a9830c-2c67-4460-9dc0-851db432ec79 tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:41:53 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-59a9830c-2c67-4460-9dc0-851db432ec79 tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:41:53 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-59a9830c-2c67-4460-9dc0-851db432ec79 tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:41:53 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-59a9830c-2c67-4460-9dc0-851db432ec79 tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:41:53 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-59a9830c-2c67-4460-9dc0-851db432ec79 tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:41:53 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-59a9830c-2c67-4460-9dc0-851db432ec79 tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:41:53 user devstack@n-api.service[72088]: DEBUG nova.policy [None req-59a9830c-2c67-4460-9dc0-851db432ec79 tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68fcdcd3af164195bf0c7da3b8dfecb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7b9baa081ca455ea6931b7801c805b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72088) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:41:53 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [None req-59a9830c-2c67-4460-9dc0-851db432ec79 tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d42dc0ea-4631-44be-8b58-09877280ba2e" status: 200 len: 1555 microversion: 2.1 time: 0.284774 Apr 11 19:41:53 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 287/876] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 19:41:53 2023] GET /compute/v2.1/servers/d42dc0ea-4631-44be-8b58-09877280ba2e => generated 1555 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:41:53 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [req-92b2c85d-b493-4f84-ba5d-52f1082f5c3d req-1b3cd84c-3b05-4360-a2c6-5578046105c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d42dc0ea-4631-44be-8b58-09877280ba2e", "name": "network-vif-unplugged", "status": "completed", "tag": "fd43e974-64b6-4605-83cb-11b9cfe58341"}]} {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:41:53 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-92b2c85d-b493-4f84-ba5d-52f1082f5c3d req-1b3cd84c-3b05-4360-a2c6-5578046105c2 service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:41:53 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-92b2c85d-b493-4f84-ba5d-52f1082f5c3d req-1b3cd84c-3b05-4360-a2c6-5578046105c2 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:41:53 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-92b2c85d-b493-4f84-ba5d-52f1082f5c3d req-1b3cd84c-3b05-4360-a2c6-5578046105c2 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:41:53 user devstack@n-api.service[72089]: INFO nova.api.openstack.compute.server_external_events [req-92b2c85d-b493-4f84-ba5d-52f1082f5c3d req-1b3cd84c-3b05-4360-a2c6-5578046105c2 service nova] Creating event network-vif-unplugged:fd43e974-64b6-4605-83cb-11b9cfe58341 for instance d42dc0ea-4631-44be-8b58-09877280ba2e on user Apr 11 19:41:53 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [req-92b2c85d-b493-4f84-ba5d-52f1082f5c3d req-1b3cd84c-3b05-4360-a2c6-5578046105c2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033851 Apr 11 19:41:53 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 300/877] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:41:53 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:41:55 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [req-51683cd6-9245-455a-ba6c-9d44d17e9246 req-6bf055b9-5cee-4cff-acb1-3bafe8bbc0b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d42dc0ea-4631-44be-8b58-09877280ba2e", "name": "network-vif-deleted", "tag": "fd43e974-64b6-4605-83cb-11b9cfe58341"}]} {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:41:55 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-51683cd6-9245-455a-ba6c-9d44d17e9246 req-6bf055b9-5cee-4cff-acb1-3bafe8bbc0b6 service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:41:55 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-51683cd6-9245-455a-ba6c-9d44d17e9246 req-6bf055b9-5cee-4cff-acb1-3bafe8bbc0b6 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:41:55 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-51683cd6-9245-455a-ba6c-9d44d17e9246 req-6bf055b9-5cee-4cff-acb1-3bafe8bbc0b6 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:41:55 user devstack@n-api.service[72090]: INFO nova.api.openstack.compute.server_external_events [req-51683cd6-9245-455a-ba6c-9d44d17e9246 req-6bf055b9-5cee-4cff-acb1-3bafe8bbc0b6 service nova] Creating event network-vif-deleted:fd43e974-64b6-4605-83cb-11b9cfe58341 for instance d42dc0ea-4631-44be-8b58-09877280ba2e on user Apr 11 19:41:55 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [req-51683cd6-9245-455a-ba6c-9d44d17e9246 req-6bf055b9-5cee-4cff-acb1-3bafe8bbc0b6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035450 Apr 11 19:41:55 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 291/878] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:41:54 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:41:55 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [req-720c1b16-3a02-4c92-a1f0-51f4c13c79fd req-209c3e2e-279f-4ddd-b06e-70f6316e2ae7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d42dc0ea-4631-44be-8b58-09877280ba2e", "name": "network-vif-plugged", "status": "completed", "tag": "fd43e974-64b6-4605-83cb-11b9cfe58341"}]} {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:41:55 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-720c1b16-3a02-4c92-a1f0-51f4c13c79fd req-209c3e2e-279f-4ddd-b06e-70f6316e2ae7 service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:41:55 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-720c1b16-3a02-4c92-a1f0-51f4c13c79fd req-209c3e2e-279f-4ddd-b06e-70f6316e2ae7 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:41:55 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-720c1b16-3a02-4c92-a1f0-51f4c13c79fd req-209c3e2e-279f-4ddd-b06e-70f6316e2ae7 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:41:55 user devstack@n-api.service[72088]: INFO nova.api.openstack.compute.server_external_events [req-720c1b16-3a02-4c92-a1f0-51f4c13c79fd req-209c3e2e-279f-4ddd-b06e-70f6316e2ae7 service nova] Creating event network-vif-plugged:fd43e974-64b6-4605-83cb-11b9cfe58341 for instance d42dc0ea-4631-44be-8b58-09877280ba2e on user Apr 11 19:41:55 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [req-720c1b16-3a02-4c92-a1f0-51f4c13c79fd req-209c3e2e-279f-4ddd-b06e-70f6316e2ae7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031454 Apr 11 19:41:55 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 288/879] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:41:55 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 11 19:41:55 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [req-bf426c18-8566-4a1a-8e7f-9628ebe0467d req-c3486ea8-3d12-4665-b93b-bf7637d725ab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6b110aaa-0f26-4bab-8f3e-d22edb5a5072", "tag": "8d43789b-e200-409a-b819-09dd85859b3c"}]} {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:41:55 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-bf426c18-8566-4a1a-8e7f-9628ebe0467d req-c3486ea8-3d12-4665-b93b-bf7637d725ab service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:41:55 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-bf426c18-8566-4a1a-8e7f-9628ebe0467d req-c3486ea8-3d12-4665-b93b-bf7637d725ab service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:41:55 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-bf426c18-8566-4a1a-8e7f-9628ebe0467d req-c3486ea8-3d12-4665-b93b-bf7637d725ab service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:41:55 user devstack@n-api.service[72089]: INFO nova.api.openstack.compute.server_external_events [req-bf426c18-8566-4a1a-8e7f-9628ebe0467d req-c3486ea8-3d12-4665-b93b-bf7637d725ab service nova] Creating event network-changed:8d43789b-e200-409a-b819-09dd85859b3c for instance 6b110aaa-0f26-4bab-8f3e-d22edb5a5072 on user Apr 11 19:41:55 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [req-bf426c18-8566-4a1a-8e7f-9628ebe0467d req-c3486ea8-3d12-4665-b93b-bf7637d725ab service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035411 Apr 11 19:41:55 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 301/880] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:41:55 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:41:57 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [None req-49fcebae-a205-4b63-888c-f79fc04dc2f9 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Calling method '>' {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:41:57 user devstack@n-api.service[72090]: DEBUG nova.compute.api [None req-49fcebae-a205-4b63-888c-f79fc04dc2f9 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] [instance: 478eb884-ba19-4a4b-b1eb-a2e59d6beef0] Fetching instance by UUID {{(pid=72090) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:41:57 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-49fcebae-a205-4b63-888c-f79fc04dc2f9 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:41:57 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-49fcebae-a205-4b63-888c-f79fc04dc2f9 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:41:57 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-49fcebae-a205-4b63-888c-f79fc04dc2f9 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:41:57 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-49fcebae-a205-4b63-888c-f79fc04dc2f9 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:41:57 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-49fcebae-a205-4b63-888c-f79fc04dc2f9 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:41:57 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-49fcebae-a205-4b63-888c-f79fc04dc2f9 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:41:58 user devstack@n-api.service[72090]: DEBUG nova.policy [None req-49fcebae-a205-4b63-888c-f79fc04dc2f9 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05fb551c320a48f98a4ec00a7f7492d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60a7381a31b84e97a068528f90813773', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72090) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:41:58 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [None req-49fcebae-a205-4b63-888c-f79fc04dc2f9 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] 10.0.0.210 "GET /compute/v2.1/servers/478eb884-ba19-4a4b-b1eb-a2e59d6beef0" status: 200 len: 1539 microversion: 2.1 time: 0.378103 Apr 11 19:41:58 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 292/881] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 19:41:57 2023] GET /compute/v2.1/servers/478eb884-ba19-4a4b-b1eb-a2e59d6beef0 => generated 1539 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:41:58 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [req-01bba42a-e544-4f91-8378-f5dfa8280284 req-7ee30039-a105-4a8a-8d06-19e8d79a3a73 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b110aaa-0f26-4bab-8f3e-d22edb5a5072", "name": "network-vif-plugged", "status": "completed", "tag": "8d43789b-e200-409a-b819-09dd85859b3c"}]} {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:41:58 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-01bba42a-e544-4f91-8378-f5dfa8280284 req-7ee30039-a105-4a8a-8d06-19e8d79a3a73 service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:41:58 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-01bba42a-e544-4f91-8378-f5dfa8280284 req-7ee30039-a105-4a8a-8d06-19e8d79a3a73 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:41:58 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-01bba42a-e544-4f91-8378-f5dfa8280284 req-7ee30039-a105-4a8a-8d06-19e8d79a3a73 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:41:58 user devstack@n-api.service[72088]: INFO nova.api.openstack.compute.server_external_events [req-01bba42a-e544-4f91-8378-f5dfa8280284 req-7ee30039-a105-4a8a-8d06-19e8d79a3a73 service nova] Creating event network-vif-plugged:8d43789b-e200-409a-b819-09dd85859b3c for instance 6b110aaa-0f26-4bab-8f3e-d22edb5a5072 on user Apr 11 19:41:58 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [req-01bba42a-e544-4f91-8378-f5dfa8280284 req-7ee30039-a105-4a8a-8d06-19e8d79a3a73 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030552 Apr 11 19:41:58 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 289/882] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:41:58 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:42:00 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [req-b53645a2-b5fa-43f3-9343-c70086d65932 req-34ea37f0-f588-469a-af68-781269f32fbd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b110aaa-0f26-4bab-8f3e-d22edb5a5072", "name": "network-vif-plugged", "status": "completed", "tag": "8d43789b-e200-409a-b819-09dd85859b3c"}]} {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:42:00 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-b53645a2-b5fa-43f3-9343-c70086d65932 req-34ea37f0-f588-469a-af68-781269f32fbd service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:42:00 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-b53645a2-b5fa-43f3-9343-c70086d65932 req-34ea37f0-f588-469a-af68-781269f32fbd service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:42:00 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-b53645a2-b5fa-43f3-9343-c70086d65932 req-34ea37f0-f588-469a-af68-781269f32fbd service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:42:00 user devstack@n-api.service[72089]: INFO nova.api.openstack.compute.server_external_events [req-b53645a2-b5fa-43f3-9343-c70086d65932 req-34ea37f0-f588-469a-af68-781269f32fbd service nova] Creating event network-vif-plugged:8d43789b-e200-409a-b819-09dd85859b3c for instance 6b110aaa-0f26-4bab-8f3e-d22edb5a5072 on user Apr 11 19:42:00 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [req-b53645a2-b5fa-43f3-9343-c70086d65932 req-34ea37f0-f588-469a-af68-781269f32fbd service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029745 Apr 11 19:42:00 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 302/883] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:42:00 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:42:09 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [None req-591888e4-a797-451c-b5f0-a8172d33c8bf tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Calling method '>' {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:42:09 user devstack@n-api.service[72090]: DEBUG nova.compute.api [None req-591888e4-a797-451c-b5f0-a8172d33c8bf tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] [instance: bf0a75f5-2f44-4687-af12-046f6761fee2] Fetching instance by UUID {{(pid=72090) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:42:09 user devstack@n-api.service[72090]: DEBUG dbcounter [-] [72090] Writing DB stats nova_cell0:SELECT=4 {{(pid=72090) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:42:09 user devstack@n-api.service[72090]: DEBUG dbcounter [-] [72090] Writing DB stats nova_api:SELECT=22,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=72090) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:42:09 user devstack@n-api.service[72090]: DEBUG dbcounter [-] [72090] Writing DB stats nova_cell1:SELECT=23,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=72090) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:42:09 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-591888e4-a797-451c-b5f0-a8172d33c8bf tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:42:09 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-591888e4-a797-451c-b5f0-a8172d33c8bf tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:42:09 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-591888e4-a797-451c-b5f0-a8172d33c8bf tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:42:09 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-591888e4-a797-451c-b5f0-a8172d33c8bf tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:42:09 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-591888e4-a797-451c-b5f0-a8172d33c8bf tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:42:09 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-591888e4-a797-451c-b5f0-a8172d33c8bf tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:42:09 user devstack@n-api.service[72090]: INFO nova.api.openstack.wsgi [None req-591888e4-a797-451c-b5f0-a8172d33c8bf tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] HTTP exception thrown: Cannot 'detach_volume' instance bf0a75f5-2f44-4687-af12-046f6761fee2 while it is in vm_state rescued Apr 11 19:42:09 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [None req-591888e4-a797-451c-b5f0-a8172d33c8bf tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Request method failure captured: Apr 11 19:42:09 user devstack@n-api.service[72090]: request: DELETE /compute/v2.1/servers/bf0a75f5-2f44-4687-af12-046f6761fee2/os-volume_attachments/6cb60e75-74d9-4e1f-a22e-40a36780b21b HTTP/1.1 Apr 11 19:42:09 user devstack@n-api.service[72090]: Accept: application/json Apr 11 19:42:09 user devstack@n-api.service[72090]: Accept-Encoding: identity Apr 11 19:42:09 user devstack@n-api.service[72090]: Connection: close Apr 11 19:42:09 user devstack@n-api.service[72090]: Content-Length: 0 Apr 11 19:42:09 user devstack@n-api.service[72090]: Content-Type: application/json Apr 11 19:42:09 user devstack@n-api.service[72090]: Host: 10.0.0.210 Apr 11 19:42:09 user devstack@n-api.service[72090]: Openstack-System-Scope: None Apr 11 19:42:09 user devstack@n-api.service[72090]: User-Agent: python-urllib3/1.26.15 Apr 11 19:42:09 user devstack@n-api.service[72090]: X-Auth-Token: gAAAAABkNbUs3sGO0rC9Wf1HLL6y1zTXQ2xF2dMBaRGrgCkjSdBXMgDkz15sqaczXa_JcLLMjTSvFMatkt2Ta8S0VFlkGMqdbOYT7FNOzdcAgJLJI5j09-UAdp8WgiUM6SYPHBZLPS_ENQDMUXHUhrQJgHrsBuBOiq0wzxzQWDwcJRw-4wyoV9E Apr 11 19:42:09 user devstack@n-api.service[72090]: X-Domain-Id: None Apr 11 19:42:09 user devstack@n-api.service[72090]: X-Domain-Name: None Apr 11 19:42:09 user devstack@n-api.service[72090]: X-Identity-Status: Confirmed Apr 11 19:42:09 user devstack@n-api.service[72090]: X-Is-Admin-Project: True Apr 11 19:42:09 user devstack@n-api.service[72090]: X-Project-Domain-Id: default Apr 11 19:42:09 user devstack@n-api.service[72090]: X-Project-Domain-Name: Default Apr 11 19:42:09 user devstack@n-api.service[72090]: X-Project-Id: b8e3a291c54b49db8e12a88ba41865e3 Apr 11 19:42:09 user devstack@n-api.service[72090]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1429831687 Apr 11 19:42:09 user devstack@n-api.service[72090]: X-Role: reader,member Apr 11 19:42:09 user devstack@n-api.service[72090]: X-Roles: reader,member Apr 11 19:42:09 user devstack@n-api.service[72090]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b8e3a291c54b49db8e12a88ba41865e3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/b8e3a291c54b49db8e12a88ba41865e3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b8e3a291c54b49db8e12a88ba41865e3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 11 19:42:09 user devstack@n-api.service[72090]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1429831687 Apr 11 19:42:09 user devstack@n-api.service[72090]: X-Tenant-Id: b8e3a291c54b49db8e12a88ba41865e3 Apr 11 19:42:09 user devstack@n-api.service[72090]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1429831687 Apr 11 19:42:09 user devstack@n-api.service[72090]: X-User: tempest-ServerRescueNegativeTestJSON-1429831687-project-member Apr 11 19:42:09 user devstack@n-api.service[72090]: X-User-Domain-Id: default Apr 11 19:42:09 user devstack@n-api.service[72090]: X-User-Domain-Name: Default Apr 11 19:42:09 user devstack@n-api.service[72090]: X-User-Id: ba7f82b529e74d99838b6264b94d823b Apr 11 19:42:09 user devstack@n-api.service[72090]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1429831687-project-member Apr 11 19:42:09 user devstack@n-api.service[72090]: method: > Apr 11 19:42:09 user devstack@n-api.service[72090]: exception: Cannot 'detach_volume' instance bf0a75f5-2f44-4687-af12-046f6761fee2 while it is in vm_state rescued Apr 11 19:42:09 user devstack@n-api.service[72090]: action_args: {'server_id': 'bf0a75f5-2f44-4687-af12-046f6761fee2', 'id': '6cb60e75-74d9-4e1f-a22e-40a36780b21b'} Apr 11 19:42:09 user devstack@n-api.service[72090]: {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 19:42:09 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:42:09 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Apr 11 19:42:09 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Apr 11 19:42:09 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Apr 11 19:42:09 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Apr 11 19:42:09 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Apr 11 19:42:09 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Apr 11 19:42:09 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance bf0a75f5-2f44-4687-af12-046f6761fee2 in vm_state rescued. Cannot detach_volume while the instance is in this state. Apr 11 19:42:09 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi Apr 11 19:42:09 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 19:42:09 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi Apr 11 19:42:09 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:42:09 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 19:42:09 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 19:42:09 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 19:42:09 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 19:42:09 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 19:42:09 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 19:42:09 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Apr 11 19:42:09 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Apr 11 19:42:09 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Apr 11 19:42:09 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Apr 11 19:42:09 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance bf0a75f5-2f44-4687-af12-046f6761fee2 while it is in vm_state rescued Apr 11 19:42:09 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi Apr 11 19:42:09 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 19:42:09 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi Apr 11 19:42:09 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:42:09 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 19:42:09 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 19:42:09 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 19:42:09 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 19:42:09 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance bf0a75f5-2f44-4687-af12-046f6761fee2 while it is in vm_state rescued Apr 11 19:42:09 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi Apr 11 19:42:09 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [None req-591888e4-a797-451c-b5f0-a8172d33c8bf tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Returning 409 to user: Cannot 'detach_volume' instance bf0a75f5-2f44-4687-af12-046f6761fee2 while it is in vm_state rescued {{(pid=72090) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 19:42:09 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [None req-591888e4-a797-451c-b5f0-a8172d33c8bf tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/bf0a75f5-2f44-4687-af12-046f6761fee2/os-volume_attachments/6cb60e75-74d9-4e1f-a22e-40a36780b21b" status: 409 len: 152 microversion: 2.1 time: 0.172052 Apr 11 19:42:09 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 293/884] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Apr 11 19:42:09 2023] DELETE /compute/v2.1/servers/bf0a75f5-2f44-4687-af12-046f6761fee2/os-volume_attachments/6cb60e75-74d9-4e1f-a22e-40a36780b21b => generated 152 bytes in 175 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Apr 11 19:42:09 user devstack@n-api.service[72088]: DEBUG dbcounter [-] [72088] Writing DB stats nova_cell0:SELECT=2 {{(pid=72088) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:42:09 user devstack@n-api.service[72088]: DEBUG dbcounter [-] [72088] Writing DB stats nova_api:SELECT=10 {{(pid=72088) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:42:09 user devstack@n-api.service[72088]: DEBUG dbcounter [-] [72088] Writing DB stats nova_cell1:SELECT=10 {{(pid=72088) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:42:09 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [None req-fa8aa12c-e3bf-47fa-ad7c-719164a0208f tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:42:09 user devstack@n-api.service[72088]: DEBUG nova.compute.api [None req-fa8aa12c-e3bf-47fa-ad7c-719164a0208f tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] [instance: bf0a75f5-2f44-4687-af12-046f6761fee2] Fetching instance by UUID {{(pid=72088) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:42:09 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-fa8aa12c-e3bf-47fa-ad7c-719164a0208f tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:42:09 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-fa8aa12c-e3bf-47fa-ad7c-719164a0208f tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:42:09 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-fa8aa12c-e3bf-47fa-ad7c-719164a0208f tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:42:09 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-fa8aa12c-e3bf-47fa-ad7c-719164a0208f tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:42:09 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-fa8aa12c-e3bf-47fa-ad7c-719164a0208f tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:42:09 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-fa8aa12c-e3bf-47fa-ad7c-719164a0208f tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:42:09 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [None req-fa8aa12c-e3bf-47fa-ad7c-719164a0208f tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] 10.0.0.210 "POST /compute/v2.1/servers/bf0a75f5-2f44-4687-af12-046f6761fee2/action" status: 202 len: 0 microversion: 2.1 time: 0.081053 Apr 11 19:42:09 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 290/885] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Apr 11 19:42:09 2023] POST /compute/v2.1/servers/bf0a75f5-2f44-4687-af12-046f6761fee2/action => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 19:42:09 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [None req-4841a328-d827-4e52-bc06-a060753c0495 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Calling method '>' {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:42:09 user devstack@n-api.service[72089]: DEBUG nova.compute.api [None req-4841a328-d827-4e52-bc06-a060753c0495 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] [instance: bf0a75f5-2f44-4687-af12-046f6761fee2] Fetching instance by UUID {{(pid=72089) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:42:09 user devstack@n-api.service[72089]: DEBUG dbcounter [-] [72089] Writing DB stats nova_cell0:SELECT=2 {{(pid=72089) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:42:09 user devstack@n-api.service[72089]: DEBUG dbcounter [-] [72089] Writing DB stats nova_cell0:SELECT=6 {{(pid=72089) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:42:09 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-4841a328-d827-4e52-bc06-a060753c0495 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:42:09 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-4841a328-d827-4e52-bc06-a060753c0495 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:42:09 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-4841a328-d827-4e52-bc06-a060753c0495 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:42:09 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-4841a328-d827-4e52-bc06-a060753c0495 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:42:09 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-4841a328-d827-4e52-bc06-a060753c0495 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:42:09 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-4841a328-d827-4e52-bc06-a060753c0495 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:42:09 user devstack@n-api.service[72089]: DEBUG nova.policy [None req-4841a328-d827-4e52-bc06-a060753c0495 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba7f82b529e74d99838b6264b94d823b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e3a291c54b49db8e12a88ba41865e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72089) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:42:09 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [None req-4841a328-d827-4e52-bc06-a060753c0495 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bf0a75f5-2f44-4687-af12-046f6761fee2" status: 200 len: 1713 microversion: 2.1 time: 0.169352 Apr 11 19:42:09 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 303/886] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 19:42:09 2023] GET /compute/v2.1/servers/bf0a75f5-2f44-4687-af12-046f6761fee2 => generated 1713 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:42:10 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [req-56dc5eba-9edc-4618-8457-8141c8b17766 req-570ffb9c-d6d8-46f4-88e7-d399d1405c47 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf0a75f5-2f44-4687-af12-046f6761fee2", "name": "network-vif-unplugged", "status": "completed", "tag": "c662b1b3-b2b3-4502-81af-9afdf3e591dc"}]} {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:42:10 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-56dc5eba-9edc-4618-8457-8141c8b17766 req-570ffb9c-d6d8-46f4-88e7-d399d1405c47 service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:42:10 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-56dc5eba-9edc-4618-8457-8141c8b17766 req-570ffb9c-d6d8-46f4-88e7-d399d1405c47 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:42:10 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-56dc5eba-9edc-4618-8457-8141c8b17766 req-570ffb9c-d6d8-46f4-88e7-d399d1405c47 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:42:10 user devstack@n-api.service[72090]: INFO nova.api.openstack.compute.server_external_events [req-56dc5eba-9edc-4618-8457-8141c8b17766 req-570ffb9c-d6d8-46f4-88e7-d399d1405c47 service nova] Creating event network-vif-unplugged:c662b1b3-b2b3-4502-81af-9afdf3e591dc for instance bf0a75f5-2f44-4687-af12-046f6761fee2 on user Apr 11 19:42:10 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [req-56dc5eba-9edc-4618-8457-8141c8b17766 req-570ffb9c-d6d8-46f4-88e7-d399d1405c47 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.054209 Apr 11 19:42:10 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 294/887] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:42:10 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:42:12 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [req-345583c9-34f0-4c46-bcd7-99d811a77b4d req-0ab6d8b1-0380-4e76-9f7f-187844ebda01 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf0a75f5-2f44-4687-af12-046f6761fee2", "name": "network-vif-plugged", "status": "completed", "tag": "c662b1b3-b2b3-4502-81af-9afdf3e591dc"}, {"server_uuid": "bf0a75f5-2f44-4687-af12-046f6761fee2", "name": "network-vif-plugged", "status": "completed", "tag": "c662b1b3-b2b3-4502-81af-9afdf3e591dc"}, {"server_uuid": "bf0a75f5-2f44-4687-af12-046f6761fee2", "name": "network-vif-plugged", "status": "completed", "tag": "c662b1b3-b2b3-4502-81af-9afdf3e591dc"}]} {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:42:12 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-345583c9-34f0-4c46-bcd7-99d811a77b4d req-0ab6d8b1-0380-4e76-9f7f-187844ebda01 service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:42:12 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-345583c9-34f0-4c46-bcd7-99d811a77b4d req-0ab6d8b1-0380-4e76-9f7f-187844ebda01 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:42:12 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-345583c9-34f0-4c46-bcd7-99d811a77b4d req-0ab6d8b1-0380-4e76-9f7f-187844ebda01 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:42:12 user devstack@n-api.service[72088]: INFO nova.api.openstack.compute.server_external_events [req-345583c9-34f0-4c46-bcd7-99d811a77b4d req-0ab6d8b1-0380-4e76-9f7f-187844ebda01 service nova] Creating event network-vif-plugged:c662b1b3-b2b3-4502-81af-9afdf3e591dc for instance bf0a75f5-2f44-4687-af12-046f6761fee2 on user Apr 11 19:42:12 user devstack@n-api.service[72088]: INFO nova.api.openstack.compute.server_external_events [req-345583c9-34f0-4c46-bcd7-99d811a77b4d req-0ab6d8b1-0380-4e76-9f7f-187844ebda01 service nova] Creating event network-vif-plugged:c662b1b3-b2b3-4502-81af-9afdf3e591dc for instance bf0a75f5-2f44-4687-af12-046f6761fee2 on user Apr 11 19:42:12 user devstack@n-api.service[72088]: INFO nova.api.openstack.compute.server_external_events [req-345583c9-34f0-4c46-bcd7-99d811a77b4d req-0ab6d8b1-0380-4e76-9f7f-187844ebda01 service nova] Creating event network-vif-plugged:c662b1b3-b2b3-4502-81af-9afdf3e591dc for instance bf0a75f5-2f44-4687-af12-046f6761fee2 on user Apr 11 19:42:12 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [req-345583c9-34f0-4c46-bcd7-99d811a77b4d req-0ab6d8b1-0380-4e76-9f7f-187844ebda01 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.032691 Apr 11 19:42:12 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 291/888] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:42:12 2023] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:42:19 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [None req-e0a67549-2c44-46a1-8621-c60e2369725d tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Calling method '>' {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:42:19 user devstack@n-api.service[72089]: DEBUG nova.compute.api [None req-e0a67549-2c44-46a1-8621-c60e2369725d tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] [instance: 0a59d114-20ac-448e-a95a-d3501c914833] Fetching instance by UUID {{(pid=72089) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:42:19 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-e0a67549-2c44-46a1-8621-c60e2369725d tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:42:19 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-e0a67549-2c44-46a1-8621-c60e2369725d tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:42:19 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-e0a67549-2c44-46a1-8621-c60e2369725d tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:42:19 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-e0a67549-2c44-46a1-8621-c60e2369725d tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:42:19 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-e0a67549-2c44-46a1-8621-c60e2369725d tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:42:19 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-e0a67549-2c44-46a1-8621-c60e2369725d tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:42:19 user devstack@n-api.service[72089]: DEBUG nova.policy [None req-e0a67549-2c44-46a1-8621-c60e2369725d tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf262cd03f4a41c4956d8784cf37d86d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caba0618fc743e7bfb2dd866a511df9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72089) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:42:19 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [None req-e0a67549-2c44-46a1-8621-c60e2369725d tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0a59d114-20ac-448e-a95a-d3501c914833" status: 200 len: 1442 microversion: 2.1 time: 0.149428 Apr 11 19:42:19 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 304/889] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 19:42:19 2023] GET /compute/v2.1/servers/0a59d114-20ac-448e-a95a-d3501c914833 => generated 1442 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:42:20 user devstack@n-api.service[72090]: DEBUG dbcounter [-] [72090] Writing DB stats nova_api:SELECT=4 {{(pid=72090) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:42:20 user devstack@n-api.service[72090]: DEBUG dbcounter [-] [72090] Writing DB stats nova_cell1:SELECT=8 {{(pid=72090) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:42:20 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [req-a89e3cac-7810-4a2e-b6b7-4788a8e472d9 req-d8df495e-7602-4d81-9265-183bc03a74c7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0a59d114-20ac-448e-a95a-d3501c914833", "tag": "41122899-3bba-4bdd-a114-61f342be91ae"}]} {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:42:20 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-a89e3cac-7810-4a2e-b6b7-4788a8e472d9 req-d8df495e-7602-4d81-9265-183bc03a74c7 service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:42:20 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-a89e3cac-7810-4a2e-b6b7-4788a8e472d9 req-d8df495e-7602-4d81-9265-183bc03a74c7 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:42:20 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-a89e3cac-7810-4a2e-b6b7-4788a8e472d9 req-d8df495e-7602-4d81-9265-183bc03a74c7 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:42:20 user devstack@n-api.service[72090]: INFO nova.api.openstack.compute.server_external_events [req-a89e3cac-7810-4a2e-b6b7-4788a8e472d9 req-d8df495e-7602-4d81-9265-183bc03a74c7 service nova] Creating event network-changed:41122899-3bba-4bdd-a114-61f342be91ae for instance 0a59d114-20ac-448e-a95a-d3501c914833 on user Apr 11 19:42:20 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [req-a89e3cac-7810-4a2e-b6b7-4788a8e472d9 req-d8df495e-7602-4d81-9265-183bc03a74c7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039210 Apr 11 19:42:20 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 295/890] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:42:20 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:42:21 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [None req-d1447fab-fb8c-4722-bb42-7aae33b17589 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Calling method '>' {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:42:21 user devstack@n-api.service[72088]: DEBUG nova.compute.api [None req-d1447fab-fb8c-4722-bb42-7aae33b17589 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] [instance: 0a59d114-20ac-448e-a95a-d3501c914833] Fetching instance by UUID {{(pid=72088) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:42:21 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-d1447fab-fb8c-4722-bb42-7aae33b17589 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:42:21 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-d1447fab-fb8c-4722-bb42-7aae33b17589 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:42:21 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-d1447fab-fb8c-4722-bb42-7aae33b17589 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:42:21 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-d1447fab-fb8c-4722-bb42-7aae33b17589 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:42:21 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-d1447fab-fb8c-4722-bb42-7aae33b17589 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:42:21 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-d1447fab-fb8c-4722-bb42-7aae33b17589 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:42:21 user devstack@n-api.service[72088]: DEBUG nova.compute.api [None req-d1447fab-fb8c-4722-bb42-7aae33b17589 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] [instance: 0a59d114-20ac-448e-a95a-d3501c914833] Going to try to terminate instance {{(pid=72088) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 11 19:42:21 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [None req-d1447fab-fb8c-4722-bb42-7aae33b17589 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/0a59d114-20ac-448e-a95a-d3501c914833" status: 204 len: 0 microversion: 2.1 time: 0.111947 Apr 11 19:42:21 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 292/891] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 19:42:20 2023] DELETE /compute/v2.1/servers/0a59d114-20ac-448e-a95a-d3501c914833 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 11 19:42:21 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [None req-52fa4189-5357-4d23-8d7f-754f6881df38 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Calling method '>' {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:42:21 user devstack@n-api.service[72089]: DEBUG nova.compute.api [None req-52fa4189-5357-4d23-8d7f-754f6881df38 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] [instance: 0a59d114-20ac-448e-a95a-d3501c914833] Fetching instance by UUID {{(pid=72089) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:42:21 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-52fa4189-5357-4d23-8d7f-754f6881df38 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:42:21 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-52fa4189-5357-4d23-8d7f-754f6881df38 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:42:21 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-52fa4189-5357-4d23-8d7f-754f6881df38 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:42:21 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-52fa4189-5357-4d23-8d7f-754f6881df38 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:42:21 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-52fa4189-5357-4d23-8d7f-754f6881df38 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:42:21 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-52fa4189-5357-4d23-8d7f-754f6881df38 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:42:21 user devstack@n-api.service[72089]: DEBUG nova.policy [None req-52fa4189-5357-4d23-8d7f-754f6881df38 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf262cd03f4a41c4956d8784cf37d86d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caba0618fc743e7bfb2dd866a511df9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72089) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:42:21 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [None req-52fa4189-5357-4d23-8d7f-754f6881df38 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0a59d114-20ac-448e-a95a-d3501c914833" status: 200 len: 1448 microversion: 2.1 time: 0.186776 Apr 11 19:42:21 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 305/892] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 19:42:21 2023] GET /compute/v2.1/servers/0a59d114-20ac-448e-a95a-d3501c914833 => generated 1448 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:42:21 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [req-fe5587be-f810-46f3-abbb-5c5180e3ac45 req-28df430f-f698-4370-9d03-2622b10a3022 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a59d114-20ac-448e-a95a-d3501c914833", "name": "network-vif-unplugged", "status": "completed", "tag": "41122899-3bba-4bdd-a114-61f342be91ae"}]} {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:42:21 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-fe5587be-f810-46f3-abbb-5c5180e3ac45 req-28df430f-f698-4370-9d03-2622b10a3022 service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:42:21 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-fe5587be-f810-46f3-abbb-5c5180e3ac45 req-28df430f-f698-4370-9d03-2622b10a3022 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:42:21 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-fe5587be-f810-46f3-abbb-5c5180e3ac45 req-28df430f-f698-4370-9d03-2622b10a3022 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:42:21 user devstack@n-api.service[72090]: INFO nova.api.openstack.compute.server_external_events [req-fe5587be-f810-46f3-abbb-5c5180e3ac45 req-28df430f-f698-4370-9d03-2622b10a3022 service nova] Creating event network-vif-unplugged:41122899-3bba-4bdd-a114-61f342be91ae for instance 0a59d114-20ac-448e-a95a-d3501c914833 on user Apr 11 19:42:21 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [req-fe5587be-f810-46f3-abbb-5c5180e3ac45 req-28df430f-f698-4370-9d03-2622b10a3022 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.101250 Apr 11 19:42:21 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 296/893] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:42:21 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:42:23 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [req-219d0a54-29f2-42e9-8c0d-837b8af23304 req-811d5666-7b1c-4136-822d-2fd527a3b274 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a59d114-20ac-448e-a95a-d3501c914833", "name": "network-vif-deleted", "tag": "41122899-3bba-4bdd-a114-61f342be91ae"}]} {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:42:23 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-219d0a54-29f2-42e9-8c0d-837b8af23304 req-811d5666-7b1c-4136-822d-2fd527a3b274 service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:42:23 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-219d0a54-29f2-42e9-8c0d-837b8af23304 req-811d5666-7b1c-4136-822d-2fd527a3b274 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:42:23 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-219d0a54-29f2-42e9-8c0d-837b8af23304 req-811d5666-7b1c-4136-822d-2fd527a3b274 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:42:23 user devstack@n-api.service[72088]: INFO nova.api.openstack.compute.server_external_events [req-219d0a54-29f2-42e9-8c0d-837b8af23304 req-811d5666-7b1c-4136-822d-2fd527a3b274 service nova] Creating event network-vif-deleted:41122899-3bba-4bdd-a114-61f342be91ae for instance 0a59d114-20ac-448e-a95a-d3501c914833 on user Apr 11 19:42:23 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [req-219d0a54-29f2-42e9-8c0d-837b8af23304 req-811d5666-7b1c-4136-822d-2fd527a3b274 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096358 Apr 11 19:42:23 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 293/894] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:42:23 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 11 19:42:23 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [req-ade9cff6-1e90-442c-b4f8-cb00340d8bca req-52ec6275-7f80-4ed3-9562-65f38838c5a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a59d114-20ac-448e-a95a-d3501c914833", "name": "network-vif-plugged", "status": "completed", "tag": "41122899-3bba-4bdd-a114-61f342be91ae"}]} {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:42:23 user devstack@n-api.service[72089]: DEBUG dbcounter [-] [72089] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=3 {{(pid=72089) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:42:23 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-ade9cff6-1e90-442c-b4f8-cb00340d8bca req-52ec6275-7f80-4ed3-9562-65f38838c5a2 service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:42:23 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-ade9cff6-1e90-442c-b4f8-cb00340d8bca req-52ec6275-7f80-4ed3-9562-65f38838c5a2 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:42:23 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-ade9cff6-1e90-442c-b4f8-cb00340d8bca req-52ec6275-7f80-4ed3-9562-65f38838c5a2 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:42:23 user devstack@n-api.service[72089]: DEBUG dbcounter [-] [72089] Writing DB stats nova_cell1:SELECT=29 {{(pid=72089) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:42:23 user devstack@n-api.service[72089]: INFO nova.api.openstack.compute.server_external_events [req-ade9cff6-1e90-442c-b4f8-cb00340d8bca req-52ec6275-7f80-4ed3-9562-65f38838c5a2 service nova] Creating event network-vif-plugged:41122899-3bba-4bdd-a114-61f342be91ae for instance 0a59d114-20ac-448e-a95a-d3501c914833 on user Apr 11 19:42:23 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [req-ade9cff6-1e90-442c-b4f8-cb00340d8bca req-52ec6275-7f80-4ed3-9562-65f38838c5a2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038924 Apr 11 19:42:23 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 306/895] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:42:23 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:42:32 user devstack@n-api.service[72090]: DEBUG dbcounter [-] [72090] Writing DB stats nova_api:SELECT=4 {{(pid=72090) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:42:32 user devstack@n-api.service[72090]: DEBUG dbcounter [-] [72090] Writing DB stats nova_cell1:SELECT=4 {{(pid=72090) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:42:32 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [None req-85ea411b-a26a-4eb2-bd73-e2abf4382fcf tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Calling method '>' {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:42:32 user devstack@n-api.service[72090]: DEBUG nova.compute.api [None req-85ea411b-a26a-4eb2-bd73-e2abf4382fcf tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] [instance: 8c45de50-92bc-467c-9f3d-7e667e1d0bb3] Fetching instance by UUID {{(pid=72090) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:42:32 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-85ea411b-a26a-4eb2-bd73-e2abf4382fcf tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:42:32 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-85ea411b-a26a-4eb2-bd73-e2abf4382fcf tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:42:32 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-85ea411b-a26a-4eb2-bd73-e2abf4382fcf tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:42:32 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-85ea411b-a26a-4eb2-bd73-e2abf4382fcf tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:42:32 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-85ea411b-a26a-4eb2-bd73-e2abf4382fcf tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:42:32 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-85ea411b-a26a-4eb2-bd73-e2abf4382fcf tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:42:32 user devstack@n-api.service[72090]: DEBUG nova.compute.api [None req-85ea411b-a26a-4eb2-bd73-e2abf4382fcf tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] [instance: 8c45de50-92bc-467c-9f3d-7e667e1d0bb3] Going to try to terminate instance {{(pid=72090) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 11 19:42:32 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [None req-85ea411b-a26a-4eb2-bd73-e2abf4382fcf tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/8c45de50-92bc-467c-9f3d-7e667e1d0bb3" status: 204 len: 0 microversion: 2.87 time: 0.237106 Apr 11 19:42:32 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 297/896] 10.0.0.210 () {64 vars in 1357 bytes} [Tue Apr 11 19:42:32 2023] DELETE /compute/v2.1/servers/8c45de50-92bc-467c-9f3d-7e667e1d0bb3 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 11 19:42:32 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [None req-04c60e17-3415-4024-9681-7426eb349c11 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Calling method '>' {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:42:32 user devstack@n-api.service[72088]: DEBUG nova.compute.api [None req-04c60e17-3415-4024-9681-7426eb349c11 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] [instance: 8c45de50-92bc-467c-9f3d-7e667e1d0bb3] Fetching instance by UUID {{(pid=72088) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:42:32 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-04c60e17-3415-4024-9681-7426eb349c11 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:42:32 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-04c60e17-3415-4024-9681-7426eb349c11 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:42:32 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-04c60e17-3415-4024-9681-7426eb349c11 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:42:32 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-04c60e17-3415-4024-9681-7426eb349c11 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:42:32 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-04c60e17-3415-4024-9681-7426eb349c11 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:42:32 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-04c60e17-3415-4024-9681-7426eb349c11 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:42:32 user devstack@n-api.service[72088]: DEBUG nova.policy [None req-04c60e17-3415-4024-9681-7426eb349c11 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b3adca432b04d70818a51d1366f5c6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb91586feb3f4a4c84fa8c2183baaf8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72088) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:42:32 user devstack@n-api.service[72088]: DEBUG nova.policy [None req-04c60e17-3415-4024-9681-7426eb349c11 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b3adca432b04d70818a51d1366f5c6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb91586feb3f4a4c84fa8c2183baaf8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72088) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:42:32 user devstack@n-api.service[72088]: DEBUG nova.policy [None req-04c60e17-3415-4024-9681-7426eb349c11 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b3adca432b04d70818a51d1366f5c6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb91586feb3f4a4c84fa8c2183baaf8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72088) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:42:32 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [None req-04c60e17-3415-4024-9681-7426eb349c11 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8c45de50-92bc-467c-9f3d-7e667e1d0bb3" status: 200 len: 1774 microversion: 2.87 time: 0.204885 Apr 11 19:42:32 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 294/897] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 19:42:32 2023] GET /compute/v2.1/servers/8c45de50-92bc-467c-9f3d-7e667e1d0bb3 => generated 1774 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 19:42:32 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [req-9a1f733e-5c6c-48dc-b55e-68d1071e11b5 req-7f739710-3b3e-45ef-af16-6de9b43b54e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c45de50-92bc-467c-9f3d-7e667e1d0bb3", "name": "network-vif-unplugged", "status": "completed", "tag": "82ee2878-c477-419c-97ba-9ac4b36dacab"}]} {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:42:32 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-9a1f733e-5c6c-48dc-b55e-68d1071e11b5 req-7f739710-3b3e-45ef-af16-6de9b43b54e0 service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:42:32 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-9a1f733e-5c6c-48dc-b55e-68d1071e11b5 req-7f739710-3b3e-45ef-af16-6de9b43b54e0 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:42:32 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-9a1f733e-5c6c-48dc-b55e-68d1071e11b5 req-7f739710-3b3e-45ef-af16-6de9b43b54e0 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:42:32 user devstack@n-api.service[72089]: INFO nova.api.openstack.compute.server_external_events [req-9a1f733e-5c6c-48dc-b55e-68d1071e11b5 req-7f739710-3b3e-45ef-af16-6de9b43b54e0 service nova] Creating event network-vif-unplugged:82ee2878-c477-419c-97ba-9ac4b36dacab for instance 8c45de50-92bc-467c-9f3d-7e667e1d0bb3 on user Apr 11 19:42:32 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [req-9a1f733e-5c6c-48dc-b55e-68d1071e11b5 req-7f739710-3b3e-45ef-af16-6de9b43b54e0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.037724 Apr 11 19:42:32 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 307/898] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:42:32 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:42:33 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [req-81bc9b28-4a64-4389-b681-5663110bf3b8 req-051363cd-a202-4f42-a277-d2262abf3ce3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c45de50-92bc-467c-9f3d-7e667e1d0bb3", "name": "network-vif-deleted", "tag": "82ee2878-c477-419c-97ba-9ac4b36dacab"}]} {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:42:33 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-81bc9b28-4a64-4389-b681-5663110bf3b8 req-051363cd-a202-4f42-a277-d2262abf3ce3 service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:42:33 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-81bc9b28-4a64-4389-b681-5663110bf3b8 req-051363cd-a202-4f42-a277-d2262abf3ce3 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:42:33 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-81bc9b28-4a64-4389-b681-5663110bf3b8 req-051363cd-a202-4f42-a277-d2262abf3ce3 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:42:33 user devstack@n-api.service[72090]: INFO nova.api.openstack.compute.server_external_events [req-81bc9b28-4a64-4389-b681-5663110bf3b8 req-051363cd-a202-4f42-a277-d2262abf3ce3 service nova] Creating event network-vif-deleted:82ee2878-c477-419c-97ba-9ac4b36dacab for instance 8c45de50-92bc-467c-9f3d-7e667e1d0bb3 on user Apr 11 19:42:33 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [req-81bc9b28-4a64-4389-b681-5663110bf3b8 req-051363cd-a202-4f42-a277-d2262abf3ce3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030302 Apr 11 19:42:33 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 298/899] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:42:33 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:42:34 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [req-3e45516e-3eb7-4122-aa71-b9f57156de79 req-a80c32b4-36b7-42f1-a204-c99033de096e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c45de50-92bc-467c-9f3d-7e667e1d0bb3", "name": "network-vif-plugged", "status": "completed", "tag": "82ee2878-c477-419c-97ba-9ac4b36dacab"}]} {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:42:34 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-3e45516e-3eb7-4122-aa71-b9f57156de79 req-a80c32b4-36b7-42f1-a204-c99033de096e service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:42:34 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-3e45516e-3eb7-4122-aa71-b9f57156de79 req-a80c32b4-36b7-42f1-a204-c99033de096e service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:42:34 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-3e45516e-3eb7-4122-aa71-b9f57156de79 req-a80c32b4-36b7-42f1-a204-c99033de096e service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:42:34 user devstack@n-api.service[72088]: INFO nova.api.openstack.compute.server_external_events [req-3e45516e-3eb7-4122-aa71-b9f57156de79 req-a80c32b4-36b7-42f1-a204-c99033de096e service nova] Creating event network-vif-plugged:82ee2878-c477-419c-97ba-9ac4b36dacab for instance 8c45de50-92bc-467c-9f3d-7e667e1d0bb3 on user Apr 11 19:42:34 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [req-3e45516e-3eb7-4122-aa71-b9f57156de79 req-a80c32b4-36b7-42f1-a204-c99033de096e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028484 Apr 11 19:42:34 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 295/900] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:42:34 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:42:42 user devstack@n-api.service[72089]: DEBUG dbcounter [-] [72089] Writing DB stats nova_api:SELECT=3 {{(pid=72089) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:42:42 user devstack@n-api.service[72089]: DEBUG dbcounter [-] [72089] Writing DB stats nova_cell1:SELECT=3 {{(pid=72089) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:42:42 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [None req-3db74fb0-41b5-4912-a7da-5479abb13f8e tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Calling method '>' {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:42:42 user devstack@n-api.service[72089]: DEBUG nova.compute.api [None req-3db74fb0-41b5-4912-a7da-5479abb13f8e tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] [instance: 6b110aaa-0f26-4bab-8f3e-d22edb5a5072] Fetching instance by UUID {{(pid=72089) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:42:42 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-3db74fb0-41b5-4912-a7da-5479abb13f8e tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:42:42 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-3db74fb0-41b5-4912-a7da-5479abb13f8e tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:42:42 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-3db74fb0-41b5-4912-a7da-5479abb13f8e tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:42:42 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-3db74fb0-41b5-4912-a7da-5479abb13f8e tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:42:42 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-3db74fb0-41b5-4912-a7da-5479abb13f8e tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:42:42 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-3db74fb0-41b5-4912-a7da-5479abb13f8e tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:42:43 user devstack@n-api.service[72089]: DEBUG nova.policy [None req-3db74fb0-41b5-4912-a7da-5479abb13f8e tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b2a4a06b5354121ae49d85be8b02458', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f0373f7bf54eb8845340bd4e931ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72089) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:42:43 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [None req-3db74fb0-41b5-4912-a7da-5479abb13f8e tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6b110aaa-0f26-4bab-8f3e-d22edb5a5072" status: 200 len: 1567 microversion: 2.1 time: 0.178689 Apr 11 19:42:43 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 308/901] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 19:42:42 2023] GET /compute/v2.1/servers/6b110aaa-0f26-4bab-8f3e-d22edb5a5072 => generated 1567 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:42:43 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [None req-2be3f00b-6f1a-4b4d-a9e8-852cb803690d tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] Calling method '>' {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:42:43 user devstack@n-api.service[72090]: DEBUG nova.compute.api [None req-2be3f00b-6f1a-4b4d-a9e8-852cb803690d tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] [instance: d42dc0ea-4631-44be-8b58-09877280ba2e] Fetching instance by UUID {{(pid=72090) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:42:43 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-2be3f00b-6f1a-4b4d-a9e8-852cb803690d tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:42:43 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-2be3f00b-6f1a-4b4d-a9e8-852cb803690d tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:42:43 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-2be3f00b-6f1a-4b4d-a9e8-852cb803690d tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:42:43 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-2be3f00b-6f1a-4b4d-a9e8-852cb803690d tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:42:43 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-2be3f00b-6f1a-4b4d-a9e8-852cb803690d tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:42:43 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-2be3f00b-6f1a-4b4d-a9e8-852cb803690d tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:42:43 user devstack@n-api.service[72090]: INFO nova.api.openstack.wsgi [None req-2be3f00b-6f1a-4b4d-a9e8-852cb803690d tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] HTTP exception thrown: Instance d42dc0ea-4631-44be-8b58-09877280ba2e could not be found. Apr 11 19:42:43 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [None req-2be3f00b-6f1a-4b4d-a9e8-852cb803690d tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] Request method failure captured: Apr 11 19:42:43 user devstack@n-api.service[72090]: request: GET /compute/v2.1/servers/d42dc0ea-4631-44be-8b58-09877280ba2e HTTP/1.1 Apr 11 19:42:43 user devstack@n-api.service[72090]: Accept: application/json Apr 11 19:42:43 user devstack@n-api.service[72090]: Accept-Encoding: identity Apr 11 19:42:43 user devstack@n-api.service[72090]: Connection: close Apr 11 19:42:43 user devstack@n-api.service[72090]: Content-Length: 0 Apr 11 19:42:43 user devstack@n-api.service[72090]: Content-Type: application/json Apr 11 19:42:43 user devstack@n-api.service[72090]: Host: 10.0.0.210 Apr 11 19:42:43 user devstack@n-api.service[72090]: Openstack-System-Scope: None Apr 11 19:42:43 user devstack@n-api.service[72090]: User-Agent: python-urllib3/1.26.15 Apr 11 19:42:43 user devstack@n-api.service[72090]: X-Auth-Token: gAAAAABkNbamEWlRFrwWv3dgLEs24wwjJh6RImsuEnqRMMYvaehCHDJj0nP_-NT6lcQzTNRN2-rvCkdz3Kh93_2xMF7j-J9hIUPHIzHvxjX7ovLyVeIzYKQaz6lr30UdXj3gnUnP0jW8bo1oVaUvQ-Ckrayi2Cm7dk5j52LKM9WVbOq9GgtKYrM Apr 11 19:42:43 user devstack@n-api.service[72090]: X-Domain-Id: None Apr 11 19:42:43 user devstack@n-api.service[72090]: X-Domain-Name: None Apr 11 19:42:43 user devstack@n-api.service[72090]: X-Identity-Status: Confirmed Apr 11 19:42:43 user devstack@n-api.service[72090]: X-Is-Admin-Project: True Apr 11 19:42:43 user devstack@n-api.service[72090]: X-Project-Domain-Id: default Apr 11 19:42:43 user devstack@n-api.service[72090]: X-Project-Domain-Name: Default Apr 11 19:42:43 user devstack@n-api.service[72090]: X-Project-Id: c7b9baa081ca455ea6931b7801c805b8 Apr 11 19:42:43 user devstack@n-api.service[72090]: X-Project-Name: tempest-TestShelveInstance-1694566228 Apr 11 19:42:43 user devstack@n-api.service[72090]: X-Role: reader,member Apr 11 19:42:43 user devstack@n-api.service[72090]: X-Roles: reader,member Apr 11 19:42:43 user devstack@n-api.service[72090]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c7b9baa081ca455ea6931b7801c805b8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/c7b9baa081ca455ea6931b7801c805b8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c7b9baa081ca455ea6931b7801c805b8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 11 19:42:43 user devstack@n-api.service[72090]: X-Tenant: tempest-TestShelveInstance-1694566228 Apr 11 19:42:43 user devstack@n-api.service[72090]: X-Tenant-Id: c7b9baa081ca455ea6931b7801c805b8 Apr 11 19:42:43 user devstack@n-api.service[72090]: X-Tenant-Name: tempest-TestShelveInstance-1694566228 Apr 11 19:42:43 user devstack@n-api.service[72090]: X-User: tempest-TestShelveInstance-1694566228-project-member Apr 11 19:42:43 user devstack@n-api.service[72090]: X-User-Domain-Id: default Apr 11 19:42:43 user devstack@n-api.service[72090]: X-User-Domain-Name: Default Apr 11 19:42:43 user devstack@n-api.service[72090]: X-User-Id: 68fcdcd3af164195bf0c7da3b8dfecb7 Apr 11 19:42:43 user devstack@n-api.service[72090]: X-User-Name: tempest-TestShelveInstance-1694566228-project-member Apr 11 19:42:43 user devstack@n-api.service[72090]: method: > Apr 11 19:42:43 user devstack@n-api.service[72090]: exception: Instance d42dc0ea-4631-44be-8b58-09877280ba2e could not be found. Apr 11 19:42:43 user devstack@n-api.service[72090]: action_args: {'id': 'd42dc0ea-4631-44be-8b58-09877280ba2e'} Apr 11 19:42:43 user devstack@n-api.service[72090]: {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 19:42:43 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:42:43 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 19:42:43 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 19:42:43 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 19:42:43 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 19:42:43 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 19:42:43 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 19:42:43 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 19:42:43 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 19:42:43 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d42dc0ea-4631-44be-8b58-09877280ba2e could not be found. Apr 11 19:42:43 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi Apr 11 19:42:43 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 19:42:43 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi Apr 11 19:42:43 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:42:43 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 19:42:43 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 19:42:43 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 19:42:43 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 19:42:43 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 19:42:43 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 19:42:43 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 19:42:43 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 19:42:43 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 19:42:43 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 19:42:43 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 19:42:43 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 19:42:43 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d42dc0ea-4631-44be-8b58-09877280ba2e could not be found. Apr 11 19:42:43 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi Apr 11 19:42:43 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 19:42:43 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi Apr 11 19:42:43 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:42:43 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 19:42:43 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 19:42:43 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 19:42:43 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 19:42:43 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d42dc0ea-4631-44be-8b58-09877280ba2e could not be found. Apr 11 19:42:43 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi Apr 11 19:42:43 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [None req-2be3f00b-6f1a-4b4d-a9e8-852cb803690d tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] Returning 404 to user: Instance d42dc0ea-4631-44be-8b58-09877280ba2e could not be found. {{(pid=72090) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 19:42:43 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [None req-2be3f00b-6f1a-4b4d-a9e8-852cb803690d tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d42dc0ea-4631-44be-8b58-09877280ba2e" status: 404 len: 111 microversion: 2.1 time: 0.033557 Apr 11 19:42:43 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 299/902] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 19:42:43 2023] GET /compute/v2.1/servers/d42dc0ea-4631-44be-8b58-09877280ba2e => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 11 19:42:43 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [None req-10e38c84-b3d8-41ac-8dce-938da86598eb tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] Calling method '.version_select at 0x7f118c78fa30>' {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:42:43 user devstack@n-api.service[72088]: DEBUG dbcounter [-] [72088] Writing DB stats nova_api:SELECT=20,nova_api:UPDATE=1 {{(pid=72088) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:42:43 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [None req-10e38c84-b3d8-41ac-8dce-938da86598eb tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1765937682" status: 202 len: 0 microversion: 2.1 time: 0.030186 Apr 11 19:42:43 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 296/903] 10.0.0.210 () {62 vars in 1331 bytes} [Tue Apr 11 19:42:43 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1765937682 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 19:42:58 user devstack@n-api.service[72089]: DEBUG dbcounter [-] [72089] Writing DB stats nova_api:SELECT=2 {{(pid=72089) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:42:58 user devstack@n-api.service[72089]: DEBUG dbcounter [-] [72089] Writing DB stats nova_cell1:SELECT=6 {{(pid=72089) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:42:58 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [None req-9bff3b2d-80c1-4ee6-a244-fafc0d442b6e tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Calling method '>' {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:42:58 user devstack@n-api.service[72089]: DEBUG nova.compute.api [None req-9bff3b2d-80c1-4ee6-a244-fafc0d442b6e tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] [instance: 478eb884-ba19-4a4b-b1eb-a2e59d6beef0] Fetching instance by UUID {{(pid=72089) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:42:58 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-9bff3b2d-80c1-4ee6-a244-fafc0d442b6e tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:42:58 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-9bff3b2d-80c1-4ee6-a244-fafc0d442b6e tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:42:58 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-9bff3b2d-80c1-4ee6-a244-fafc0d442b6e tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:42:58 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-9bff3b2d-80c1-4ee6-a244-fafc0d442b6e tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:42:58 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-9bff3b2d-80c1-4ee6-a244-fafc0d442b6e tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:42:58 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-9bff3b2d-80c1-4ee6-a244-fafc0d442b6e tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:42:58 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [None req-9bff3b2d-80c1-4ee6-a244-fafc0d442b6e tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] 10.0.0.210 "GET /compute/v2.1/servers/478eb884-ba19-4a4b-b1eb-a2e59d6beef0/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.268734 Apr 11 19:42:58 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 309/904] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Apr 11 19:42:58 2023] GET /compute/v2.1/servers/478eb884-ba19-4a4b-b1eb-a2e59d6beef0/os-interface => generated 283 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:42:59 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [req-40451d13-a55a-4df7-a7d7-0bb1e0fd1f09 req-3432855d-fd46-41f4-8912-f2d28c2cdfc5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "478eb884-ba19-4a4b-b1eb-a2e59d6beef0", "tag": "91ef79db-4548-423d-9022-b88dd7608438"}]} {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:42:59 user devstack@n-api.service[72090]: DEBUG dbcounter [-] [72090] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=72090) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:42:59 user devstack@n-api.service[72090]: DEBUG dbcounter [-] [72090] Writing DB stats nova_cell1:SELECT=19,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=72090) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:42:59 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-40451d13-a55a-4df7-a7d7-0bb1e0fd1f09 req-3432855d-fd46-41f4-8912-f2d28c2cdfc5 service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:42:59 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-40451d13-a55a-4df7-a7d7-0bb1e0fd1f09 req-3432855d-fd46-41f4-8912-f2d28c2cdfc5 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:42:59 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-40451d13-a55a-4df7-a7d7-0bb1e0fd1f09 req-3432855d-fd46-41f4-8912-f2d28c2cdfc5 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:42:59 user devstack@n-api.service[72090]: INFO nova.api.openstack.compute.server_external_events [req-40451d13-a55a-4df7-a7d7-0bb1e0fd1f09 req-3432855d-fd46-41f4-8912-f2d28c2cdfc5 service nova] Creating event network-changed:91ef79db-4548-423d-9022-b88dd7608438 for instance 478eb884-ba19-4a4b-b1eb-a2e59d6beef0 on user Apr 11 19:42:59 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [req-40451d13-a55a-4df7-a7d7-0bb1e0fd1f09 req-3432855d-fd46-41f4-8912-f2d28c2cdfc5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042692 Apr 11 19:42:59 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 300/905] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:42:59 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:43:00 user devstack@n-api.service[72088]: DEBUG dbcounter [-] [72088] Writing DB stats nova_cell1:SELECT=37,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=72088) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:43:00 user devstack@n-api.service[72088]: DEBUG dbcounter [-] [72088] Writing DB stats nova_api:SELECT=2,nova_api:DELETE=1 {{(pid=72088) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:43:00 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [None req-1957e014-f626-4cc2-b249-91eaff24161f tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Calling method '>' {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:43:00 user devstack@n-api.service[72088]: DEBUG nova.compute.api [None req-1957e014-f626-4cc2-b249-91eaff24161f tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] [instance: bf0a75f5-2f44-4687-af12-046f6761fee2] Fetching instance by UUID {{(pid=72088) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:43:00 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-1957e014-f626-4cc2-b249-91eaff24161f tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:43:00 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-1957e014-f626-4cc2-b249-91eaff24161f tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:43:00 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-1957e014-f626-4cc2-b249-91eaff24161f tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:43:00 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-1957e014-f626-4cc2-b249-91eaff24161f tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:43:00 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-1957e014-f626-4cc2-b249-91eaff24161f tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:43:00 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-1957e014-f626-4cc2-b249-91eaff24161f tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:43:00 user devstack@n-api.service[72088]: DEBUG nova.policy [None req-1957e014-f626-4cc2-b249-91eaff24161f tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba7f82b529e74d99838b6264b94d823b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e3a291c54b49db8e12a88ba41865e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72088) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:43:00 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [None req-1957e014-f626-4cc2-b249-91eaff24161f tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bf0a75f5-2f44-4687-af12-046f6761fee2" status: 200 len: 1719 microversion: 2.1 time: 0.225696 Apr 11 19:43:00 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 297/906] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 19:43:00 2023] GET /compute/v2.1/servers/bf0a75f5-2f44-4687-af12-046f6761fee2 => generated 1719 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:43:01 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [None req-2587da74-19c1-41d6-8b0f-ba0b89303bb1 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-2146974288", "imageRef": "", "flavorRef": "42", "networks": [{"uuid": "8694f053-fd47-47b5-8463-d21b35fbe7ac"}], "security_groups": [{"name": "tempest-securitygroup--641665583"}], "key_name": "tempest-keypair-185807874", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "block_device_mapping_v2": [{"uuid": "8cc8ee09-43bc-4887-ad61-c9f10b5f487d", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:43:01 user devstack@n-api.service[72089]: DEBUG nova.network.neutron [None req-2587da74-19c1-41d6-8b0f-ba0b89303bb1 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] validate_networks() for [('8694f053-fd47-47b5-8463-d21b35fbe7ac', None, None, None, None, None)] {{(pid=72089) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 11 19:43:01 user devstack@n-api.service[72089]: DEBUG nova.virt.hardware [None req-2587da74-19c1-41d6-8b0f-ba0b89303bb1 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Flavor limits 0:0:0 {{(pid=72089) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 19:43:01 user devstack@n-api.service[72089]: DEBUG nova.virt.hardware [None req-2587da74-19c1-41d6-8b0f-ba0b89303bb1 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Image limits 0:0:0 {{(pid=72089) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 19:43:01 user devstack@n-api.service[72089]: DEBUG nova.virt.hardware [None req-2587da74-19c1-41d6-8b0f-ba0b89303bb1 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Flavor pref 0:0:0 {{(pid=72089) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 19:43:01 user devstack@n-api.service[72089]: DEBUG nova.virt.hardware [None req-2587da74-19c1-41d6-8b0f-ba0b89303bb1 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Image pref 0:0:0 {{(pid=72089) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 19:43:01 user devstack@n-api.service[72089]: DEBUG nova.virt.hardware [None req-2587da74-19c1-41d6-8b0f-ba0b89303bb1 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72089) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 19:43:01 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-2587da74-19c1-41d6-8b0f-ba0b89303bb1 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:43:01 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-2587da74-19c1-41d6-8b0f-ba0b89303bb1 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:43:01 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-2587da74-19c1-41d6-8b0f-ba0b89303bb1 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:43:01 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-2587da74-19c1-41d6-8b0f-ba0b89303bb1 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:43:01 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-2587da74-19c1-41d6-8b0f-ba0b89303bb1 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:43:01 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-2587da74-19c1-41d6-8b0f-ba0b89303bb1 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:43:01 user devstack@n-api.service[72089]: DEBUG nova.quota [None req-2587da74-19c1-41d6-8b0f-ba0b89303bb1 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Getting quotas for project 60a7381a31b84e97a068528f90813773. Resources: {'ram', 'instances', 'cores'} {{(pid=72089) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 19:43:01 user devstack@n-api.service[72089]: DEBUG nova.quota [None req-2587da74-19c1-41d6-8b0f-ba0b89303bb1 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Getting quotas for user 05fb551c320a48f98a4ec00a7f7492d7 and project 60a7381a31b84e97a068528f90813773. Resources: {'ram', 'instances', 'cores'} {{(pid=72089) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 19:43:01 user devstack@n-api.service[72089]: DEBUG nova.compute.api [None req-2587da74-19c1-41d6-8b0f-ba0b89303bb1 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Going to run 1 instances... {{(pid=72089) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 11 19:43:01 user devstack@n-api.service[72089]: DEBUG nova.compute.api [None req-2587da74-19c1-41d6-8b0f-ba0b89303bb1 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] [instance: f633037d-87d0-4dda-aa33-3cc9c3191080] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='8cc8ee09-43bc-4887-ad61-c9f10b5f487d',volume_size=None,volume_type=None)] {{(pid=72089) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 11 19:43:01 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [None req-2587da74-19c1-41d6-8b0f-ba0b89303bb1 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 0.735084 Apr 11 19:43:01 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 310/907] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 11 19:43:01 2023] POST /compute/v2.1/servers => generated 403 bytes in 737 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 11 19:43:01 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [None req-c4fca276-eafd-4b6d-bd92-06b5f6b11a23 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Calling method '>' {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:43:01 user devstack@n-api.service[72090]: DEBUG nova.compute.api [None req-c4fca276-eafd-4b6d-bd92-06b5f6b11a23 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] [instance: f633037d-87d0-4dda-aa33-3cc9c3191080] Fetching instance by UUID {{(pid=72090) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:43:01 user devstack@n-api.service[72090]: DEBUG nova.policy [None req-c4fca276-eafd-4b6d-bd92-06b5f6b11a23 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05fb551c320a48f98a4ec00a7f7492d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60a7381a31b84e97a068528f90813773', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72090) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:43:01 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [None req-c4fca276-eafd-4b6d-bd92-06b5f6b11a23 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f633037d-87d0-4dda-aa33-3cc9c3191080" status: 200 len: 1075 microversion: 2.1 time: 0.181922 Apr 11 19:43:01 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 301/908] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 19:43:01 2023] GET /compute/v2.1/servers/f633037d-87d0-4dda-aa33-3cc9c3191080 => generated 1075 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:43:04 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [req-f48ca453-fb56-4b98-a76d-677f2046a123 req-d50f86eb-1876-46e5-b313-9ed56b553946 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f633037d-87d0-4dda-aa33-3cc9c3191080", "tag": "c3ef7018-189c-423e-b92b-b2b4a98dafce"}]} {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:43:04 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-f48ca453-fb56-4b98-a76d-677f2046a123 req-d50f86eb-1876-46e5-b313-9ed56b553946 service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:43:04 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-f48ca453-fb56-4b98-a76d-677f2046a123 req-d50f86eb-1876-46e5-b313-9ed56b553946 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:43:04 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-f48ca453-fb56-4b98-a76d-677f2046a123 req-d50f86eb-1876-46e5-b313-9ed56b553946 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:43:04 user devstack@n-api.service[72088]: INFO nova.api.openstack.compute.server_external_events [req-f48ca453-fb56-4b98-a76d-677f2046a123 req-d50f86eb-1876-46e5-b313-9ed56b553946 service nova] Creating event network-changed:c3ef7018-189c-423e-b92b-b2b4a98dafce for instance f633037d-87d0-4dda-aa33-3cc9c3191080 on user Apr 11 19:43:04 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [req-f48ca453-fb56-4b98-a76d-677f2046a123 req-d50f86eb-1876-46e5-b313-9ed56b553946 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053860 Apr 11 19:43:04 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 298/909] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:43:04 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:43:10 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [req-ce1ea699-f8d2-4816-84b3-2dffc075d329 req-9c2a96c8-39b5-4b1e-b1cd-a5094dc55755 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f633037d-87d0-4dda-aa33-3cc9c3191080", "name": "network-vif-plugged", "status": "completed", "tag": "c3ef7018-189c-423e-b92b-b2b4a98dafce"}]} {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:43:10 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-ce1ea699-f8d2-4816-84b3-2dffc075d329 req-9c2a96c8-39b5-4b1e-b1cd-a5094dc55755 service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:43:10 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-ce1ea699-f8d2-4816-84b3-2dffc075d329 req-9c2a96c8-39b5-4b1e-b1cd-a5094dc55755 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:43:10 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-ce1ea699-f8d2-4816-84b3-2dffc075d329 req-9c2a96c8-39b5-4b1e-b1cd-a5094dc55755 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:43:10 user devstack@n-api.service[72089]: INFO nova.api.openstack.compute.server_external_events [req-ce1ea699-f8d2-4816-84b3-2dffc075d329 req-9c2a96c8-39b5-4b1e-b1cd-a5094dc55755 service nova] Creating event network-vif-plugged:c3ef7018-189c-423e-b92b-b2b4a98dafce for instance f633037d-87d0-4dda-aa33-3cc9c3191080 on user Apr 11 19:43:10 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [req-ce1ea699-f8d2-4816-84b3-2dffc075d329 req-9c2a96c8-39b5-4b1e-b1cd-a5094dc55755 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035315 Apr 11 19:43:10 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 311/910] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:43:10 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:43:11 user devstack@n-api.service[72090]: DEBUG dbcounter [-] [72090] Writing DB stats nova_cell1:SELECT=2 {{(pid=72090) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:43:11 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [None req-81415651-9633-4782-abfe-9baa77cf703c tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Calling method '>' {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:43:11 user devstack@n-api.service[72090]: DEBUG nova.compute.api [None req-81415651-9633-4782-abfe-9baa77cf703c tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] [instance: 0a59d114-20ac-448e-a95a-d3501c914833] Fetching instance by UUID {{(pid=72090) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:43:11 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-81415651-9633-4782-abfe-9baa77cf703c tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:43:11 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-81415651-9633-4782-abfe-9baa77cf703c tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:43:11 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-81415651-9633-4782-abfe-9baa77cf703c tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:43:11 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-81415651-9633-4782-abfe-9baa77cf703c tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:43:11 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-81415651-9633-4782-abfe-9baa77cf703c tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:43:11 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-81415651-9633-4782-abfe-9baa77cf703c tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:43:11 user devstack@n-api.service[72090]: INFO nova.api.openstack.wsgi [None req-81415651-9633-4782-abfe-9baa77cf703c tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] HTTP exception thrown: Instance 0a59d114-20ac-448e-a95a-d3501c914833 could not be found. Apr 11 19:43:11 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [None req-81415651-9633-4782-abfe-9baa77cf703c tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Request method failure captured: Apr 11 19:43:11 user devstack@n-api.service[72090]: request: GET /compute/v2.1/servers/0a59d114-20ac-448e-a95a-d3501c914833 HTTP/1.1 Apr 11 19:43:11 user devstack@n-api.service[72090]: Accept: application/json Apr 11 19:43:11 user devstack@n-api.service[72090]: Accept-Encoding: identity Apr 11 19:43:11 user devstack@n-api.service[72090]: Connection: close Apr 11 19:43:11 user devstack@n-api.service[72090]: Content-Length: 0 Apr 11 19:43:11 user devstack@n-api.service[72090]: Content-Type: application/json Apr 11 19:43:11 user devstack@n-api.service[72090]: Host: 10.0.0.210 Apr 11 19:43:11 user devstack@n-api.service[72090]: Openstack-System-Scope: None Apr 11 19:43:11 user devstack@n-api.service[72090]: User-Agent: python-urllib3/1.26.15 Apr 11 19:43:11 user devstack@n-api.service[72090]: X-Auth-Token: gAAAAABkNbWuPL7tpG6O55jvFSGO371AELCQlFZHf6FrRxh7vClaI6XXjuETFNQG4Gook2-ws7z2jCWcd2rLpcqQWtWmqjJ0M2xKefxUzDSsHikQ381w5ena7_2Zjp6vyHkrh7PG-gVY2vEL8dYAJIJ3D9B2mOuFBAai8zWGdpQnauKzi-Qcl_M Apr 11 19:43:11 user devstack@n-api.service[72090]: X-Domain-Id: None Apr 11 19:43:11 user devstack@n-api.service[72090]: X-Domain-Name: None Apr 11 19:43:11 user devstack@n-api.service[72090]: X-Identity-Status: Confirmed Apr 11 19:43:11 user devstack@n-api.service[72090]: X-Is-Admin-Project: True Apr 11 19:43:11 user devstack@n-api.service[72090]: X-Project-Domain-Id: default Apr 11 19:43:11 user devstack@n-api.service[72090]: X-Project-Domain-Name: Default Apr 11 19:43:11 user devstack@n-api.service[72090]: X-Project-Id: 2caba0618fc743e7bfb2dd866a511df9 Apr 11 19:43:11 user devstack@n-api.service[72090]: X-Project-Name: tempest-TestVolumeBootPattern-935343500 Apr 11 19:43:11 user devstack@n-api.service[72090]: X-Role: reader,member Apr 11 19:43:11 user devstack@n-api.service[72090]: X-Roles: reader,member Apr 11 19:43:11 user devstack@n-api.service[72090]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2caba0618fc743e7bfb2dd866a511df9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/2caba0618fc743e7bfb2dd866a511df9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2caba0618fc743e7bfb2dd866a511df9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 11 19:43:11 user devstack@n-api.service[72090]: X-Tenant: tempest-TestVolumeBootPattern-935343500 Apr 11 19:43:11 user devstack@n-api.service[72090]: X-Tenant-Id: 2caba0618fc743e7bfb2dd866a511df9 Apr 11 19:43:11 user devstack@n-api.service[72090]: X-Tenant-Name: tempest-TestVolumeBootPattern-935343500 Apr 11 19:43:11 user devstack@n-api.service[72090]: X-User: tempest-TestVolumeBootPattern-935343500-project-member Apr 11 19:43:11 user devstack@n-api.service[72090]: X-User-Domain-Id: default Apr 11 19:43:11 user devstack@n-api.service[72090]: X-User-Domain-Name: Default Apr 11 19:43:11 user devstack@n-api.service[72090]: X-User-Id: cf262cd03f4a41c4956d8784cf37d86d Apr 11 19:43:11 user devstack@n-api.service[72090]: X-User-Name: tempest-TestVolumeBootPattern-935343500-project-member Apr 11 19:43:11 user devstack@n-api.service[72090]: method: > Apr 11 19:43:11 user devstack@n-api.service[72090]: exception: Instance 0a59d114-20ac-448e-a95a-d3501c914833 could not be found. Apr 11 19:43:11 user devstack@n-api.service[72090]: action_args: {'id': '0a59d114-20ac-448e-a95a-d3501c914833'} Apr 11 19:43:11 user devstack@n-api.service[72090]: {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 19:43:11 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:43:11 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 19:43:11 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 19:43:11 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 19:43:11 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 19:43:11 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 19:43:11 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 19:43:11 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 19:43:11 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 19:43:11 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0a59d114-20ac-448e-a95a-d3501c914833 could not be found. Apr 11 19:43:11 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi Apr 11 19:43:11 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 19:43:11 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi Apr 11 19:43:11 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:43:11 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 19:43:11 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 19:43:11 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 19:43:11 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 19:43:11 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 19:43:11 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 19:43:11 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 19:43:11 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 19:43:11 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 19:43:11 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 19:43:11 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 19:43:11 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 19:43:11 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0a59d114-20ac-448e-a95a-d3501c914833 could not be found. Apr 11 19:43:11 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi Apr 11 19:43:11 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 19:43:11 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi Apr 11 19:43:11 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:43:11 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 19:43:11 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 19:43:11 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 19:43:11 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 19:43:11 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0a59d114-20ac-448e-a95a-d3501c914833 could not be found. Apr 11 19:43:11 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi Apr 11 19:43:11 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [None req-81415651-9633-4782-abfe-9baa77cf703c tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Returning 404 to user: Instance 0a59d114-20ac-448e-a95a-d3501c914833 could not be found. {{(pid=72090) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 19:43:11 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [None req-81415651-9633-4782-abfe-9baa77cf703c tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0a59d114-20ac-448e-a95a-d3501c914833" status: 404 len: 111 microversion: 2.1 time: 0.320260 Apr 11 19:43:11 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 302/911] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 19:43:11 2023] GET /compute/v2.1/servers/0a59d114-20ac-448e-a95a-d3501c914833 => generated 111 bytes in 322 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 19:43:11 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [None req-a704a3a5-f1d3-4b59-a1f6-c616c0bc2011 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-189754775", "imageRef": "", "flavorRef": "42", "key_name": "tempest-TestVolumeBootPattern-1844027973", "security_groups": [{"name": "tempest-secgroup-smoke-49720192"}], "block_device_mapping_v2": [{"uuid": "af3920bc-0034-4875-be3a-b25fe27ee037", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "f22e45e9-cc15-401e-aed7-3506278d3d0d"}]}} {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:43:11 user devstack@n-api.service[72088]: DEBUG nova.network.neutron [None req-a704a3a5-f1d3-4b59-a1f6-c616c0bc2011 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] validate_networks() for [('f22e45e9-cc15-401e-aed7-3506278d3d0d', None, None, None, None, None)] {{(pid=72088) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 11 19:43:12 user devstack@n-api.service[72089]: DEBUG dbcounter [-] [72089] Writing DB stats nova_cell0:SELECT=2 {{(pid=72089) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:43:12 user devstack@n-api.service[72089]: DEBUG dbcounter [-] [72089] Writing DB stats nova_cell0:SELECT=6 {{(pid=72089) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:43:12 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [req-b656ce58-630f-476b-a9cc-e253b380c522 req-69e7c141-3c9a-4ade-8ee2-22d538f234ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f633037d-87d0-4dda-aa33-3cc9c3191080", "name": "network-vif-plugged", "status": "completed", "tag": "c3ef7018-189c-423e-b92b-b2b4a98dafce"}]} {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:43:12 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-b656ce58-630f-476b-a9cc-e253b380c522 req-69e7c141-3c9a-4ade-8ee2-22d538f234ac service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:43:12 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-b656ce58-630f-476b-a9cc-e253b380c522 req-69e7c141-3c9a-4ade-8ee2-22d538f234ac service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:43:12 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-b656ce58-630f-476b-a9cc-e253b380c522 req-69e7c141-3c9a-4ade-8ee2-22d538f234ac service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:43:12 user devstack@n-api.service[72089]: INFO nova.api.openstack.compute.server_external_events [req-b656ce58-630f-476b-a9cc-e253b380c522 req-69e7c141-3c9a-4ade-8ee2-22d538f234ac service nova] Creating event network-vif-plugged:c3ef7018-189c-423e-b92b-b2b4a98dafce for instance f633037d-87d0-4dda-aa33-3cc9c3191080 on user Apr 11 19:43:12 user devstack@n-api.service[72088]: DEBUG nova.virt.hardware [None req-a704a3a5-f1d3-4b59-a1f6-c616c0bc2011 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Flavor limits 0:0:0 {{(pid=72088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 19:43:12 user devstack@n-api.service[72088]: DEBUG nova.virt.hardware [None req-a704a3a5-f1d3-4b59-a1f6-c616c0bc2011 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Image limits 0:0:0 {{(pid=72088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 19:43:12 user devstack@n-api.service[72088]: DEBUG nova.virt.hardware [None req-a704a3a5-f1d3-4b59-a1f6-c616c0bc2011 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Flavor pref 0:0:0 {{(pid=72088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 19:43:12 user devstack@n-api.service[72088]: DEBUG nova.virt.hardware [None req-a704a3a5-f1d3-4b59-a1f6-c616c0bc2011 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Image pref 0:0:0 {{(pid=72088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 19:43:12 user devstack@n-api.service[72088]: DEBUG nova.virt.hardware [None req-a704a3a5-f1d3-4b59-a1f6-c616c0bc2011 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 19:43:12 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [req-b656ce58-630f-476b-a9cc-e253b380c522 req-69e7c141-3c9a-4ade-8ee2-22d538f234ac service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050516 Apr 11 19:43:12 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 312/912] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:43:12 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:43:12 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-a704a3a5-f1d3-4b59-a1f6-c616c0bc2011 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:43:12 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-a704a3a5-f1d3-4b59-a1f6-c616c0bc2011 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:43:12 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-a704a3a5-f1d3-4b59-a1f6-c616c0bc2011 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:43:12 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-a704a3a5-f1d3-4b59-a1f6-c616c0bc2011 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:43:12 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-a704a3a5-f1d3-4b59-a1f6-c616c0bc2011 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:43:12 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-a704a3a5-f1d3-4b59-a1f6-c616c0bc2011 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:43:12 user devstack@n-api.service[72088]: DEBUG nova.quota [None req-a704a3a5-f1d3-4b59-a1f6-c616c0bc2011 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Getting quotas for project 2caba0618fc743e7bfb2dd866a511df9. Resources: {'ram', 'instances', 'cores'} {{(pid=72088) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 19:43:12 user devstack@n-api.service[72088]: DEBUG nova.quota [None req-a704a3a5-f1d3-4b59-a1f6-c616c0bc2011 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Getting quotas for user cf262cd03f4a41c4956d8784cf37d86d and project 2caba0618fc743e7bfb2dd866a511df9. Resources: {'ram', 'instances', 'cores'} {{(pid=72088) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 19:43:12 user devstack@n-api.service[72088]: DEBUG nova.compute.api [None req-a704a3a5-f1d3-4b59-a1f6-c616c0bc2011 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Going to run 1 instances... {{(pid=72088) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 11 19:43:12 user devstack@n-api.service[72088]: DEBUG nova.compute.api [None req-a704a3a5-f1d3-4b59-a1f6-c616c0bc2011 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] [instance: a66c1d51-e194-424d-a37c-d308544774c6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='af3920bc-0034-4875-be3a-b25fe27ee037',volume_size=None,volume_type=None)] {{(pid=72088) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 11 19:43:12 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [None req-a704a3a5-f1d3-4b59-a1f6-c616c0bc2011 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.800776 Apr 11 19:43:12 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 299/913] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 11 19:43:11 2023] POST /compute/v2.1/servers => generated 402 bytes in 803 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 11 19:43:12 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [None req-af77b63b-4988-4a23-b4f4-2b687b8a8dc9 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Calling method '>' {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:43:12 user devstack@n-api.service[72090]: DEBUG nova.compute.api [None req-af77b63b-4988-4a23-b4f4-2b687b8a8dc9 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] [instance: a66c1d51-e194-424d-a37c-d308544774c6] Fetching instance by UUID {{(pid=72090) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:43:12 user devstack@n-api.service[72090]: DEBUG dbcounter [-] [72090] Writing DB stats nova_cell0:SELECT=2 {{(pid=72090) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:43:12 user devstack@n-api.service[72090]: DEBUG nova.policy [None req-af77b63b-4988-4a23-b4f4-2b687b8a8dc9 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf262cd03f4a41c4956d8784cf37d86d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caba0618fc743e7bfb2dd866a511df9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72090) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:43:12 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [None req-af77b63b-4988-4a23-b4f4-2b687b8a8dc9 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a66c1d51-e194-424d-a37c-d308544774c6" status: 200 len: 1089 microversion: 2.1 time: 0.068994 Apr 11 19:43:12 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 303/914] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 19:43:12 2023] GET /compute/v2.1/servers/a66c1d51-e194-424d-a37c-d308544774c6 => generated 1089 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:43:15 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [req-3412b735-5f1e-40a3-b907-e08ca6dfdbd2 req-8b392c64-405a-4fd2-a53b-3a58249c3100 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a66c1d51-e194-424d-a37c-d308544774c6", "tag": "397ebb82-45b3-41ad-bbac-ef07140bf942"}]} {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:43:15 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-3412b735-5f1e-40a3-b907-e08ca6dfdbd2 req-8b392c64-405a-4fd2-a53b-3a58249c3100 service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:43:15 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-3412b735-5f1e-40a3-b907-e08ca6dfdbd2 req-8b392c64-405a-4fd2-a53b-3a58249c3100 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:43:15 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-3412b735-5f1e-40a3-b907-e08ca6dfdbd2 req-8b392c64-405a-4fd2-a53b-3a58249c3100 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:43:15 user devstack@n-api.service[72089]: INFO nova.api.openstack.compute.server_external_events [req-3412b735-5f1e-40a3-b907-e08ca6dfdbd2 req-8b392c64-405a-4fd2-a53b-3a58249c3100 service nova] Creating event network-changed:397ebb82-45b3-41ad-bbac-ef07140bf942 for instance a66c1d51-e194-424d-a37c-d308544774c6 on user Apr 11 19:43:15 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [req-3412b735-5f1e-40a3-b907-e08ca6dfdbd2 req-8b392c64-405a-4fd2-a53b-3a58249c3100 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043405 Apr 11 19:43:15 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 313/915] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:43:15 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:43:21 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [req-bdee2580-d295-4777-817b-9e5e1892b98a req-f1e08a7b-4fd3-45a1-aa57-05d6a872651d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a66c1d51-e194-424d-a37c-d308544774c6", "name": "network-vif-plugged", "status": "completed", "tag": "397ebb82-45b3-41ad-bbac-ef07140bf942"}]} {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:43:21 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-bdee2580-d295-4777-817b-9e5e1892b98a req-f1e08a7b-4fd3-45a1-aa57-05d6a872651d service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:43:21 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-bdee2580-d295-4777-817b-9e5e1892b98a req-f1e08a7b-4fd3-45a1-aa57-05d6a872651d service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:43:21 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-bdee2580-d295-4777-817b-9e5e1892b98a req-f1e08a7b-4fd3-45a1-aa57-05d6a872651d service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:43:21 user devstack@n-api.service[72088]: INFO nova.api.openstack.compute.server_external_events [req-bdee2580-d295-4777-817b-9e5e1892b98a req-f1e08a7b-4fd3-45a1-aa57-05d6a872651d service nova] Creating event network-vif-plugged:397ebb82-45b3-41ad-bbac-ef07140bf942 for instance a66c1d51-e194-424d-a37c-d308544774c6 on user Apr 11 19:43:21 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [req-bdee2580-d295-4777-817b-9e5e1892b98a req-f1e08a7b-4fd3-45a1-aa57-05d6a872651d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065108 Apr 11 19:43:21 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 300/916] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:43:21 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:43:22 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [None req-23763d2b-65b1-48bc-bd90-653aeddafe05 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Calling method '>' {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:43:22 user devstack@n-api.service[72090]: DEBUG nova.compute.api [None req-23763d2b-65b1-48bc-bd90-653aeddafe05 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] [instance: 8c45de50-92bc-467c-9f3d-7e667e1d0bb3] Fetching instance by UUID {{(pid=72090) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:43:22 user devstack@n-api.service[72090]: DEBUG dbcounter [-] [72090] Writing DB stats nova_cell1:SELECT=2 {{(pid=72090) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:43:22 user devstack@n-api.service[72090]: DEBUG dbcounter [-] [72090] Writing DB stats nova_api:SELECT=12 {{(pid=72090) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:43:22 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-23763d2b-65b1-48bc-bd90-653aeddafe05 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:43:22 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-23763d2b-65b1-48bc-bd90-653aeddafe05 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:43:22 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-23763d2b-65b1-48bc-bd90-653aeddafe05 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:43:22 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-23763d2b-65b1-48bc-bd90-653aeddafe05 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:43:22 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-23763d2b-65b1-48bc-bd90-653aeddafe05 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:43:22 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-23763d2b-65b1-48bc-bd90-653aeddafe05 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:43:22 user devstack@n-api.service[72090]: INFO nova.api.openstack.wsgi [None req-23763d2b-65b1-48bc-bd90-653aeddafe05 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] HTTP exception thrown: Instance 8c45de50-92bc-467c-9f3d-7e667e1d0bb3 could not be found. Apr 11 19:43:22 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [None req-23763d2b-65b1-48bc-bd90-653aeddafe05 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Request method failure captured: Apr 11 19:43:22 user devstack@n-api.service[72090]: request: GET /compute/v2.1/servers/8c45de50-92bc-467c-9f3d-7e667e1d0bb3 HTTP/1.1 Apr 11 19:43:22 user devstack@n-api.service[72090]: Accept: application/json Apr 11 19:43:22 user devstack@n-api.service[72090]: Accept-Encoding: identity Apr 11 19:43:22 user devstack@n-api.service[72090]: Connection: close Apr 11 19:43:22 user devstack@n-api.service[72090]: Content-Length: 0 Apr 11 19:43:22 user devstack@n-api.service[72090]: Content-Type: application/json Apr 11 19:43:22 user devstack@n-api.service[72090]: Host: 10.0.0.210 Apr 11 19:43:22 user devstack@n-api.service[72090]: Openstack-System-Scope: None Apr 11 19:43:22 user devstack@n-api.service[72090]: User-Agent: python-urllib3/1.26.15 Apr 11 19:43:22 user devstack@n-api.service[72090]: X-Auth-Token: gAAAAABkNbQnEMwb9bokVGqy8IBkwGOZTlbefW9-gCGma1Q9aMCf7rErAs3NuXcPCnuWAMFMb4o5vJ-bB4xPFTn6y2WKU9I0pItmZHu7i_RppKkEiULwNqNywUZ2M-d73QMTy5dW3-OZVF1Bf-qwJagrp481OxGYQGqOEgWnBHPks1h4PLepPQA Apr 11 19:43:22 user devstack@n-api.service[72090]: X-Domain-Id: None Apr 11 19:43:22 user devstack@n-api.service[72090]: X-Domain-Name: None Apr 11 19:43:22 user devstack@n-api.service[72090]: X-Identity-Status: Confirmed Apr 11 19:43:22 user devstack@n-api.service[72090]: X-Is-Admin-Project: True Apr 11 19:43:22 user devstack@n-api.service[72090]: X-Openstack-Nova-Api-Version: 2.87 Apr 11 19:43:22 user devstack@n-api.service[72090]: X-Project-Domain-Id: default Apr 11 19:43:22 user devstack@n-api.service[72090]: X-Project-Domain-Name: Default Apr 11 19:43:22 user devstack@n-api.service[72090]: X-Project-Id: eb91586feb3f4a4c84fa8c2183baaf8c Apr 11 19:43:22 user devstack@n-api.service[72090]: X-Project-Name: tempest-ServerBootFromVolumeStableRescueTest-863156619 Apr 11 19:43:22 user devstack@n-api.service[72090]: X-Role: reader,member Apr 11 19:43:22 user devstack@n-api.service[72090]: X-Roles: reader,member Apr 11 19:43:22 user devstack@n-api.service[72090]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/eb91586feb3f4a4c84fa8c2183baaf8c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/eb91586feb3f4a4c84fa8c2183baaf8c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/eb91586feb3f4a4c84fa8c2183baaf8c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 11 19:43:22 user devstack@n-api.service[72090]: X-Tenant: tempest-ServerBootFromVolumeStableRescueTest-863156619 Apr 11 19:43:22 user devstack@n-api.service[72090]: X-Tenant-Id: eb91586feb3f4a4c84fa8c2183baaf8c Apr 11 19:43:22 user devstack@n-api.service[72090]: X-Tenant-Name: tempest-ServerBootFromVolumeStableRescueTest-863156619 Apr 11 19:43:22 user devstack@n-api.service[72090]: X-User: tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member Apr 11 19:43:22 user devstack@n-api.service[72090]: X-User-Domain-Id: default Apr 11 19:43:22 user devstack@n-api.service[72090]: X-User-Domain-Name: Default Apr 11 19:43:22 user devstack@n-api.service[72090]: X-User-Id: 1b3adca432b04d70818a51d1366f5c6d Apr 11 19:43:22 user devstack@n-api.service[72090]: X-User-Name: tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member Apr 11 19:43:22 user devstack@n-api.service[72090]: method: > Apr 11 19:43:22 user devstack@n-api.service[72090]: exception: Instance 8c45de50-92bc-467c-9f3d-7e667e1d0bb3 could not be found. Apr 11 19:43:22 user devstack@n-api.service[72090]: action_args: {'id': '8c45de50-92bc-467c-9f3d-7e667e1d0bb3'} Apr 11 19:43:22 user devstack@n-api.service[72090]: {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 19:43:22 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:43:22 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 19:43:22 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 19:43:22 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 19:43:22 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 19:43:22 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 19:43:22 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 19:43:22 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 19:43:22 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 19:43:22 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8c45de50-92bc-467c-9f3d-7e667e1d0bb3 could not be found. Apr 11 19:43:22 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi Apr 11 19:43:22 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 19:43:22 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi Apr 11 19:43:22 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:43:22 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 19:43:22 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 19:43:22 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 19:43:22 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 19:43:22 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 19:43:22 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 19:43:22 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 19:43:22 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 19:43:22 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 19:43:22 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 19:43:22 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 19:43:22 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 19:43:22 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8c45de50-92bc-467c-9f3d-7e667e1d0bb3 could not be found. Apr 11 19:43:22 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi Apr 11 19:43:22 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 19:43:22 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi Apr 11 19:43:22 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:43:22 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 19:43:22 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 19:43:22 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 19:43:22 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 19:43:22 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8c45de50-92bc-467c-9f3d-7e667e1d0bb3 could not be found. Apr 11 19:43:22 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi Apr 11 19:43:22 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [None req-23763d2b-65b1-48bc-bd90-653aeddafe05 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Returning 404 to user: Instance 8c45de50-92bc-467c-9f3d-7e667e1d0bb3 could not be found. {{(pid=72090) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 19:43:22 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [None req-23763d2b-65b1-48bc-bd90-653aeddafe05 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8c45de50-92bc-467c-9f3d-7e667e1d0bb3" status: 404 len: 111 microversion: 2.87 time: 0.039232 Apr 11 19:43:22 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 304/917] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 19:43:22 2023] GET /compute/v2.1/servers/8c45de50-92bc-467c-9f3d-7e667e1d0bb3 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 11 19:43:22 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [None req-b6808995-7d91-4ecf-af18-ebb1b443f274 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Calling method '>' {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:43:22 user devstack@n-api.service[72089]: DEBUG nova.compute.api [None req-b6808995-7d91-4ecf-af18-ebb1b443f274 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] [instance: b079367a-558e-4920-ad8d-972a8065260c] Fetching instance by UUID {{(pid=72089) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:43:22 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-b6808995-7d91-4ecf-af18-ebb1b443f274 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:43:22 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-b6808995-7d91-4ecf-af18-ebb1b443f274 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:43:22 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-b6808995-7d91-4ecf-af18-ebb1b443f274 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:43:22 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-b6808995-7d91-4ecf-af18-ebb1b443f274 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:43:22 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-b6808995-7d91-4ecf-af18-ebb1b443f274 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:43:22 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-b6808995-7d91-4ecf-af18-ebb1b443f274 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:43:22 user devstack@n-api.service[72089]: DEBUG nova.compute.api [None req-b6808995-7d91-4ecf-af18-ebb1b443f274 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] [instance: b079367a-558e-4920-ad8d-972a8065260c] Going to try to terminate instance {{(pid=72089) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 11 19:43:23 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [None req-b6808995-7d91-4ecf-af18-ebb1b443f274 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/b079367a-558e-4920-ad8d-972a8065260c" status: 204 len: 0 microversion: 2.87 time: 0.151024 Apr 11 19:43:23 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 314/918] 10.0.0.210 () {64 vars in 1357 bytes} [Tue Apr 11 19:43:22 2023] DELETE /compute/v2.1/servers/b079367a-558e-4920-ad8d-972a8065260c => generated 0 bytes in 153 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 11 19:43:23 user devstack@n-api.service[72088]: DEBUG dbcounter [-] [72088] Writing DB stats nova_cell0:SELECT=2 {{(pid=72088) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:43:23 user devstack@n-api.service[72088]: DEBUG dbcounter [-] [72088] Writing DB stats nova_cell0:SELECT=6 {{(pid=72088) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:43:23 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [None req-f467dac0-a25d-4d35-bf35-312afee73806 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Calling method '>' {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:43:23 user devstack@n-api.service[72088]: DEBUG nova.compute.api [None req-f467dac0-a25d-4d35-bf35-312afee73806 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] [instance: b079367a-558e-4920-ad8d-972a8065260c] Fetching instance by UUID {{(pid=72088) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:43:23 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-f467dac0-a25d-4d35-bf35-312afee73806 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:43:23 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-f467dac0-a25d-4d35-bf35-312afee73806 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:43:23 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-f467dac0-a25d-4d35-bf35-312afee73806 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:43:23 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-f467dac0-a25d-4d35-bf35-312afee73806 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:43:23 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-f467dac0-a25d-4d35-bf35-312afee73806 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:43:23 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-f467dac0-a25d-4d35-bf35-312afee73806 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:43:23 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [req-0e859726-02df-4f59-9b94-2a42d3313a9a req-ad5708d0-25ec-404a-a3db-b70b83c7ce4b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a66c1d51-e194-424d-a37c-d308544774c6", "name": "network-vif-plugged", "status": "completed", "tag": "397ebb82-45b3-41ad-bbac-ef07140bf942"}]} {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:43:23 user devstack@n-api.service[72090]: DEBUG dbcounter [-] [72090] Writing DB stats nova_cell0:SELECT=2 {{(pid=72090) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:43:23 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-0e859726-02df-4f59-9b94-2a42d3313a9a req-ad5708d0-25ec-404a-a3db-b70b83c7ce4b service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:43:23 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-0e859726-02df-4f59-9b94-2a42d3313a9a req-ad5708d0-25ec-404a-a3db-b70b83c7ce4b service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:43:23 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-0e859726-02df-4f59-9b94-2a42d3313a9a req-ad5708d0-25ec-404a-a3db-b70b83c7ce4b service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:43:23 user devstack@n-api.service[72090]: INFO nova.api.openstack.compute.server_external_events [req-0e859726-02df-4f59-9b94-2a42d3313a9a req-ad5708d0-25ec-404a-a3db-b70b83c7ce4b service nova] Creating event network-vif-plugged:397ebb82-45b3-41ad-bbac-ef07140bf942 for instance a66c1d51-e194-424d-a37c-d308544774c6 on user Apr 11 19:43:23 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [req-0e859726-02df-4f59-9b94-2a42d3313a9a req-ad5708d0-25ec-404a-a3db-b70b83c7ce4b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051746 Apr 11 19:43:23 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 305/919] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:43:23 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 11 19:43:23 user devstack@n-api.service[72088]: DEBUG nova.policy [None req-f467dac0-a25d-4d35-bf35-312afee73806 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b3adca432b04d70818a51d1366f5c6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb91586feb3f4a4c84fa8c2183baaf8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72088) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:43:23 user devstack@n-api.service[72088]: DEBUG nova.policy [None req-f467dac0-a25d-4d35-bf35-312afee73806 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b3adca432b04d70818a51d1366f5c6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb91586feb3f4a4c84fa8c2183baaf8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72088) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:43:23 user devstack@n-api.service[72088]: DEBUG nova.policy [None req-f467dac0-a25d-4d35-bf35-312afee73806 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b3adca432b04d70818a51d1366f5c6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb91586feb3f4a4c84fa8c2183baaf8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72088) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:43:23 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [None req-f467dac0-a25d-4d35-bf35-312afee73806 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b079367a-558e-4920-ad8d-972a8065260c" status: 200 len: 1696 microversion: 2.87 time: 0.264932 Apr 11 19:43:23 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 301/920] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 19:43:23 2023] GET /compute/v2.1/servers/b079367a-558e-4920-ad8d-972a8065260c => generated 1696 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 19:43:23 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [req-ce56e9c8-0641-472a-a637-bad38a8baa1e req-4976c9d4-da48-4762-8de0-b86487cd572f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b079367a-558e-4920-ad8d-972a8065260c", "name": "network-vif-unplugged", "status": "completed", "tag": "54168103-37cf-4abe-a4e5-bac3eeeca578"}]} {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:43:23 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-ce56e9c8-0641-472a-a637-bad38a8baa1e req-4976c9d4-da48-4762-8de0-b86487cd572f service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:43:23 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-ce56e9c8-0641-472a-a637-bad38a8baa1e req-4976c9d4-da48-4762-8de0-b86487cd572f service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:43:23 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-ce56e9c8-0641-472a-a637-bad38a8baa1e req-4976c9d4-da48-4762-8de0-b86487cd572f service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:43:23 user devstack@n-api.service[72089]: INFO nova.api.openstack.compute.server_external_events [req-ce56e9c8-0641-472a-a637-bad38a8baa1e req-4976c9d4-da48-4762-8de0-b86487cd572f service nova] Creating event network-vif-unplugged:54168103-37cf-4abe-a4e5-bac3eeeca578 for instance b079367a-558e-4920-ad8d-972a8065260c on user Apr 11 19:43:23 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [req-ce56e9c8-0641-472a-a637-bad38a8baa1e req-4976c9d4-da48-4762-8de0-b86487cd572f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.072114 Apr 11 19:43:23 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 315/921] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:43:23 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:43:25 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [req-a4f461d1-b220-4907-a1e5-65955eac9408 req-8fb4c0bf-4c0d-4d77-8144-eb7492a23fa6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b079367a-558e-4920-ad8d-972a8065260c", "name": "network-vif-deleted", "tag": "54168103-37cf-4abe-a4e5-bac3eeeca578"}]} {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:43:25 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-a4f461d1-b220-4907-a1e5-65955eac9408 req-8fb4c0bf-4c0d-4d77-8144-eb7492a23fa6 service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:43:25 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-a4f461d1-b220-4907-a1e5-65955eac9408 req-8fb4c0bf-4c0d-4d77-8144-eb7492a23fa6 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:43:25 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-a4f461d1-b220-4907-a1e5-65955eac9408 req-8fb4c0bf-4c0d-4d77-8144-eb7492a23fa6 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:43:25 user devstack@n-api.service[72090]: INFO nova.api.openstack.compute.server_external_events [req-a4f461d1-b220-4907-a1e5-65955eac9408 req-8fb4c0bf-4c0d-4d77-8144-eb7492a23fa6 service nova] Creating event network-vif-deleted:54168103-37cf-4abe-a4e5-bac3eeeca578 for instance b079367a-558e-4920-ad8d-972a8065260c on user Apr 11 19:43:25 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [req-a4f461d1-b220-4907-a1e5-65955eac9408 req-8fb4c0bf-4c0d-4d77-8144-eb7492a23fa6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035882 Apr 11 19:43:25 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 306/922] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:43:25 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:43:25 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [req-ce2da7be-8bc6-4f0a-959e-62c24aced79e req-e0c727ad-1ae9-4146-b78e-ce43e764a46f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b079367a-558e-4920-ad8d-972a8065260c", "name": "network-vif-plugged", "status": "completed", "tag": "54168103-37cf-4abe-a4e5-bac3eeeca578"}, {"server_uuid": "b079367a-558e-4920-ad8d-972a8065260c", "name": "network-vif-plugged", "status": "completed", "tag": "54168103-37cf-4abe-a4e5-bac3eeeca578"}, {"server_uuid": "b079367a-558e-4920-ad8d-972a8065260c", "name": "network-vif-plugged", "status": "completed", "tag": "54168103-37cf-4abe-a4e5-bac3eeeca578"}, {"server_uuid": "b079367a-558e-4920-ad8d-972a8065260c", "name": "network-vif-unplugged", "status": "completed", "tag": "54168103-37cf-4abe-a4e5-bac3eeeca578"}, {"server_uuid": "b079367a-558e-4920-ad8d-972a8065260c", "name": "network-vif-plugged", "status": "completed", "tag": "54168103-37cf-4abe-a4e5-bac3eeeca578"}]} {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:43:25 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-ce2da7be-8bc6-4f0a-959e-62c24aced79e req-e0c727ad-1ae9-4146-b78e-ce43e764a46f service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:43:25 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-ce2da7be-8bc6-4f0a-959e-62c24aced79e req-e0c727ad-1ae9-4146-b78e-ce43e764a46f service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:43:25 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-ce2da7be-8bc6-4f0a-959e-62c24aced79e req-e0c727ad-1ae9-4146-b78e-ce43e764a46f service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:43:25 user devstack@n-api.service[72088]: INFO nova.api.openstack.compute.server_external_events [req-ce2da7be-8bc6-4f0a-959e-62c24aced79e req-e0c727ad-1ae9-4146-b78e-ce43e764a46f service nova] Creating event network-vif-plugged:54168103-37cf-4abe-a4e5-bac3eeeca578 for instance b079367a-558e-4920-ad8d-972a8065260c on user Apr 11 19:43:25 user devstack@n-api.service[72088]: INFO nova.api.openstack.compute.server_external_events [req-ce2da7be-8bc6-4f0a-959e-62c24aced79e req-e0c727ad-1ae9-4146-b78e-ce43e764a46f service nova] Creating event network-vif-plugged:54168103-37cf-4abe-a4e5-bac3eeeca578 for instance b079367a-558e-4920-ad8d-972a8065260c on user Apr 11 19:43:25 user devstack@n-api.service[72088]: INFO nova.api.openstack.compute.server_external_events [req-ce2da7be-8bc6-4f0a-959e-62c24aced79e req-e0c727ad-1ae9-4146-b78e-ce43e764a46f service nova] Creating event network-vif-plugged:54168103-37cf-4abe-a4e5-bac3eeeca578 for instance b079367a-558e-4920-ad8d-972a8065260c on user Apr 11 19:43:25 user devstack@n-api.service[72088]: INFO nova.api.openstack.compute.server_external_events [req-ce2da7be-8bc6-4f0a-959e-62c24aced79e req-e0c727ad-1ae9-4146-b78e-ce43e764a46f service nova] Creating event network-vif-unplugged:54168103-37cf-4abe-a4e5-bac3eeeca578 for instance b079367a-558e-4920-ad8d-972a8065260c on user Apr 11 19:43:25 user devstack@n-api.service[72088]: INFO nova.api.openstack.compute.server_external_events [req-ce2da7be-8bc6-4f0a-959e-62c24aced79e req-e0c727ad-1ae9-4146-b78e-ce43e764a46f service nova] Creating event network-vif-plugged:54168103-37cf-4abe-a4e5-bac3eeeca578 for instance b079367a-558e-4920-ad8d-972a8065260c on user Apr 11 19:43:25 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [req-ce2da7be-8bc6-4f0a-959e-62c24aced79e req-e0c727ad-1ae9-4146-b78e-ce43e764a46f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 869 microversion: 2.1 time: 0.035061 Apr 11 19:43:25 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 302/923] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:43:25 2023] POST /compute/v2.1/os-server-external-events => generated 869 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:43:43 user devstack@n-api.service[72089]: DEBUG dbcounter [-] [72089] Writing DB stats nova_api:SELECT=32,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=72089) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:43:43 user devstack@n-api.service[72089]: DEBUG dbcounter [-] [72089] Writing DB stats nova_cell1:SELECT=29,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=72089) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:43:43 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [None req-d0c7aa73-093e-4398-8ba6-d3e048bf85a3 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Calling method '>' {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:43:43 user devstack@n-api.service[72089]: DEBUG nova.compute.api [None req-d0c7aa73-093e-4398-8ba6-d3e048bf85a3 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] [instance: 6b110aaa-0f26-4bab-8f3e-d22edb5a5072] Fetching instance by UUID {{(pid=72089) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:43:43 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-d0c7aa73-093e-4398-8ba6-d3e048bf85a3 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:43:43 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-d0c7aa73-093e-4398-8ba6-d3e048bf85a3 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:43:43 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-d0c7aa73-093e-4398-8ba6-d3e048bf85a3 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:43:43 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-d0c7aa73-093e-4398-8ba6-d3e048bf85a3 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:43:43 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-d0c7aa73-093e-4398-8ba6-d3e048bf85a3 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:43:43 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-d0c7aa73-093e-4398-8ba6-d3e048bf85a3 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:43:43 user devstack@n-api.service[72089]: DEBUG nova.policy [None req-d0c7aa73-093e-4398-8ba6-d3e048bf85a3 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b2a4a06b5354121ae49d85be8b02458', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f0373f7bf54eb8845340bd4e931ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72089) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:43:43 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [None req-d0c7aa73-093e-4398-8ba6-d3e048bf85a3 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6b110aaa-0f26-4bab-8f3e-d22edb5a5072" status: 200 len: 1567 microversion: 2.1 time: 0.161495 Apr 11 19:43:43 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 316/924] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 19:43:43 2023] GET /compute/v2.1/servers/6b110aaa-0f26-4bab-8f3e-d22edb5a5072 => generated 1567 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:43:46 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [req-624bc961-ab97-4da3-a4bd-f29a6a8efeed req-bb5b0c65-ae92-4f44-8901-3b9900dcb5bc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6b110aaa-0f26-4bab-8f3e-d22edb5a5072", "tag": "8d43789b-e200-409a-b819-09dd85859b3c"}]} {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:43:46 user devstack@n-api.service[72090]: DEBUG dbcounter [-] [72090] Writing DB stats nova_api:SELECT=6 {{(pid=72090) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:43:46 user devstack@n-api.service[72090]: DEBUG dbcounter [-] [72090] Writing DB stats nova_cell1:SELECT=6 {{(pid=72090) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:43:46 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-624bc961-ab97-4da3-a4bd-f29a6a8efeed req-bb5b0c65-ae92-4f44-8901-3b9900dcb5bc service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:43:46 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-624bc961-ab97-4da3-a4bd-f29a6a8efeed req-bb5b0c65-ae92-4f44-8901-3b9900dcb5bc service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:43:46 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-624bc961-ab97-4da3-a4bd-f29a6a8efeed req-bb5b0c65-ae92-4f44-8901-3b9900dcb5bc service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:43:46 user devstack@n-api.service[72090]: INFO nova.api.openstack.compute.server_external_events [req-624bc961-ab97-4da3-a4bd-f29a6a8efeed req-bb5b0c65-ae92-4f44-8901-3b9900dcb5bc service nova] Creating event network-changed:8d43789b-e200-409a-b819-09dd85859b3c for instance 6b110aaa-0f26-4bab-8f3e-d22edb5a5072 on user Apr 11 19:43:46 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [req-624bc961-ab97-4da3-a4bd-f29a6a8efeed req-bb5b0c65-ae92-4f44-8901-3b9900dcb5bc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039094 Apr 11 19:43:46 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 307/925] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:43:46 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:43:47 user devstack@n-api.service[72088]: DEBUG dbcounter [-] [72088] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=3 {{(pid=72088) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:43:47 user devstack@n-api.service[72088]: DEBUG dbcounter [-] [72088] Writing DB stats nova_cell1:SELECT=20 {{(pid=72088) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:43:47 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [None req-617e9a18-a108-47a4-962a-2b520b6f4be9 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fddbfb90-1352-42e7-bb50-aa2c83c2e019"}} {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:43:47 user devstack@n-api.service[72088]: DEBUG nova.compute.api [None req-617e9a18-a108-47a4-962a-2b520b6f4be9 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] [instance: 6b110aaa-0f26-4bab-8f3e-d22edb5a5072] Fetching instance by UUID {{(pid=72088) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:43:47 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-617e9a18-a108-47a4-962a-2b520b6f4be9 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:43:47 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-617e9a18-a108-47a4-962a-2b520b6f4be9 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:43:47 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-617e9a18-a108-47a4-962a-2b520b6f4be9 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:43:47 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-617e9a18-a108-47a4-962a-2b520b6f4be9 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:43:47 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-617e9a18-a108-47a4-962a-2b520b6f4be9 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:43:47 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-617e9a18-a108-47a4-962a-2b520b6f4be9 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:43:47 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [None req-617e9a18-a108-47a4-962a-2b520b6f4be9 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] 10.0.0.210 "POST /compute/v2.1/servers/6b110aaa-0f26-4bab-8f3e-d22edb5a5072/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.569822 Apr 11 19:43:47 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 303/926] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Apr 11 19:43:47 2023] POST /compute/v2.1/servers/6b110aaa-0f26-4bab-8f3e-d22edb5a5072/os-volume_attachments => generated 194 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:43:52 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [None req-642cce12-ba3d-48cb-957c-cf151c94a440 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Calling method '>' {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:43:52 user devstack@n-api.service[72089]: DEBUG nova.compute.api [None req-642cce12-ba3d-48cb-957c-cf151c94a440 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] [instance: f633037d-87d0-4dda-aa33-3cc9c3191080] Fetching instance by UUID {{(pid=72089) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:43:52 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-642cce12-ba3d-48cb-957c-cf151c94a440 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:43:52 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-642cce12-ba3d-48cb-957c-cf151c94a440 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:43:52 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-642cce12-ba3d-48cb-957c-cf151c94a440 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:43:52 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-642cce12-ba3d-48cb-957c-cf151c94a440 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:43:52 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-642cce12-ba3d-48cb-957c-cf151c94a440 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:43:52 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-642cce12-ba3d-48cb-957c-cf151c94a440 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:43:52 user devstack@n-api.service[72089]: DEBUG nova.policy [None req-642cce12-ba3d-48cb-957c-cf151c94a440 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05fb551c320a48f98a4ec00a7f7492d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60a7381a31b84e97a068528f90813773', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72089) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:43:52 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [None req-642cce12-ba3d-48cb-957c-cf151c94a440 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f633037d-87d0-4dda-aa33-3cc9c3191080" status: 200 len: 1427 microversion: 2.1 time: 0.224247 Apr 11 19:43:52 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 317/927] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 19:43:52 2023] GET /compute/v2.1/servers/f633037d-87d0-4dda-aa33-3cc9c3191080 => generated 1427 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:43:59 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [None req-2e766d84-4145-4ba5-8093-263a7797b0e3 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Calling method '>' {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:43:59 user devstack@n-api.service[72090]: DEBUG nova.compute.api [None req-2e766d84-4145-4ba5-8093-263a7797b0e3 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] [instance: 6b110aaa-0f26-4bab-8f3e-d22edb5a5072] Fetching instance by UUID {{(pid=72090) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:43:59 user devstack@n-api.service[72090]: DEBUG dbcounter [-] [72090] Writing DB stats nova_cell1:SELECT=2 {{(pid=72090) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:43:59 user devstack@n-api.service[72090]: DEBUG dbcounter [-] [72090] Writing DB stats nova_api:SELECT=2 {{(pid=72090) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:43:59 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-2e766d84-4145-4ba5-8093-263a7797b0e3 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:43:59 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-2e766d84-4145-4ba5-8093-263a7797b0e3 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:43:59 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-2e766d84-4145-4ba5-8093-263a7797b0e3 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:43:59 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-2e766d84-4145-4ba5-8093-263a7797b0e3 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:43:59 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-2e766d84-4145-4ba5-8093-263a7797b0e3 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:43:59 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-2e766d84-4145-4ba5-8093-263a7797b0e3 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:43:59 user devstack@n-api.service[72090]: DEBUG nova.objects.instance [None req-2e766d84-4145-4ba5-8093-263a7797b0e3 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Lazy-loading 'services' on Instance uuid 6b110aaa-0f26-4bab-8f3e-d22edb5a5072 {{(pid=72090) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 11 19:43:59 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [None req-2e766d84-4145-4ba5-8093-263a7797b0e3 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/6b110aaa-0f26-4bab-8f3e-d22edb5a5072/os-volume_attachments/fddbfb90-1352-42e7-bb50-aa2c83c2e019" status: 202 len: 0 microversion: 2.1 time: 0.187008 Apr 11 19:43:59 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 308/928] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Apr 11 19:43:59 2023] DELETE /compute/v2.1/servers/6b110aaa-0f26-4bab-8f3e-d22edb5a5072/os-volume_attachments/fddbfb90-1352-42e7-bb50-aa2c83c2e019 => generated 0 bytes in 189 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 19:43:59 user devstack@n-api.service[72088]: DEBUG dbcounter [-] [72088] Writing DB stats nova_api:SELECT=2 {{(pid=72088) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:43:59 user devstack@n-api.service[72088]: DEBUG dbcounter [-] [72088] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=72088) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:43:59 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [None req-7a3eb072-8881-4137-acc7-f44ed6c1884f tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Calling method '>' {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:43:59 user devstack@n-api.service[72088]: DEBUG nova.compute.api [None req-7a3eb072-8881-4137-acc7-f44ed6c1884f tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] [instance: 6b110aaa-0f26-4bab-8f3e-d22edb5a5072] Fetching instance by UUID {{(pid=72088) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:43:59 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-7a3eb072-8881-4137-acc7-f44ed6c1884f tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:43:59 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-7a3eb072-8881-4137-acc7-f44ed6c1884f tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:43:59 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-7a3eb072-8881-4137-acc7-f44ed6c1884f tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:43:59 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-7a3eb072-8881-4137-acc7-f44ed6c1884f tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:43:59 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-7a3eb072-8881-4137-acc7-f44ed6c1884f tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:43:59 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-7a3eb072-8881-4137-acc7-f44ed6c1884f tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:43:59 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [None req-7a3eb072-8881-4137-acc7-f44ed6c1884f tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6b110aaa-0f26-4bab-8f3e-d22edb5a5072/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.084911 Apr 11 19:43:59 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 304/929] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Apr 11 19:43:59 2023] GET /compute/v2.1/servers/6b110aaa-0f26-4bab-8f3e-d22edb5a5072/os-volume_attachments => generated 197 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 11 19:44:00 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [None req-bcc2d4a0-0488-49fe-b8c3-ddb85104f464 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Calling method '>' {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:44:00 user devstack@n-api.service[72089]: DEBUG nova.compute.api [None req-bcc2d4a0-0488-49fe-b8c3-ddb85104f464 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] [instance: bf0a75f5-2f44-4687-af12-046f6761fee2] Fetching instance by UUID {{(pid=72089) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:44:00 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-bcc2d4a0-0488-49fe-b8c3-ddb85104f464 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:44:00 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-bcc2d4a0-0488-49fe-b8c3-ddb85104f464 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:44:00 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-bcc2d4a0-0488-49fe-b8c3-ddb85104f464 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:44:00 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-bcc2d4a0-0488-49fe-b8c3-ddb85104f464 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:44:00 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-bcc2d4a0-0488-49fe-b8c3-ddb85104f464 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:44:00 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-bcc2d4a0-0488-49fe-b8c3-ddb85104f464 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:44:00 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [None req-bcc2d4a0-0488-49fe-b8c3-ddb85104f464 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bf0a75f5-2f44-4687-af12-046f6761fee2/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.103697 Apr 11 19:44:00 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 318/930] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Apr 11 19:44:00 2023] GET /compute/v2.1/servers/bf0a75f5-2f44-4687-af12-046f6761fee2/os-interface => generated 283 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:44:01 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [req-ba4263ea-5e96-4de5-bf12-2311c629744c req-c437ff2b-51e2-4f88-9fdc-57c5b304c0a8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bf0a75f5-2f44-4687-af12-046f6761fee2", "tag": "c662b1b3-b2b3-4502-81af-9afdf3e591dc"}]} {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:44:01 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-ba4263ea-5e96-4de5-bf12-2311c629744c req-c437ff2b-51e2-4f88-9fdc-57c5b304c0a8 service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:44:01 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-ba4263ea-5e96-4de5-bf12-2311c629744c req-c437ff2b-51e2-4f88-9fdc-57c5b304c0a8 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:44:01 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-ba4263ea-5e96-4de5-bf12-2311c629744c req-c437ff2b-51e2-4f88-9fdc-57c5b304c0a8 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:44:01 user devstack@n-api.service[72090]: INFO nova.api.openstack.compute.server_external_events [req-ba4263ea-5e96-4de5-bf12-2311c629744c req-c437ff2b-51e2-4f88-9fdc-57c5b304c0a8 service nova] Creating event network-changed:c662b1b3-b2b3-4502-81af-9afdf3e591dc for instance bf0a75f5-2f44-4687-af12-046f6761fee2 on user Apr 11 19:44:01 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [req-ba4263ea-5e96-4de5-bf12-2311c629744c req-c437ff2b-51e2-4f88-9fdc-57c5b304c0a8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031880 Apr 11 19:44:01 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 309/931] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:44:01 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:44:01 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [None req-48d1caf3-af61-40fd-9ee4-e3d28f607e96 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Calling method '>' {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:44:01 user devstack@n-api.service[72088]: DEBUG nova.compute.api [None req-48d1caf3-af61-40fd-9ee4-e3d28f607e96 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] [instance: bf0a75f5-2f44-4687-af12-046f6761fee2] Fetching instance by UUID {{(pid=72088) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:44:01 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-48d1caf3-af61-40fd-9ee4-e3d28f607e96 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:44:01 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-48d1caf3-af61-40fd-9ee4-e3d28f607e96 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:44:01 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-48d1caf3-af61-40fd-9ee4-e3d28f607e96 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:44:01 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-48d1caf3-af61-40fd-9ee4-e3d28f607e96 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:44:01 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-48d1caf3-af61-40fd-9ee4-e3d28f607e96 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:44:01 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-48d1caf3-af61-40fd-9ee4-e3d28f607e96 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:44:01 user devstack@n-api.service[72088]: DEBUG nova.objects.instance [None req-48d1caf3-af61-40fd-9ee4-e3d28f607e96 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Lazy-loading 'services' on Instance uuid bf0a75f5-2f44-4687-af12-046f6761fee2 {{(pid=72088) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 11 19:44:01 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [None req-48d1caf3-af61-40fd-9ee4-e3d28f607e96 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/bf0a75f5-2f44-4687-af12-046f6761fee2/os-volume_attachments/6cb60e75-74d9-4e1f-a22e-40a36780b21b" status: 202 len: 0 microversion: 2.1 time: 0.168413 Apr 11 19:44:01 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 305/932] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Apr 11 19:44:01 2023] DELETE /compute/v2.1/servers/bf0a75f5-2f44-4687-af12-046f6761fee2/os-volume_attachments/6cb60e75-74d9-4e1f-a22e-40a36780b21b => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 19:44:01 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [None req-a19031ef-7e17-4483-97a6-a76ff0c3c52f tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Calling method '>' {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:44:01 user devstack@n-api.service[72089]: DEBUG nova.compute.api [None req-a19031ef-7e17-4483-97a6-a76ff0c3c52f tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] [instance: bf0a75f5-2f44-4687-af12-046f6761fee2] Fetching instance by UUID {{(pid=72089) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:44:01 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-a19031ef-7e17-4483-97a6-a76ff0c3c52f tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:44:01 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-a19031ef-7e17-4483-97a6-a76ff0c3c52f tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:44:01 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-a19031ef-7e17-4483-97a6-a76ff0c3c52f tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:44:01 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-a19031ef-7e17-4483-97a6-a76ff0c3c52f tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:44:01 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-a19031ef-7e17-4483-97a6-a76ff0c3c52f tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:44:01 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-a19031ef-7e17-4483-97a6-a76ff0c3c52f tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:44:01 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [None req-a19031ef-7e17-4483-97a6-a76ff0c3c52f tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bf0a75f5-2f44-4687-af12-046f6761fee2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052237 Apr 11 19:44:01 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 319/933] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Apr 11 19:44:01 2023] GET /compute/v2.1/servers/bf0a75f5-2f44-4687-af12-046f6761fee2/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:44:02 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [None req-e1df40ef-ff89-4890-ace0-f4da4c46041b tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Calling method '>' {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:44:02 user devstack@n-api.service[72090]: DEBUG nova.compute.api [None req-e1df40ef-ff89-4890-ace0-f4da4c46041b tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] [instance: a66c1d51-e194-424d-a37c-d308544774c6] Fetching instance by UUID {{(pid=72090) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:44:02 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-e1df40ef-ff89-4890-ace0-f4da4c46041b tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:44:02 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-e1df40ef-ff89-4890-ace0-f4da4c46041b tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:44:02 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-e1df40ef-ff89-4890-ace0-f4da4c46041b tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:44:02 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-e1df40ef-ff89-4890-ace0-f4da4c46041b tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:44:02 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-e1df40ef-ff89-4890-ace0-f4da4c46041b tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:44:02 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-e1df40ef-ff89-4890-ace0-f4da4c46041b tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:44:02 user devstack@n-api.service[72090]: DEBUG nova.policy [None req-e1df40ef-ff89-4890-ace0-f4da4c46041b tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf262cd03f4a41c4956d8784cf37d86d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caba0618fc743e7bfb2dd866a511df9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72090) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:44:02 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [None req-e1df40ef-ff89-4890-ace0-f4da4c46041b tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a66c1d51-e194-424d-a37c-d308544774c6" status: 200 len: 1440 microversion: 2.1 time: 0.157381 Apr 11 19:44:02 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 310/934] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 19:44:02 2023] GET /compute/v2.1/servers/a66c1d51-e194-424d-a37c-d308544774c6 => generated 1440 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:44:03 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [req-6d6afc04-4be8-441d-aecd-92318ce341a7 req-9ff83c25-6a5a-41b0-8902-3b0f3eb7c7e1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bf0a75f5-2f44-4687-af12-046f6761fee2", "tag": "c662b1b3-b2b3-4502-81af-9afdf3e591dc"}]} {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:44:03 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-6d6afc04-4be8-441d-aecd-92318ce341a7 req-9ff83c25-6a5a-41b0-8902-3b0f3eb7c7e1 service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:44:03 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-6d6afc04-4be8-441d-aecd-92318ce341a7 req-9ff83c25-6a5a-41b0-8902-3b0f3eb7c7e1 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:44:03 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-6d6afc04-4be8-441d-aecd-92318ce341a7 req-9ff83c25-6a5a-41b0-8902-3b0f3eb7c7e1 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:44:03 user devstack@n-api.service[72088]: INFO nova.api.openstack.compute.server_external_events [req-6d6afc04-4be8-441d-aecd-92318ce341a7 req-9ff83c25-6a5a-41b0-8902-3b0f3eb7c7e1 service nova] Creating event network-changed:c662b1b3-b2b3-4502-81af-9afdf3e591dc for instance bf0a75f5-2f44-4687-af12-046f6761fee2 on user Apr 11 19:44:03 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [req-6d6afc04-4be8-441d-aecd-92318ce341a7 req-9ff83c25-6a5a-41b0-8902-3b0f3eb7c7e1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030619 Apr 11 19:44:03 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 306/935] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:44:03 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:44:13 user devstack@n-api.service[72089]: DEBUG dbcounter [-] [72089] Writing DB stats nova_api:SELECT=8 {{(pid=72089) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:44:13 user devstack@n-api.service[72089]: DEBUG dbcounter [-] [72089] Writing DB stats nova_cell1:SELECT=22 {{(pid=72089) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:44:13 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [None req-b37eb8df-4ecb-4c88-9658-b7851eb796a6 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Calling method '>' {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:44:13 user devstack@n-api.service[72089]: DEBUG nova.compute.api [None req-b37eb8df-4ecb-4c88-9658-b7851eb796a6 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] [instance: b079367a-558e-4920-ad8d-972a8065260c] Fetching instance by UUID {{(pid=72089) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:44:13 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-b37eb8df-4ecb-4c88-9658-b7851eb796a6 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:44:13 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-b37eb8df-4ecb-4c88-9658-b7851eb796a6 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:44:13 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-b37eb8df-4ecb-4c88-9658-b7851eb796a6 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:44:13 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-b37eb8df-4ecb-4c88-9658-b7851eb796a6 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:44:13 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-b37eb8df-4ecb-4c88-9658-b7851eb796a6 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:44:13 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-b37eb8df-4ecb-4c88-9658-b7851eb796a6 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:44:13 user devstack@n-api.service[72089]: INFO nova.api.openstack.wsgi [None req-b37eb8df-4ecb-4c88-9658-b7851eb796a6 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] HTTP exception thrown: Instance b079367a-558e-4920-ad8d-972a8065260c could not be found. Apr 11 19:44:13 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [None req-b37eb8df-4ecb-4c88-9658-b7851eb796a6 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Request method failure captured: Apr 11 19:44:13 user devstack@n-api.service[72089]: request: GET /compute/v2.1/servers/b079367a-558e-4920-ad8d-972a8065260c HTTP/1.1 Apr 11 19:44:13 user devstack@n-api.service[72089]: Accept: application/json Apr 11 19:44:13 user devstack@n-api.service[72089]: Accept-Encoding: identity Apr 11 19:44:13 user devstack@n-api.service[72089]: Connection: close Apr 11 19:44:13 user devstack@n-api.service[72089]: Content-Length: 0 Apr 11 19:44:13 user devstack@n-api.service[72089]: Content-Type: application/json Apr 11 19:44:13 user devstack@n-api.service[72089]: Host: 10.0.0.210 Apr 11 19:44:13 user devstack@n-api.service[72089]: Openstack-System-Scope: None Apr 11 19:44:13 user devstack@n-api.service[72089]: User-Agent: python-urllib3/1.26.15 Apr 11 19:44:13 user devstack@n-api.service[72089]: X-Auth-Token: gAAAAABkNbQnEMwb9bokVGqy8IBkwGOZTlbefW9-gCGma1Q9aMCf7rErAs3NuXcPCnuWAMFMb4o5vJ-bB4xPFTn6y2WKU9I0pItmZHu7i_RppKkEiULwNqNywUZ2M-d73QMTy5dW3-OZVF1Bf-qwJagrp481OxGYQGqOEgWnBHPks1h4PLepPQA Apr 11 19:44:13 user devstack@n-api.service[72089]: X-Domain-Id: None Apr 11 19:44:13 user devstack@n-api.service[72089]: X-Domain-Name: None Apr 11 19:44:13 user devstack@n-api.service[72089]: X-Identity-Status: Confirmed Apr 11 19:44:13 user devstack@n-api.service[72089]: X-Is-Admin-Project: True Apr 11 19:44:13 user devstack@n-api.service[72089]: X-Openstack-Nova-Api-Version: 2.87 Apr 11 19:44:13 user devstack@n-api.service[72089]: X-Project-Domain-Id: default Apr 11 19:44:13 user devstack@n-api.service[72089]: X-Project-Domain-Name: Default Apr 11 19:44:13 user devstack@n-api.service[72089]: X-Project-Id: eb91586feb3f4a4c84fa8c2183baaf8c Apr 11 19:44:13 user devstack@n-api.service[72089]: X-Project-Name: tempest-ServerBootFromVolumeStableRescueTest-863156619 Apr 11 19:44:13 user devstack@n-api.service[72089]: X-Role: reader,member Apr 11 19:44:13 user devstack@n-api.service[72089]: X-Roles: reader,member Apr 11 19:44:13 user devstack@n-api.service[72089]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/eb91586feb3f4a4c84fa8c2183baaf8c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/eb91586feb3f4a4c84fa8c2183baaf8c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/eb91586feb3f4a4c84fa8c2183baaf8c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 11 19:44:13 user devstack@n-api.service[72089]: X-Tenant: tempest-ServerBootFromVolumeStableRescueTest-863156619 Apr 11 19:44:13 user devstack@n-api.service[72089]: X-Tenant-Id: eb91586feb3f4a4c84fa8c2183baaf8c Apr 11 19:44:13 user devstack@n-api.service[72089]: X-Tenant-Name: tempest-ServerBootFromVolumeStableRescueTest-863156619 Apr 11 19:44:13 user devstack@n-api.service[72089]: X-User: tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member Apr 11 19:44:13 user devstack@n-api.service[72089]: X-User-Domain-Id: default Apr 11 19:44:13 user devstack@n-api.service[72089]: X-User-Domain-Name: Default Apr 11 19:44:13 user devstack@n-api.service[72089]: X-User-Id: 1b3adca432b04d70818a51d1366f5c6d Apr 11 19:44:13 user devstack@n-api.service[72089]: X-User-Name: tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member Apr 11 19:44:13 user devstack@n-api.service[72089]: method: > Apr 11 19:44:13 user devstack@n-api.service[72089]: exception: Instance b079367a-558e-4920-ad8d-972a8065260c could not be found. Apr 11 19:44:13 user devstack@n-api.service[72089]: action_args: {'id': 'b079367a-558e-4920-ad8d-972a8065260c'} Apr 11 19:44:13 user devstack@n-api.service[72089]: {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 19:44:13 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:44:13 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 19:44:13 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 19:44:13 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 19:44:13 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 19:44:13 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 19:44:13 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 19:44:13 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 19:44:13 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 19:44:13 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b079367a-558e-4920-ad8d-972a8065260c could not be found. Apr 11 19:44:13 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi Apr 11 19:44:13 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 19:44:13 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi Apr 11 19:44:13 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:44:13 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 19:44:13 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 19:44:13 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 19:44:13 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 19:44:13 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 19:44:13 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 19:44:13 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 19:44:13 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 19:44:13 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 19:44:13 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 19:44:13 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 19:44:13 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 19:44:13 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b079367a-558e-4920-ad8d-972a8065260c could not be found. Apr 11 19:44:13 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi Apr 11 19:44:13 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 19:44:13 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi Apr 11 19:44:13 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:44:13 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 19:44:13 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 19:44:13 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 19:44:13 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 19:44:13 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b079367a-558e-4920-ad8d-972a8065260c could not be found. Apr 11 19:44:13 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi Apr 11 19:44:13 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [None req-b37eb8df-4ecb-4c88-9658-b7851eb796a6 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Returning 404 to user: Instance b079367a-558e-4920-ad8d-972a8065260c could not be found. {{(pid=72089) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 19:44:13 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [None req-b37eb8df-4ecb-4c88-9658-b7851eb796a6 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b079367a-558e-4920-ad8d-972a8065260c" status: 404 len: 111 microversion: 2.87 time: 0.038729 Apr 11 19:44:13 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 320/936] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 19:44:13 2023] GET /compute/v2.1/servers/b079367a-558e-4920-ad8d-972a8065260c => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 11 19:44:13 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [None req-86723e45-d1f4-4694-ba38-5ff461e88d4f tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Calling method '>' {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:44:13 user devstack@n-api.service[72090]: DEBUG nova.compute.api [None req-86723e45-d1f4-4694-ba38-5ff461e88d4f tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] [instance: 864fcd9b-8e5b-4de8-a2e6-292a8907a834] Fetching instance by UUID {{(pid=72090) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:44:13 user devstack@n-api.service[72090]: DEBUG dbcounter [-] [72090] Writing DB stats nova_api:SELECT=6 {{(pid=72090) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:44:13 user devstack@n-api.service[72090]: DEBUG dbcounter [-] [72090] Writing DB stats nova_cell1:SELECT=17,nova_cell1:INSERT=1 {{(pid=72090) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:44:13 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-86723e45-d1f4-4694-ba38-5ff461e88d4f tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:44:13 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-86723e45-d1f4-4694-ba38-5ff461e88d4f tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:44:13 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-86723e45-d1f4-4694-ba38-5ff461e88d4f tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:44:13 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-86723e45-d1f4-4694-ba38-5ff461e88d4f tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:44:13 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-86723e45-d1f4-4694-ba38-5ff461e88d4f tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:44:13 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-86723e45-d1f4-4694-ba38-5ff461e88d4f tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:44:13 user devstack@n-api.service[72090]: DEBUG nova.compute.api [None req-86723e45-d1f4-4694-ba38-5ff461e88d4f tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] [instance: 864fcd9b-8e5b-4de8-a2e6-292a8907a834] Going to try to terminate instance {{(pid=72090) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 11 19:44:13 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [None req-86723e45-d1f4-4694-ba38-5ff461e88d4f tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/864fcd9b-8e5b-4de8-a2e6-292a8907a834" status: 204 len: 0 microversion: 2.87 time: 0.122556 Apr 11 19:44:13 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 311/937] 10.0.0.210 () {64 vars in 1357 bytes} [Tue Apr 11 19:44:13 2023] DELETE /compute/v2.1/servers/864fcd9b-8e5b-4de8-a2e6-292a8907a834 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 11 19:44:13 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [None req-bacd6d9c-af04-4d55-9703-2fbd5bafb581 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Calling method '>' {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:44:13 user devstack@n-api.service[72088]: DEBUG nova.compute.api [None req-bacd6d9c-af04-4d55-9703-2fbd5bafb581 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] [instance: 864fcd9b-8e5b-4de8-a2e6-292a8907a834] Fetching instance by UUID {{(pid=72088) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:44:13 user devstack@n-api.service[72088]: DEBUG dbcounter [-] [72088] Writing DB stats nova_api:SELECT=6 {{(pid=72088) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:44:13 user devstack@n-api.service[72088]: DEBUG dbcounter [-] [72088] Writing DB stats nova_cell1:SELECT=17,nova_cell1:INSERT=1 {{(pid=72088) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:44:13 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-bacd6d9c-af04-4d55-9703-2fbd5bafb581 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:44:13 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-bacd6d9c-af04-4d55-9703-2fbd5bafb581 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:44:13 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-bacd6d9c-af04-4d55-9703-2fbd5bafb581 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:44:13 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-bacd6d9c-af04-4d55-9703-2fbd5bafb581 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:44:13 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-bacd6d9c-af04-4d55-9703-2fbd5bafb581 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:44:13 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-bacd6d9c-af04-4d55-9703-2fbd5bafb581 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:44:13 user devstack@n-api.service[72088]: DEBUG nova.policy [None req-bacd6d9c-af04-4d55-9703-2fbd5bafb581 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b3adca432b04d70818a51d1366f5c6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb91586feb3f4a4c84fa8c2183baaf8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72088) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:44:13 user devstack@n-api.service[72088]: DEBUG nova.policy [None req-bacd6d9c-af04-4d55-9703-2fbd5bafb581 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b3adca432b04d70818a51d1366f5c6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb91586feb3f4a4c84fa8c2183baaf8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72088) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:44:13 user devstack@n-api.service[72088]: DEBUG nova.policy [None req-bacd6d9c-af04-4d55-9703-2fbd5bafb581 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b3adca432b04d70818a51d1366f5c6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb91586feb3f4a4c84fa8c2183baaf8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72088) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:44:13 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [None req-bacd6d9c-af04-4d55-9703-2fbd5bafb581 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] 10.0.0.210 "GET /compute/v2.1/servers/864fcd9b-8e5b-4de8-a2e6-292a8907a834" status: 200 len: 1775 microversion: 2.87 time: 0.188758 Apr 11 19:44:13 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 307/938] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 19:44:13 2023] GET /compute/v2.1/servers/864fcd9b-8e5b-4de8-a2e6-292a8907a834 => generated 1775 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 19:44:13 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [req-ab28b17b-4883-4963-915e-a7eced32b17d req-dc337a70-52a0-40af-aaba-fe3d36238bc6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "864fcd9b-8e5b-4de8-a2e6-292a8907a834", "name": "network-vif-unplugged", "status": "completed", "tag": "60f272b0-f7d2-408b-b99b-9bcfcd3f23ff"}]} {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:44:13 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-ab28b17b-4883-4963-915e-a7eced32b17d req-dc337a70-52a0-40af-aaba-fe3d36238bc6 service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:44:13 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-ab28b17b-4883-4963-915e-a7eced32b17d req-dc337a70-52a0-40af-aaba-fe3d36238bc6 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:44:13 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-ab28b17b-4883-4963-915e-a7eced32b17d req-dc337a70-52a0-40af-aaba-fe3d36238bc6 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:44:13 user devstack@n-api.service[72089]: INFO nova.api.openstack.compute.server_external_events [req-ab28b17b-4883-4963-915e-a7eced32b17d req-dc337a70-52a0-40af-aaba-fe3d36238bc6 service nova] Creating event network-vif-unplugged:60f272b0-f7d2-408b-b99b-9bcfcd3f23ff for instance 864fcd9b-8e5b-4de8-a2e6-292a8907a834 on user Apr 11 19:44:13 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [req-ab28b17b-4883-4963-915e-a7eced32b17d req-dc337a70-52a0-40af-aaba-fe3d36238bc6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034550 Apr 11 19:44:13 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 321/939] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:44:13 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:44:15 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [req-72182481-4b62-4b89-ad00-a6f7e6f67142 req-e20fa4ec-0081-469e-8b37-1b372aa99afb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "864fcd9b-8e5b-4de8-a2e6-292a8907a834", "name": "network-vif-deleted", "tag": "60f272b0-f7d2-408b-b99b-9bcfcd3f23ff"}]} {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:44:15 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-72182481-4b62-4b89-ad00-a6f7e6f67142 req-e20fa4ec-0081-469e-8b37-1b372aa99afb service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:44:15 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-72182481-4b62-4b89-ad00-a6f7e6f67142 req-e20fa4ec-0081-469e-8b37-1b372aa99afb service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:44:15 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-72182481-4b62-4b89-ad00-a6f7e6f67142 req-e20fa4ec-0081-469e-8b37-1b372aa99afb service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:44:15 user devstack@n-api.service[72090]: INFO nova.api.openstack.compute.server_external_events [req-72182481-4b62-4b89-ad00-a6f7e6f67142 req-e20fa4ec-0081-469e-8b37-1b372aa99afb service nova] Creating event network-vif-deleted:60f272b0-f7d2-408b-b99b-9bcfcd3f23ff for instance 864fcd9b-8e5b-4de8-a2e6-292a8907a834 on user Apr 11 19:44:15 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [req-72182481-4b62-4b89-ad00-a6f7e6f67142 req-e20fa4ec-0081-469e-8b37-1b372aa99afb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047221 Apr 11 19:44:15 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 312/940] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:44:15 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:44:15 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [req-2294e617-ea14-4a2a-8121-8cb3662ecb7e req-79472b61-164c-4c31-abe9-3d0395c8d027 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "864fcd9b-8e5b-4de8-a2e6-292a8907a834", "name": "network-vif-plugged", "status": "completed", "tag": "60f272b0-f7d2-408b-b99b-9bcfcd3f23ff"}]} {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:44:15 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-2294e617-ea14-4a2a-8121-8cb3662ecb7e req-79472b61-164c-4c31-abe9-3d0395c8d027 service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:44:15 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-2294e617-ea14-4a2a-8121-8cb3662ecb7e req-79472b61-164c-4c31-abe9-3d0395c8d027 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:44:15 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-2294e617-ea14-4a2a-8121-8cb3662ecb7e req-79472b61-164c-4c31-abe9-3d0395c8d027 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:44:15 user devstack@n-api.service[72088]: INFO nova.api.openstack.compute.server_external_events [req-2294e617-ea14-4a2a-8121-8cb3662ecb7e req-79472b61-164c-4c31-abe9-3d0395c8d027 service nova] Creating event network-vif-plugged:60f272b0-f7d2-408b-b99b-9bcfcd3f23ff for instance 864fcd9b-8e5b-4de8-a2e6-292a8907a834 on user Apr 11 19:44:15 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [req-2294e617-ea14-4a2a-8121-8cb3662ecb7e req-79472b61-164c-4c31-abe9-3d0395c8d027 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058180 Apr 11 19:44:15 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 308/941] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:44:15 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:44:49 user devstack@n-api.service[72089]: DEBUG dbcounter [-] [72089] Writing DB stats nova_api:SELECT=4 {{(pid=72089) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:44:49 user devstack@n-api.service[72089]: DEBUG dbcounter [-] [72089] Writing DB stats nova_cell1:SELECT=4 {{(pid=72089) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:44:49 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [None req-5fb35aea-9ca7-4d3d-b286-fd6cc539676d tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Calling method '>' {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:44:49 user devstack@n-api.service[72089]: DEBUG nova.compute.api [None req-5fb35aea-9ca7-4d3d-b286-fd6cc539676d tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] [instance: 6b110aaa-0f26-4bab-8f3e-d22edb5a5072] Fetching instance by UUID {{(pid=72089) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:44:49 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-5fb35aea-9ca7-4d3d-b286-fd6cc539676d tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:44:49 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-5fb35aea-9ca7-4d3d-b286-fd6cc539676d tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:44:49 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-5fb35aea-9ca7-4d3d-b286-fd6cc539676d tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:44:49 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-5fb35aea-9ca7-4d3d-b286-fd6cc539676d tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:44:49 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-5fb35aea-9ca7-4d3d-b286-fd6cc539676d tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:44:49 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-5fb35aea-9ca7-4d3d-b286-fd6cc539676d tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:44:49 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [None req-5fb35aea-9ca7-4d3d-b286-fd6cc539676d tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6b110aaa-0f26-4bab-8f3e-d22edb5a5072/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.051789 Apr 11 19:44:49 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 322/942] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Apr 11 19:44:49 2023] GET /compute/v2.1/servers/6b110aaa-0f26-4bab-8f3e-d22edb5a5072/os-volume_attachments => generated 25 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 11 19:44:51 user devstack@n-api.service[72090]: DEBUG dbcounter [-] [72090] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=72090) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:44:51 user devstack@n-api.service[72090]: DEBUG dbcounter [-] [72090] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=72090) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:44:51 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [None req-9ffb18b3-2224-47ff-8555-4e2981f625a3 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "873005bd-7295-415c-b38f-2b5d07bca963"}} {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:44:51 user devstack@n-api.service[72090]: DEBUG nova.compute.api [None req-9ffb18b3-2224-47ff-8555-4e2981f625a3 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] [instance: 6b110aaa-0f26-4bab-8f3e-d22edb5a5072] Fetching instance by UUID {{(pid=72090) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:44:51 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-9ffb18b3-2224-47ff-8555-4e2981f625a3 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:44:51 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-9ffb18b3-2224-47ff-8555-4e2981f625a3 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:44:51 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-9ffb18b3-2224-47ff-8555-4e2981f625a3 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:44:51 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-9ffb18b3-2224-47ff-8555-4e2981f625a3 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:44:51 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-9ffb18b3-2224-47ff-8555-4e2981f625a3 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:44:51 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-9ffb18b3-2224-47ff-8555-4e2981f625a3 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:44:51 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [None req-9ffb18b3-2224-47ff-8555-4e2981f625a3 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] 10.0.0.210 "POST /compute/v2.1/servers/6b110aaa-0f26-4bab-8f3e-d22edb5a5072/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.329319 Apr 11 19:44:51 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 313/943] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Apr 11 19:44:51 2023] POST /compute/v2.1/servers/6b110aaa-0f26-4bab-8f3e-d22edb5a5072/os-volume_attachments => generated 194 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:44:51 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [None req-c50ac294-4a03-45df-885a-734f3a220dd3 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Calling method '>' {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:44:51 user devstack@n-api.service[72088]: DEBUG nova.compute.api [None req-c50ac294-4a03-45df-885a-734f3a220dd3 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] [instance: bf0a75f5-2f44-4687-af12-046f6761fee2] Fetching instance by UUID {{(pid=72088) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:44:51 user devstack@n-api.service[72088]: DEBUG dbcounter [-] [72088] Writing DB stats nova_api:SELECT=6 {{(pid=72088) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:44:51 user devstack@n-api.service[72088]: DEBUG dbcounter [-] [72088] Writing DB stats nova_cell1:SELECT=8 {{(pid=72088) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:44:51 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-c50ac294-4a03-45df-885a-734f3a220dd3 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:44:51 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-c50ac294-4a03-45df-885a-734f3a220dd3 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:44:51 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-c50ac294-4a03-45df-885a-734f3a220dd3 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:44:51 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-c50ac294-4a03-45df-885a-734f3a220dd3 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:44:51 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-c50ac294-4a03-45df-885a-734f3a220dd3 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:44:51 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-c50ac294-4a03-45df-885a-734f3a220dd3 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:44:51 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [None req-c50ac294-4a03-45df-885a-734f3a220dd3 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bf0a75f5-2f44-4687-af12-046f6761fee2/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.077649 Apr 11 19:44:51 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 309/944] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Apr 11 19:44:51 2023] GET /compute/v2.1/servers/bf0a75f5-2f44-4687-af12-046f6761fee2/os-volume_attachments => generated 25 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 11 19:44:51 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [None req-84525690-5d3a-4ed2-9c11-d2f00141f29c tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Calling method '>' {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:44:51 user devstack@n-api.service[72089]: DEBUG nova.compute.api [None req-84525690-5d3a-4ed2-9c11-d2f00141f29c tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] [instance: bf0a75f5-2f44-4687-af12-046f6761fee2] Fetching instance by UUID {{(pid=72089) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:44:51 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-84525690-5d3a-4ed2-9c11-d2f00141f29c tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:44:51 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-84525690-5d3a-4ed2-9c11-d2f00141f29c tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:44:51 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-84525690-5d3a-4ed2-9c11-d2f00141f29c tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:44:51 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-84525690-5d3a-4ed2-9c11-d2f00141f29c tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:44:51 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-84525690-5d3a-4ed2-9c11-d2f00141f29c tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:44:51 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-84525690-5d3a-4ed2-9c11-d2f00141f29c tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:44:51 user devstack@n-api.service[72089]: DEBUG nova.compute.api [None req-84525690-5d3a-4ed2-9c11-d2f00141f29c tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] [instance: bf0a75f5-2f44-4687-af12-046f6761fee2] Going to try to terminate instance {{(pid=72089) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 11 19:44:52 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [None req-84525690-5d3a-4ed2-9c11-d2f00141f29c tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/bf0a75f5-2f44-4687-af12-046f6761fee2" status: 204 len: 0 microversion: 2.1 time: 0.117435 Apr 11 19:44:52 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 323/945] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 19:44:51 2023] DELETE /compute/v2.1/servers/bf0a75f5-2f44-4687-af12-046f6761fee2 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 11 19:44:52 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [None req-991747a9-4f8a-40f7-9746-5917c92e0036 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Calling method '>' {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:44:52 user devstack@n-api.service[72090]: DEBUG nova.compute.api [None req-991747a9-4f8a-40f7-9746-5917c92e0036 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] [instance: bf0a75f5-2f44-4687-af12-046f6761fee2] Fetching instance by UUID {{(pid=72090) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:44:52 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-991747a9-4f8a-40f7-9746-5917c92e0036 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:44:52 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-991747a9-4f8a-40f7-9746-5917c92e0036 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:44:52 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-991747a9-4f8a-40f7-9746-5917c92e0036 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:44:52 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-991747a9-4f8a-40f7-9746-5917c92e0036 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:44:52 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-991747a9-4f8a-40f7-9746-5917c92e0036 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:44:52 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-991747a9-4f8a-40f7-9746-5917c92e0036 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:44:52 user devstack@n-api.service[72090]: DEBUG nova.policy [None req-991747a9-4f8a-40f7-9746-5917c92e0036 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba7f82b529e74d99838b6264b94d823b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e3a291c54b49db8e12a88ba41865e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72090) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:44:52 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [None req-991747a9-4f8a-40f7-9746-5917c92e0036 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bf0a75f5-2f44-4687-af12-046f6761fee2" status: 200 len: 1679 microversion: 2.1 time: 0.193917 Apr 11 19:44:52 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 314/946] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 19:44:52 2023] GET /compute/v2.1/servers/bf0a75f5-2f44-4687-af12-046f6761fee2 => generated 1679 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:44:52 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [None req-e96cca6a-9c2a-4ede-b638-8328c9d33432 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Calling method '>' {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:44:52 user devstack@n-api.service[72088]: DEBUG nova.compute.api [None req-e96cca6a-9c2a-4ede-b638-8328c9d33432 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] [instance: f633037d-87d0-4dda-aa33-3cc9c3191080] Fetching instance by UUID {{(pid=72088) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:44:52 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-e96cca6a-9c2a-4ede-b638-8328c9d33432 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:44:52 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-e96cca6a-9c2a-4ede-b638-8328c9d33432 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:44:52 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-e96cca6a-9c2a-4ede-b638-8328c9d33432 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:44:52 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-e96cca6a-9c2a-4ede-b638-8328c9d33432 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:44:52 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-e96cca6a-9c2a-4ede-b638-8328c9d33432 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:44:52 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [req-0c537dee-51ce-483a-821d-d7603b50de5e req-bc48195e-5662-4479-8cce-cb9558cfc8c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf0a75f5-2f44-4687-af12-046f6761fee2", "name": "network-vif-unplugged", "status": "completed", "tag": "c662b1b3-b2b3-4502-81af-9afdf3e591dc"}]} {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:44:52 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-e96cca6a-9c2a-4ede-b638-8328c9d33432 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:44:52 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-0c537dee-51ce-483a-821d-d7603b50de5e req-bc48195e-5662-4479-8cce-cb9558cfc8c4 service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:44:52 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-0c537dee-51ce-483a-821d-d7603b50de5e req-bc48195e-5662-4479-8cce-cb9558cfc8c4 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:44:52 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-0c537dee-51ce-483a-821d-d7603b50de5e req-bc48195e-5662-4479-8cce-cb9558cfc8c4 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:44:52 user devstack@n-api.service[72089]: INFO nova.api.openstack.compute.server_external_events [req-0c537dee-51ce-483a-821d-d7603b50de5e req-bc48195e-5662-4479-8cce-cb9558cfc8c4 service nova] Creating event network-vif-unplugged:c662b1b3-b2b3-4502-81af-9afdf3e591dc for instance bf0a75f5-2f44-4687-af12-046f6761fee2 on user Apr 11 19:44:52 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [req-0c537dee-51ce-483a-821d-d7603b50de5e req-bc48195e-5662-4479-8cce-cb9558cfc8c4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036891 Apr 11 19:44:52 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 324/947] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:44:52 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:44:52 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [None req-e96cca6a-9c2a-4ede-b638-8328c9d33432 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f633037d-87d0-4dda-aa33-3cc9c3191080/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.114666 Apr 11 19:44:52 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 310/948] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Apr 11 19:44:52 2023] GET /compute/v2.1/servers/f633037d-87d0-4dda-aa33-3cc9c3191080/os-interface => generated 282 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:44:53 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [req-b860e793-ce52-48ba-86c3-eae4faa70acf req-0df15f67-1676-4cfd-927f-046eb795cab2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "478eb884-ba19-4a4b-b1eb-a2e59d6beef0", "tag": "91ef79db-4548-423d-9022-b88dd7608438"}]} {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:44:53 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-b860e793-ce52-48ba-86c3-eae4faa70acf req-0df15f67-1676-4cfd-927f-046eb795cab2 service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:44:53 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-b860e793-ce52-48ba-86c3-eae4faa70acf req-0df15f67-1676-4cfd-927f-046eb795cab2 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:44:53 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-b860e793-ce52-48ba-86c3-eae4faa70acf req-0df15f67-1676-4cfd-927f-046eb795cab2 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:44:53 user devstack@n-api.service[72090]: INFO nova.api.openstack.compute.server_external_events [req-b860e793-ce52-48ba-86c3-eae4faa70acf req-0df15f67-1676-4cfd-927f-046eb795cab2 service nova] Creating event network-changed:91ef79db-4548-423d-9022-b88dd7608438 for instance 478eb884-ba19-4a4b-b1eb-a2e59d6beef0 on user Apr 11 19:44:53 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [req-b860e793-ce52-48ba-86c3-eae4faa70acf req-0df15f67-1676-4cfd-927f-046eb795cab2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038180 Apr 11 19:44:53 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 315/949] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:44:53 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:44:53 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [None req-b7fd18e5-6ed6-491e-9afb-1169f35440df tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Calling method '>' {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:44:53 user devstack@n-api.service[72089]: DEBUG nova.compute.api [None req-b7fd18e5-6ed6-491e-9afb-1169f35440df tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] [instance: f633037d-87d0-4dda-aa33-3cc9c3191080] Fetching instance by UUID {{(pid=72089) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:44:53 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-b7fd18e5-6ed6-491e-9afb-1169f35440df tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:44:53 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-b7fd18e5-6ed6-491e-9afb-1169f35440df tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:44:53 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-b7fd18e5-6ed6-491e-9afb-1169f35440df tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:44:53 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-b7fd18e5-6ed6-491e-9afb-1169f35440df tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:44:53 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-b7fd18e5-6ed6-491e-9afb-1169f35440df tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:44:53 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-b7fd18e5-6ed6-491e-9afb-1169f35440df tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:44:54 user devstack@n-api.service[72089]: DEBUG nova.policy [None req-b7fd18e5-6ed6-491e-9afb-1169f35440df tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05fb551c320a48f98a4ec00a7f7492d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60a7381a31b84e97a068528f90813773', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72089) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:44:54 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [None req-b7fd18e5-6ed6-491e-9afb-1169f35440df tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f633037d-87d0-4dda-aa33-3cc9c3191080" status: 200 len: 1427 microversion: 2.1 time: 0.272647 Apr 11 19:44:54 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 325/950] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 19:44:53 2023] GET /compute/v2.1/servers/f633037d-87d0-4dda-aa33-3cc9c3191080 => generated 1427 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:44:54 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [None req-9dbc72c5-f5ae-4ab2-ba00-c7e4463ab8db tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "84"}} {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:44:54 user devstack@n-api.service[72088]: DEBUG nova.compute.api [None req-9dbc72c5-f5ae-4ab2-ba00-c7e4463ab8db tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] [instance: f633037d-87d0-4dda-aa33-3cc9c3191080] Fetching instance by UUID {{(pid=72088) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:44:54 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-9dbc72c5-f5ae-4ab2-ba00-c7e4463ab8db tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:44:54 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-9dbc72c5-f5ae-4ab2-ba00-c7e4463ab8db tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:44:54 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-9dbc72c5-f5ae-4ab2-ba00-c7e4463ab8db tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:44:54 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-9dbc72c5-f5ae-4ab2-ba00-c7e4463ab8db tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:44:54 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-9dbc72c5-f5ae-4ab2-ba00-c7e4463ab8db tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:44:54 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-9dbc72c5-f5ae-4ab2-ba00-c7e4463ab8db tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:44:54 user devstack@n-api.service[72088]: DEBUG nova.policy [None req-9dbc72c5-f5ae-4ab2-ba00-c7e4463ab8db tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '05fb551c320a48f98a4ec00a7f7492d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60a7381a31b84e97a068528f90813773', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72088) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:44:54 user devstack@n-api.service[72088]: DEBUG nova.compute.api [None req-9dbc72c5-f5ae-4ab2-ba00-c7e4463ab8db tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] [instance: f633037d-87d0-4dda-aa33-3cc9c3191080] Old instance type m1.nano, new instance type m1.micro {{(pid=72088) resize /opt/stack/nova/nova/compute/api.py:4223}} Apr 11 19:44:54 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-9dbc72c5-f5ae-4ab2-ba00-c7e4463ab8db tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:44:54 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-9dbc72c5-f5ae-4ab2-ba00-c7e4463ab8db tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:44:54 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-9dbc72c5-f5ae-4ab2-ba00-c7e4463ab8db tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:44:54 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-9dbc72c5-f5ae-4ab2-ba00-c7e4463ab8db tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:44:54 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-9dbc72c5-f5ae-4ab2-ba00-c7e4463ab8db tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:44:54 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-9dbc72c5-f5ae-4ab2-ba00-c7e4463ab8db tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:44:54 user devstack@n-api.service[72088]: DEBUG nova.quota [None req-9dbc72c5-f5ae-4ab2-ba00-c7e4463ab8db tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Getting quotas for project 60a7381a31b84e97a068528f90813773. Resources: {'ram', 'cores'} {{(pid=72088) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 19:44:54 user devstack@n-api.service[72088]: DEBUG nova.quota [None req-9dbc72c5-f5ae-4ab2-ba00-c7e4463ab8db tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Getting quotas for user 05fb551c320a48f98a4ec00a7f7492d7 and project 60a7381a31b84e97a068528f90813773. Resources: {'ram', 'cores'} {{(pid=72088) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 19:44:54 user devstack@n-api.service[72088]: DEBUG nova.virt.hardware [None req-9dbc72c5-f5ae-4ab2-ba00-c7e4463ab8db tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Flavor limits 0:0:0 {{(pid=72088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 19:44:54 user devstack@n-api.service[72088]: DEBUG nova.virt.hardware [None req-9dbc72c5-f5ae-4ab2-ba00-c7e4463ab8db tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Image limits 0:0:0 {{(pid=72088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 19:44:54 user devstack@n-api.service[72088]: DEBUG nova.virt.hardware [None req-9dbc72c5-f5ae-4ab2-ba00-c7e4463ab8db tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Flavor pref 0:0:0 {{(pid=72088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 19:44:54 user devstack@n-api.service[72088]: DEBUG nova.virt.hardware [None req-9dbc72c5-f5ae-4ab2-ba00-c7e4463ab8db tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Image pref 0:0:0 {{(pid=72088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 19:44:54 user devstack@n-api.service[72088]: DEBUG nova.virt.hardware [None req-9dbc72c5-f5ae-4ab2-ba00-c7e4463ab8db tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 19:44:54 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [req-c5fc07fd-0737-42e0-a3fe-060d56dfe553 req-fa9fad0b-ee73-4d2e-8f05-3e42717c6680 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf0a75f5-2f44-4687-af12-046f6761fee2", "name": "network-vif-plugged", "status": "completed", "tag": "c662b1b3-b2b3-4502-81af-9afdf3e591dc"}]} {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:44:54 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [None req-9dbc72c5-f5ae-4ab2-ba00-c7e4463ab8db tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] 10.0.0.210 "POST /compute/v2.1/servers/f633037d-87d0-4dda-aa33-3cc9c3191080/action" status: 202 len: 0 microversion: 2.1 time: 0.325080 Apr 11 19:44:54 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 311/951] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Apr 11 19:44:54 2023] POST /compute/v2.1/servers/f633037d-87d0-4dda-aa33-3cc9c3191080/action => generated 0 bytes in 326 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 19:44:54 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-c5fc07fd-0737-42e0-a3fe-060d56dfe553 req-fa9fad0b-ee73-4d2e-8f05-3e42717c6680 service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:44:54 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [None req-dd05c501-597f-4ad3-a8af-451424a8e602 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Calling method '>' {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:44:54 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-c5fc07fd-0737-42e0-a3fe-060d56dfe553 req-fa9fad0b-ee73-4d2e-8f05-3e42717c6680 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:44:54 user devstack@n-api.service[72089]: DEBUG nova.compute.api [None req-dd05c501-597f-4ad3-a8af-451424a8e602 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] [instance: f633037d-87d0-4dda-aa33-3cc9c3191080] Fetching instance by UUID {{(pid=72089) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:44:54 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-c5fc07fd-0737-42e0-a3fe-060d56dfe553 req-fa9fad0b-ee73-4d2e-8f05-3e42717c6680 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:44:54 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-dd05c501-597f-4ad3-a8af-451424a8e602 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:44:54 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-dd05c501-597f-4ad3-a8af-451424a8e602 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:44:54 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-dd05c501-597f-4ad3-a8af-451424a8e602 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:44:54 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-dd05c501-597f-4ad3-a8af-451424a8e602 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:44:54 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-dd05c501-597f-4ad3-a8af-451424a8e602 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:44:54 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-dd05c501-597f-4ad3-a8af-451424a8e602 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:44:54 user devstack@n-api.service[72090]: INFO nova.api.openstack.compute.server_external_events [req-c5fc07fd-0737-42e0-a3fe-060d56dfe553 req-fa9fad0b-ee73-4d2e-8f05-3e42717c6680 service nova] Creating event network-vif-plugged:c662b1b3-b2b3-4502-81af-9afdf3e591dc for instance bf0a75f5-2f44-4687-af12-046f6761fee2 on user Apr 11 19:44:54 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [req-c5fc07fd-0737-42e0-a3fe-060d56dfe553 req-fa9fad0b-ee73-4d2e-8f05-3e42717c6680 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038815 Apr 11 19:44:54 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 316/952] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:44:54 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 11 19:44:54 user devstack@n-api.service[72089]: DEBUG nova.policy [None req-dd05c501-597f-4ad3-a8af-451424a8e602 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05fb551c320a48f98a4ec00a7f7492d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60a7381a31b84e97a068528f90813773', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72089) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:44:54 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [None req-dd05c501-597f-4ad3-a8af-451424a8e602 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f633037d-87d0-4dda-aa33-3cc9c3191080" status: 200 len: 1436 microversion: 2.1 time: 0.167330 Apr 11 19:44:54 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 326/953] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 19:44:54 2023] GET /compute/v2.1/servers/f633037d-87d0-4dda-aa33-3cc9c3191080 => generated 1436 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:44:55 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [req-fb0635a1-168b-412c-b6ed-7709a7a9a8d4 req-9331bd17-1e61-4a6e-9fb4-2f836b0f4d64 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f633037d-87d0-4dda-aa33-3cc9c3191080", "tag": "c3ef7018-189c-423e-b92b-b2b4a98dafce"}, {"server_uuid": "bf0a75f5-2f44-4687-af12-046f6761fee2", "name": "network-vif-deleted", "tag": "c662b1b3-b2b3-4502-81af-9afdf3e591dc"}]} {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:44:55 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-fb0635a1-168b-412c-b6ed-7709a7a9a8d4 req-9331bd17-1e61-4a6e-9fb4-2f836b0f4d64 service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:44:55 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-fb0635a1-168b-412c-b6ed-7709a7a9a8d4 req-9331bd17-1e61-4a6e-9fb4-2f836b0f4d64 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:44:55 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-fb0635a1-168b-412c-b6ed-7709a7a9a8d4 req-9331bd17-1e61-4a6e-9fb4-2f836b0f4d64 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:44:55 user devstack@n-api.service[72088]: INFO nova.api.openstack.compute.server_external_events [req-fb0635a1-168b-412c-b6ed-7709a7a9a8d4 req-9331bd17-1e61-4a6e-9fb4-2f836b0f4d64 service nova] Creating event network-changed:c3ef7018-189c-423e-b92b-b2b4a98dafce for instance f633037d-87d0-4dda-aa33-3cc9c3191080 on user Apr 11 19:44:55 user devstack@n-api.service[72088]: INFO nova.api.openstack.compute.server_external_events [req-fb0635a1-168b-412c-b6ed-7709a7a9a8d4 req-9331bd17-1e61-4a6e-9fb4-2f836b0f4d64 service nova] Creating event network-vif-deleted:c662b1b3-b2b3-4502-81af-9afdf3e591dc for instance bf0a75f5-2f44-4687-af12-046f6761fee2 on user Apr 11 19:44:55 user devstack@n-api.service[72088]: DEBUG nova.compute.api [req-fb0635a1-168b-412c-b6ed-7709a7a9a8d4 req-9331bd17-1e61-4a6e-9fb4-2f836b0f4d64 service nova] Instance f633037d-87d0-4dda-aa33-3cc9c3191080 is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=72088) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 11 19:44:55 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [req-fb0635a1-168b-412c-b6ed-7709a7a9a8d4 req-9331bd17-1e61-4a6e-9fb4-2f836b0f4d64 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.053890 Apr 11 19:44:55 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 312/954] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:44:55 2023] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:44:57 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [req-b1cc13e2-5834-4346-9841-3579bdf566fe req-13515d71-6e39-4cf1-8ba8-e56e7f1f990e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f633037d-87d0-4dda-aa33-3cc9c3191080", "name": "network-vif-unplugged", "status": "completed", "tag": "c3ef7018-189c-423e-b92b-b2b4a98dafce"}]} {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:44:57 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-b1cc13e2-5834-4346-9841-3579bdf566fe req-13515d71-6e39-4cf1-8ba8-e56e7f1f990e service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:44:57 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-b1cc13e2-5834-4346-9841-3579bdf566fe req-13515d71-6e39-4cf1-8ba8-e56e7f1f990e service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:44:57 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-b1cc13e2-5834-4346-9841-3579bdf566fe req-13515d71-6e39-4cf1-8ba8-e56e7f1f990e service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:44:57 user devstack@n-api.service[72090]: INFO nova.api.openstack.compute.server_external_events [req-b1cc13e2-5834-4346-9841-3579bdf566fe req-13515d71-6e39-4cf1-8ba8-e56e7f1f990e service nova] Creating event network-vif-unplugged:c3ef7018-189c-423e-b92b-b2b4a98dafce for instance f633037d-87d0-4dda-aa33-3cc9c3191080 on user Apr 11 19:44:57 user devstack@n-api.service[72090]: DEBUG nova.compute.api [req-b1cc13e2-5834-4346-9841-3579bdf566fe req-13515d71-6e39-4cf1-8ba8-e56e7f1f990e service nova] Instance f633037d-87d0-4dda-aa33-3cc9c3191080 is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=72090) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 11 19:44:57 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [req-b1cc13e2-5834-4346-9841-3579bdf566fe req-13515d71-6e39-4cf1-8ba8-e56e7f1f990e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.096558 Apr 11 19:44:57 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 317/955] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:44:57 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:44:59 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [req-100b8cf8-9a5f-483a-9d89-7c126bb0cd6e req-db1e67da-9928-4696-9192-2b102fa6c70c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f633037d-87d0-4dda-aa33-3cc9c3191080", "name": "network-vif-plugged", "status": "completed", "tag": "c3ef7018-189c-423e-b92b-b2b4a98dafce"}]} {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:44:59 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-100b8cf8-9a5f-483a-9d89-7c126bb0cd6e req-db1e67da-9928-4696-9192-2b102fa6c70c service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:44:59 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-100b8cf8-9a5f-483a-9d89-7c126bb0cd6e req-db1e67da-9928-4696-9192-2b102fa6c70c service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:44:59 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-100b8cf8-9a5f-483a-9d89-7c126bb0cd6e req-db1e67da-9928-4696-9192-2b102fa6c70c service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:44:59 user devstack@n-api.service[72089]: INFO nova.api.openstack.compute.server_external_events [req-100b8cf8-9a5f-483a-9d89-7c126bb0cd6e req-db1e67da-9928-4696-9192-2b102fa6c70c service nova] Creating event network-vif-plugged:c3ef7018-189c-423e-b92b-b2b4a98dafce for instance f633037d-87d0-4dda-aa33-3cc9c3191080 on user Apr 11 19:44:59 user devstack@n-api.service[72089]: DEBUG nova.compute.api [req-100b8cf8-9a5f-483a-9d89-7c126bb0cd6e req-db1e67da-9928-4696-9192-2b102fa6c70c service nova] Instance f633037d-87d0-4dda-aa33-3cc9c3191080 is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=72089) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 11 19:44:59 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [req-100b8cf8-9a5f-483a-9d89-7c126bb0cd6e req-db1e67da-9928-4696-9192-2b102fa6c70c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038183 Apr 11 19:44:59 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 327/956] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:44:59 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:44:59 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [None req-e4905172-fc11-4a1d-88a8-1b529262815d tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Calling method '>' {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:44:59 user devstack@n-api.service[72088]: DEBUG nova.compute.api [None req-e4905172-fc11-4a1d-88a8-1b529262815d tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] [instance: 6b110aaa-0f26-4bab-8f3e-d22edb5a5072] Fetching instance by UUID {{(pid=72088) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:44:59 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-e4905172-fc11-4a1d-88a8-1b529262815d tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:44:59 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-e4905172-fc11-4a1d-88a8-1b529262815d tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:44:59 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-e4905172-fc11-4a1d-88a8-1b529262815d tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:44:59 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-e4905172-fc11-4a1d-88a8-1b529262815d tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:44:59 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-e4905172-fc11-4a1d-88a8-1b529262815d tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:44:59 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-e4905172-fc11-4a1d-88a8-1b529262815d tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:44:59 user devstack@n-api.service[72088]: DEBUG nova.objects.instance [None req-e4905172-fc11-4a1d-88a8-1b529262815d tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Lazy-loading 'services' on Instance uuid 6b110aaa-0f26-4bab-8f3e-d22edb5a5072 {{(pid=72088) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 11 19:44:59 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [None req-e4905172-fc11-4a1d-88a8-1b529262815d tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/6b110aaa-0f26-4bab-8f3e-d22edb5a5072/os-volume_attachments/873005bd-7295-415c-b38f-2b5d07bca963" status: 202 len: 0 microversion: 2.1 time: 0.163333 Apr 11 19:44:59 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 313/957] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Apr 11 19:44:59 2023] DELETE /compute/v2.1/servers/6b110aaa-0f26-4bab-8f3e-d22edb5a5072/os-volume_attachments/873005bd-7295-415c-b38f-2b5d07bca963 => generated 0 bytes in 165 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 19:44:59 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [None req-4380f5c9-8c41-4cfd-ab13-2fe816dd5482 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Calling method '>' {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:44:59 user devstack@n-api.service[72090]: DEBUG nova.compute.api [None req-4380f5c9-8c41-4cfd-ab13-2fe816dd5482 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] [instance: 6b110aaa-0f26-4bab-8f3e-d22edb5a5072] Fetching instance by UUID {{(pid=72090) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:44:59 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-4380f5c9-8c41-4cfd-ab13-2fe816dd5482 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:44:59 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-4380f5c9-8c41-4cfd-ab13-2fe816dd5482 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:44:59 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-4380f5c9-8c41-4cfd-ab13-2fe816dd5482 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:44:59 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-4380f5c9-8c41-4cfd-ab13-2fe816dd5482 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:44:59 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-4380f5c9-8c41-4cfd-ab13-2fe816dd5482 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:44:59 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-4380f5c9-8c41-4cfd-ab13-2fe816dd5482 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:44:59 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [None req-4380f5c9-8c41-4cfd-ab13-2fe816dd5482 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6b110aaa-0f26-4bab-8f3e-d22edb5a5072/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047804 Apr 11 19:44:59 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 318/958] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Apr 11 19:44:59 2023] GET /compute/v2.1/servers/6b110aaa-0f26-4bab-8f3e-d22edb5a5072/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:45:02 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [None req-4345d2cc-5a0d-43a8-a202-f0cef2c23ec9 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Calling method '>' {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:45:02 user devstack@n-api.service[72089]: DEBUG nova.compute.api [None req-4345d2cc-5a0d-43a8-a202-f0cef2c23ec9 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] [instance: a66c1d51-e194-424d-a37c-d308544774c6] Fetching instance by UUID {{(pid=72089) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:45:02 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-4345d2cc-5a0d-43a8-a202-f0cef2c23ec9 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:45:02 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-4345d2cc-5a0d-43a8-a202-f0cef2c23ec9 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:45:02 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-4345d2cc-5a0d-43a8-a202-f0cef2c23ec9 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:45:02 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-4345d2cc-5a0d-43a8-a202-f0cef2c23ec9 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:45:02 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-4345d2cc-5a0d-43a8-a202-f0cef2c23ec9 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:45:02 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-4345d2cc-5a0d-43a8-a202-f0cef2c23ec9 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:45:03 user devstack@n-api.service[72089]: DEBUG nova.policy [None req-4345d2cc-5a0d-43a8-a202-f0cef2c23ec9 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf262cd03f4a41c4956d8784cf37d86d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caba0618fc743e7bfb2dd866a511df9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72089) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:45:03 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [None req-4345d2cc-5a0d-43a8-a202-f0cef2c23ec9 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a66c1d51-e194-424d-a37c-d308544774c6" status: 200 len: 1440 microversion: 2.1 time: 0.149338 Apr 11 19:45:03 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 328/959] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 19:45:02 2023] GET /compute/v2.1/servers/a66c1d51-e194-424d-a37c-d308544774c6 => generated 1440 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:45:03 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [None req-8da7f807-3de8-44d4-b0d2-b5bbc7d45f22 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Calling method '>' {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:45:03 user devstack@n-api.service[72088]: DEBUG nova.compute.api [None req-8da7f807-3de8-44d4-b0d2-b5bbc7d45f22 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] [instance: 864fcd9b-8e5b-4de8-a2e6-292a8907a834] Fetching instance by UUID {{(pid=72088) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:45:03 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-8da7f807-3de8-44d4-b0d2-b5bbc7d45f22 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:45:03 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-8da7f807-3de8-44d4-b0d2-b5bbc7d45f22 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:45:03 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-8da7f807-3de8-44d4-b0d2-b5bbc7d45f22 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:45:03 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-8da7f807-3de8-44d4-b0d2-b5bbc7d45f22 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:45:03 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-8da7f807-3de8-44d4-b0d2-b5bbc7d45f22 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:45:03 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-8da7f807-3de8-44d4-b0d2-b5bbc7d45f22 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:45:03 user devstack@n-api.service[72088]: INFO nova.api.openstack.wsgi [None req-8da7f807-3de8-44d4-b0d2-b5bbc7d45f22 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] HTTP exception thrown: Instance 864fcd9b-8e5b-4de8-a2e6-292a8907a834 could not be found. Apr 11 19:45:03 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [None req-8da7f807-3de8-44d4-b0d2-b5bbc7d45f22 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Request method failure captured: Apr 11 19:45:03 user devstack@n-api.service[72088]: request: GET /compute/v2.1/servers/864fcd9b-8e5b-4de8-a2e6-292a8907a834 HTTP/1.1 Apr 11 19:45:03 user devstack@n-api.service[72088]: Accept: application/json Apr 11 19:45:03 user devstack@n-api.service[72088]: Accept-Encoding: identity Apr 11 19:45:03 user devstack@n-api.service[72088]: Connection: close Apr 11 19:45:03 user devstack@n-api.service[72088]: Content-Length: 0 Apr 11 19:45:03 user devstack@n-api.service[72088]: Content-Type: application/json Apr 11 19:45:03 user devstack@n-api.service[72088]: Host: 10.0.0.210 Apr 11 19:45:03 user devstack@n-api.service[72088]: Openstack-System-Scope: None Apr 11 19:45:03 user devstack@n-api.service[72088]: User-Agent: python-urllib3/1.26.15 Apr 11 19:45:03 user devstack@n-api.service[72088]: X-Auth-Token: gAAAAABkNbQnEMwb9bokVGqy8IBkwGOZTlbefW9-gCGma1Q9aMCf7rErAs3NuXcPCnuWAMFMb4o5vJ-bB4xPFTn6y2WKU9I0pItmZHu7i_RppKkEiULwNqNywUZ2M-d73QMTy5dW3-OZVF1Bf-qwJagrp481OxGYQGqOEgWnBHPks1h4PLepPQA Apr 11 19:45:03 user devstack@n-api.service[72088]: X-Domain-Id: None Apr 11 19:45:03 user devstack@n-api.service[72088]: X-Domain-Name: None Apr 11 19:45:03 user devstack@n-api.service[72088]: X-Identity-Status: Confirmed Apr 11 19:45:03 user devstack@n-api.service[72088]: X-Is-Admin-Project: True Apr 11 19:45:03 user devstack@n-api.service[72088]: X-Openstack-Nova-Api-Version: 2.87 Apr 11 19:45:03 user devstack@n-api.service[72088]: X-Project-Domain-Id: default Apr 11 19:45:03 user devstack@n-api.service[72088]: X-Project-Domain-Name: Default Apr 11 19:45:03 user devstack@n-api.service[72088]: X-Project-Id: eb91586feb3f4a4c84fa8c2183baaf8c Apr 11 19:45:03 user devstack@n-api.service[72088]: X-Project-Name: tempest-ServerBootFromVolumeStableRescueTest-863156619 Apr 11 19:45:03 user devstack@n-api.service[72088]: X-Role: reader,member Apr 11 19:45:03 user devstack@n-api.service[72088]: X-Roles: reader,member Apr 11 19:45:03 user devstack@n-api.service[72088]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/eb91586feb3f4a4c84fa8c2183baaf8c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/eb91586feb3f4a4c84fa8c2183baaf8c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/eb91586feb3f4a4c84fa8c2183baaf8c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 11 19:45:03 user devstack@n-api.service[72088]: X-Tenant: tempest-ServerBootFromVolumeStableRescueTest-863156619 Apr 11 19:45:03 user devstack@n-api.service[72088]: X-Tenant-Id: eb91586feb3f4a4c84fa8c2183baaf8c Apr 11 19:45:03 user devstack@n-api.service[72088]: X-Tenant-Name: tempest-ServerBootFromVolumeStableRescueTest-863156619 Apr 11 19:45:03 user devstack@n-api.service[72088]: X-User: tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member Apr 11 19:45:03 user devstack@n-api.service[72088]: X-User-Domain-Id: default Apr 11 19:45:03 user devstack@n-api.service[72088]: X-User-Domain-Name: Default Apr 11 19:45:03 user devstack@n-api.service[72088]: X-User-Id: 1b3adca432b04d70818a51d1366f5c6d Apr 11 19:45:03 user devstack@n-api.service[72088]: X-User-Name: tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member Apr 11 19:45:03 user devstack@n-api.service[72088]: method: > Apr 11 19:45:03 user devstack@n-api.service[72088]: exception: Instance 864fcd9b-8e5b-4de8-a2e6-292a8907a834 could not be found. Apr 11 19:45:03 user devstack@n-api.service[72088]: action_args: {'id': '864fcd9b-8e5b-4de8-a2e6-292a8907a834'} Apr 11 19:45:03 user devstack@n-api.service[72088]: {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 19:45:03 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:45:03 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 19:45:03 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 19:45:03 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 19:45:03 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 19:45:03 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 19:45:03 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 19:45:03 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 19:45:03 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 19:45:03 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 864fcd9b-8e5b-4de8-a2e6-292a8907a834 could not be found. Apr 11 19:45:03 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi Apr 11 19:45:03 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 19:45:03 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi Apr 11 19:45:03 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:45:03 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 19:45:03 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 19:45:03 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 19:45:03 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 19:45:03 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 19:45:03 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 19:45:03 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 19:45:03 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 19:45:03 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 19:45:03 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 19:45:03 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 19:45:03 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 19:45:03 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 864fcd9b-8e5b-4de8-a2e6-292a8907a834 could not be found. Apr 11 19:45:03 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi Apr 11 19:45:03 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 19:45:03 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi Apr 11 19:45:03 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:45:03 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 19:45:03 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 19:45:03 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 19:45:03 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 19:45:03 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 864fcd9b-8e5b-4de8-a2e6-292a8907a834 could not be found. Apr 11 19:45:03 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi Apr 11 19:45:03 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [None req-8da7f807-3de8-44d4-b0d2-b5bbc7d45f22 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Returning 404 to user: Instance 864fcd9b-8e5b-4de8-a2e6-292a8907a834 could not be found. {{(pid=72088) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 19:45:03 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [None req-8da7f807-3de8-44d4-b0d2-b5bbc7d45f22 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] 10.0.0.210 "GET /compute/v2.1/servers/864fcd9b-8e5b-4de8-a2e6-292a8907a834" status: 404 len: 111 microversion: 2.87 time: 0.029840 Apr 11 19:45:03 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 314/960] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 19:45:03 2023] GET /compute/v2.1/servers/864fcd9b-8e5b-4de8-a2e6-292a8907a834 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 11 19:45:04 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [None req-c9f03171-85a5-44c7-aca3-a66759a22c8d tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Calling method '>' {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:45:04 user devstack@n-api.service[72090]: DEBUG nova.compute.api [None req-c9f03171-85a5-44c7-aca3-a66759a22c8d tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] [instance: 9e2d23e8-2d2e-4b3e-94d8-01b17242dac5] Fetching instance by UUID {{(pid=72090) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:45:04 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-c9f03171-85a5-44c7-aca3-a66759a22c8d tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:45:04 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-c9f03171-85a5-44c7-aca3-a66759a22c8d tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:45:04 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-c9f03171-85a5-44c7-aca3-a66759a22c8d tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:45:04 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-c9f03171-85a5-44c7-aca3-a66759a22c8d tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:45:04 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-c9f03171-85a5-44c7-aca3-a66759a22c8d tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:45:04 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-c9f03171-85a5-44c7-aca3-a66759a22c8d tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:45:04 user devstack@n-api.service[72090]: DEBUG nova.compute.api [None req-c9f03171-85a5-44c7-aca3-a66759a22c8d tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] [instance: 9e2d23e8-2d2e-4b3e-94d8-01b17242dac5] Going to try to terminate instance {{(pid=72090) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 11 19:45:04 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [None req-c9f03171-85a5-44c7-aca3-a66759a22c8d tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/9e2d23e8-2d2e-4b3e-94d8-01b17242dac5" status: 204 len: 0 microversion: 2.87 time: 0.131290 Apr 11 19:45:04 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 319/961] 10.0.0.210 () {64 vars in 1357 bytes} [Tue Apr 11 19:45:04 2023] DELETE /compute/v2.1/servers/9e2d23e8-2d2e-4b3e-94d8-01b17242dac5 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 11 19:45:04 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [None req-40d2e4aa-07cf-4541-a465-6ee868521652 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Calling method '>' {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:45:04 user devstack@n-api.service[72089]: DEBUG nova.compute.api [None req-40d2e4aa-07cf-4541-a465-6ee868521652 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] [instance: 9e2d23e8-2d2e-4b3e-94d8-01b17242dac5] Fetching instance by UUID {{(pid=72089) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:45:04 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-40d2e4aa-07cf-4541-a465-6ee868521652 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:45:04 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-40d2e4aa-07cf-4541-a465-6ee868521652 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:45:04 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-40d2e4aa-07cf-4541-a465-6ee868521652 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:45:04 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-40d2e4aa-07cf-4541-a465-6ee868521652 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:45:04 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-40d2e4aa-07cf-4541-a465-6ee868521652 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:45:04 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-40d2e4aa-07cf-4541-a465-6ee868521652 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:45:04 user devstack@n-api.service[72089]: DEBUG nova.policy [None req-40d2e4aa-07cf-4541-a465-6ee868521652 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b3adca432b04d70818a51d1366f5c6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb91586feb3f4a4c84fa8c2183baaf8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72089) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:45:04 user devstack@n-api.service[72089]: DEBUG nova.policy [None req-40d2e4aa-07cf-4541-a465-6ee868521652 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b3adca432b04d70818a51d1366f5c6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb91586feb3f4a4c84fa8c2183baaf8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72089) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:45:04 user devstack@n-api.service[72089]: DEBUG nova.policy [None req-40d2e4aa-07cf-4541-a465-6ee868521652 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b3adca432b04d70818a51d1366f5c6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb91586feb3f4a4c84fa8c2183baaf8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72089) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:45:04 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [None req-40d2e4aa-07cf-4541-a465-6ee868521652 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9e2d23e8-2d2e-4b3e-94d8-01b17242dac5" status: 200 len: 1696 microversion: 2.87 time: 0.227813 Apr 11 19:45:04 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 329/962] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 19:45:04 2023] GET /compute/v2.1/servers/9e2d23e8-2d2e-4b3e-94d8-01b17242dac5 => generated 1696 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 19:45:04 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [req-12178263-f359-4f8d-b4e8-0f42cf04e67d req-773037e0-f067-449f-afb2-dc8204a40ef5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e2d23e8-2d2e-4b3e-94d8-01b17242dac5", "name": "network-vif-unplugged", "status": "completed", "tag": "8c77eb6a-6186-4c87-9e30-48420d525f90"}]} {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:45:04 user devstack@n-api.service[72088]: DEBUG dbcounter [-] [72088] Writing DB stats nova_cell0:SELECT=3 {{(pid=72088) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:45:04 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-12178263-f359-4f8d-b4e8-0f42cf04e67d req-773037e0-f067-449f-afb2-dc8204a40ef5 service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:45:04 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-12178263-f359-4f8d-b4e8-0f42cf04e67d req-773037e0-f067-449f-afb2-dc8204a40ef5 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:45:04 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-12178263-f359-4f8d-b4e8-0f42cf04e67d req-773037e0-f067-449f-afb2-dc8204a40ef5 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:45:04 user devstack@n-api.service[72088]: INFO nova.api.openstack.compute.server_external_events [req-12178263-f359-4f8d-b4e8-0f42cf04e67d req-773037e0-f067-449f-afb2-dc8204a40ef5 service nova] Creating event network-vif-unplugged:8c77eb6a-6186-4c87-9e30-48420d525f90 for instance 9e2d23e8-2d2e-4b3e-94d8-01b17242dac5 on user Apr 11 19:45:04 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [req-12178263-f359-4f8d-b4e8-0f42cf04e67d req-773037e0-f067-449f-afb2-dc8204a40ef5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031463 Apr 11 19:45:04 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 315/963] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:45:04 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:45:05 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [req-3c480ccb-adc9-4b9f-8ff7-7b0e84a29699 req-7423b352-fb95-4c97-8df5-fff6ca72dfe2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e2d23e8-2d2e-4b3e-94d8-01b17242dac5", "name": "network-vif-deleted", "tag": "8c77eb6a-6186-4c87-9e30-48420d525f90"}]} {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:45:05 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-3c480ccb-adc9-4b9f-8ff7-7b0e84a29699 req-7423b352-fb95-4c97-8df5-fff6ca72dfe2 service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:45:05 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-3c480ccb-adc9-4b9f-8ff7-7b0e84a29699 req-7423b352-fb95-4c97-8df5-fff6ca72dfe2 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:45:05 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-3c480ccb-adc9-4b9f-8ff7-7b0e84a29699 req-7423b352-fb95-4c97-8df5-fff6ca72dfe2 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:45:05 user devstack@n-api.service[72090]: INFO nova.api.openstack.compute.server_external_events [req-3c480ccb-adc9-4b9f-8ff7-7b0e84a29699 req-7423b352-fb95-4c97-8df5-fff6ca72dfe2 service nova] Creating event network-vif-deleted:8c77eb6a-6186-4c87-9e30-48420d525f90 for instance 9e2d23e8-2d2e-4b3e-94d8-01b17242dac5 on user Apr 11 19:45:05 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [req-3c480ccb-adc9-4b9f-8ff7-7b0e84a29699 req-7423b352-fb95-4c97-8df5-fff6ca72dfe2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036319 Apr 11 19:45:05 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 320/964] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:45:05 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:45:06 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [req-4a30b08b-acd8-4c25-9992-9fe0ca6f4a5c req-f9d5d470-f103-490b-b176-5ecf101e4c53 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a66c1d51-e194-424d-a37c-d308544774c6", "tag": "397ebb82-45b3-41ad-bbac-ef07140bf942"}, {"server_uuid": "9e2d23e8-2d2e-4b3e-94d8-01b17242dac5", "name": "network-vif-plugged", "status": "completed", "tag": "8c77eb6a-6186-4c87-9e30-48420d525f90"}]} {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:45:06 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-4a30b08b-acd8-4c25-9992-9fe0ca6f4a5c req-f9d5d470-f103-490b-b176-5ecf101e4c53 service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:45:06 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-4a30b08b-acd8-4c25-9992-9fe0ca6f4a5c req-f9d5d470-f103-490b-b176-5ecf101e4c53 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:45:06 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-4a30b08b-acd8-4c25-9992-9fe0ca6f4a5c req-f9d5d470-f103-490b-b176-5ecf101e4c53 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:45:06 user devstack@n-api.service[72089]: INFO nova.api.openstack.compute.server_external_events [req-4a30b08b-acd8-4c25-9992-9fe0ca6f4a5c req-f9d5d470-f103-490b-b176-5ecf101e4c53 service nova] Creating event network-changed:397ebb82-45b3-41ad-bbac-ef07140bf942 for instance a66c1d51-e194-424d-a37c-d308544774c6 on user Apr 11 19:45:06 user devstack@n-api.service[72089]: INFO nova.api.openstack.compute.server_external_events [req-4a30b08b-acd8-4c25-9992-9fe0ca6f4a5c req-f9d5d470-f103-490b-b176-5ecf101e4c53 service nova] Creating event network-vif-plugged:8c77eb6a-6186-4c87-9e30-48420d525f90 for instance 9e2d23e8-2d2e-4b3e-94d8-01b17242dac5 on user Apr 11 19:45:06 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [req-4a30b08b-acd8-4c25-9992-9fe0ca6f4a5c req-f9d5d470-f103-490b-b176-5ecf101e4c53 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.038413 Apr 11 19:45:06 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 330/965] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:45:06 2023] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:45:07 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [None req-54aa67c9-d7b1-46a7-b638-5872a48cfeb8 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-225631843", "imageRef": "", "flavorRef": "42", "key_name": "tempest-TestVolumeBootPattern-1844027973", "security_groups": [{"name": "tempest-secgroup-smoke-49720192"}], "block_device_mapping_v2": [{"uuid": "d92e8c90-19c1-484b-8294-655686396811", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "f22e45e9-cc15-401e-aed7-3506278d3d0d"}]}} {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:45:07 user devstack@n-api.service[72088]: DEBUG nova.network.neutron [None req-54aa67c9-d7b1-46a7-b638-5872a48cfeb8 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] validate_networks() for [('f22e45e9-cc15-401e-aed7-3506278d3d0d', None, None, None, None, None)] {{(pid=72088) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 11 19:45:08 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [req-a6646f20-3a01-4d45-b46e-5f5dfbaf57ea req-d0458e34-120a-45e1-8065-f4f6e1ddc6f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f633037d-87d0-4dda-aa33-3cc9c3191080", "name": "network-vif-plugged", "status": "completed", "tag": "c3ef7018-189c-423e-b92b-b2b4a98dafce"}]} {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:45:08 user devstack@n-api.service[72088]: DEBUG nova.virt.hardware [None req-54aa67c9-d7b1-46a7-b638-5872a48cfeb8 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Flavor limits 0:0:0 {{(pid=72088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 19:45:08 user devstack@n-api.service[72088]: DEBUG nova.virt.hardware [None req-54aa67c9-d7b1-46a7-b638-5872a48cfeb8 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Image limits 0:0:0 {{(pid=72088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 19:45:08 user devstack@n-api.service[72088]: DEBUG nova.virt.hardware [None req-54aa67c9-d7b1-46a7-b638-5872a48cfeb8 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Flavor pref 0:0:0 {{(pid=72088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 19:45:08 user devstack@n-api.service[72088]: DEBUG nova.virt.hardware [None req-54aa67c9-d7b1-46a7-b638-5872a48cfeb8 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Image pref 0:0:0 {{(pid=72088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 19:45:08 user devstack@n-api.service[72088]: DEBUG nova.virt.hardware [None req-54aa67c9-d7b1-46a7-b638-5872a48cfeb8 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 19:45:08 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-a6646f20-3a01-4d45-b46e-5f5dfbaf57ea req-d0458e34-120a-45e1-8065-f4f6e1ddc6f4 service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:45:08 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-a6646f20-3a01-4d45-b46e-5f5dfbaf57ea req-d0458e34-120a-45e1-8065-f4f6e1ddc6f4 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:45:08 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-a6646f20-3a01-4d45-b46e-5f5dfbaf57ea req-d0458e34-120a-45e1-8065-f4f6e1ddc6f4 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:45:08 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-54aa67c9-d7b1-46a7-b638-5872a48cfeb8 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:45:08 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-54aa67c9-d7b1-46a7-b638-5872a48cfeb8 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:45:08 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-54aa67c9-d7b1-46a7-b638-5872a48cfeb8 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:45:08 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-54aa67c9-d7b1-46a7-b638-5872a48cfeb8 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:45:08 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-54aa67c9-d7b1-46a7-b638-5872a48cfeb8 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:45:08 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-54aa67c9-d7b1-46a7-b638-5872a48cfeb8 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:45:08 user devstack@n-api.service[72090]: INFO nova.api.openstack.compute.server_external_events [req-a6646f20-3a01-4d45-b46e-5f5dfbaf57ea req-d0458e34-120a-45e1-8065-f4f6e1ddc6f4 service nova] Creating event network-vif-plugged:c3ef7018-189c-423e-b92b-b2b4a98dafce for instance f633037d-87d0-4dda-aa33-3cc9c3191080 on user Apr 11 19:45:08 user devstack@n-api.service[72088]: DEBUG nova.quota [None req-54aa67c9-d7b1-46a7-b638-5872a48cfeb8 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Getting quotas for project 2caba0618fc743e7bfb2dd866a511df9. Resources: {'ram', 'instances', 'cores'} {{(pid=72088) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 19:45:08 user devstack@n-api.service[72090]: DEBUG nova.compute.api [req-a6646f20-3a01-4d45-b46e-5f5dfbaf57ea req-d0458e34-120a-45e1-8065-f4f6e1ddc6f4 service nova] Instance f633037d-87d0-4dda-aa33-3cc9c3191080 is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=72090) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 11 19:45:08 user devstack@n-api.service[72088]: DEBUG nova.quota [None req-54aa67c9-d7b1-46a7-b638-5872a48cfeb8 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Getting quotas for user cf262cd03f4a41c4956d8784cf37d86d and project 2caba0618fc743e7bfb2dd866a511df9. Resources: {'ram', 'instances', 'cores'} {{(pid=72088) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 19:45:08 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [req-a6646f20-3a01-4d45-b46e-5f5dfbaf57ea req-d0458e34-120a-45e1-8065-f4f6e1ddc6f4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062903 Apr 11 19:45:08 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 321/966] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:45:08 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:45:08 user devstack@n-api.service[72088]: DEBUG nova.compute.api [None req-54aa67c9-d7b1-46a7-b638-5872a48cfeb8 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Going to run 1 instances... {{(pid=72088) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 11 19:45:08 user devstack@n-api.service[72088]: DEBUG nova.compute.api [None req-54aa67c9-d7b1-46a7-b638-5872a48cfeb8 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] [instance: 589934d3-f72e-49d4-a230-1748ba0d5ee2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='d92e8c90-19c1-484b-8294-655686396811',volume_size=None,volume_type=None)] {{(pid=72088) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 11 19:45:08 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [None req-54aa67c9-d7b1-46a7-b638-5872a48cfeb8 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.881900 Apr 11 19:45:08 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 316/967] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 11 19:45:07 2023] POST /compute/v2.1/servers => generated 402 bytes in 884 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 11 19:45:08 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [None req-4d7f3dde-1498-4ee3-b3bf-10fdbd7092e3 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Calling method '>' {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:45:08 user devstack@n-api.service[72089]: DEBUG nova.compute.api [None req-4d7f3dde-1498-4ee3-b3bf-10fdbd7092e3 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] [instance: 589934d3-f72e-49d4-a230-1748ba0d5ee2] Fetching instance by UUID {{(pid=72089) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:45:08 user devstack@n-api.service[72089]: DEBUG nova.policy [None req-4d7f3dde-1498-4ee3-b3bf-10fdbd7092e3 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf262cd03f4a41c4956d8784cf37d86d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caba0618fc743e7bfb2dd866a511df9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72089) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:45:08 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [None req-4d7f3dde-1498-4ee3-b3bf-10fdbd7092e3 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] 10.0.0.210 "GET /compute/v2.1/servers/589934d3-f72e-49d4-a230-1748ba0d5ee2" status: 200 len: 1089 microversion: 2.1 time: 0.078730 Apr 11 19:45:08 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 331/968] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 19:45:08 2023] GET /compute/v2.1/servers/589934d3-f72e-49d4-a230-1748ba0d5ee2 => generated 1089 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:45:10 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [req-952dfcfa-4d53-4ac4-8913-4cae2512d239 req-c80217bf-23ad-4bb6-a1f4-ba5b41100e23 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f633037d-87d0-4dda-aa33-3cc9c3191080", "name": "network-vif-plugged", "status": "completed", "tag": "c3ef7018-189c-423e-b92b-b2b4a98dafce"}]} {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:45:10 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-952dfcfa-4d53-4ac4-8913-4cae2512d239 req-c80217bf-23ad-4bb6-a1f4-ba5b41100e23 service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:45:10 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-952dfcfa-4d53-4ac4-8913-4cae2512d239 req-c80217bf-23ad-4bb6-a1f4-ba5b41100e23 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:45:10 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-952dfcfa-4d53-4ac4-8913-4cae2512d239 req-c80217bf-23ad-4bb6-a1f4-ba5b41100e23 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:45:10 user devstack@n-api.service[72090]: INFO nova.api.openstack.compute.server_external_events [req-952dfcfa-4d53-4ac4-8913-4cae2512d239 req-c80217bf-23ad-4bb6-a1f4-ba5b41100e23 service nova] Creating event network-vif-plugged:c3ef7018-189c-423e-b92b-b2b4a98dafce for instance f633037d-87d0-4dda-aa33-3cc9c3191080 on user Apr 11 19:45:10 user devstack@n-api.service[72090]: DEBUG nova.compute.api [req-952dfcfa-4d53-4ac4-8913-4cae2512d239 req-c80217bf-23ad-4bb6-a1f4-ba5b41100e23 service nova] Instance f633037d-87d0-4dda-aa33-3cc9c3191080 is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=72090) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 11 19:45:10 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [req-952dfcfa-4d53-4ac4-8913-4cae2512d239 req-c80217bf-23ad-4bb6-a1f4-ba5b41100e23 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050394 Apr 11 19:45:10 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 322/969] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:45:10 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:45:12 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [req-1c016588-666d-4f29-bf02-7b6410540ad2 req-bad5afab-84ec-4b40-ad15-b14ab205f9f0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "589934d3-f72e-49d4-a230-1748ba0d5ee2", "tag": "42d318d4-06e2-42de-93b2-504f5a5a51e5"}]} {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:45:12 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-1c016588-666d-4f29-bf02-7b6410540ad2 req-bad5afab-84ec-4b40-ad15-b14ab205f9f0 service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:45:12 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-1c016588-666d-4f29-bf02-7b6410540ad2 req-bad5afab-84ec-4b40-ad15-b14ab205f9f0 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:45:12 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-1c016588-666d-4f29-bf02-7b6410540ad2 req-bad5afab-84ec-4b40-ad15-b14ab205f9f0 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:45:12 user devstack@n-api.service[72088]: INFO nova.api.openstack.compute.server_external_events [req-1c016588-666d-4f29-bf02-7b6410540ad2 req-bad5afab-84ec-4b40-ad15-b14ab205f9f0 service nova] Creating event network-changed:42d318d4-06e2-42de-93b2-504f5a5a51e5 for instance 589934d3-f72e-49d4-a230-1748ba0d5ee2 on user Apr 11 19:45:12 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [req-1c016588-666d-4f29-bf02-7b6410540ad2 req-bad5afab-84ec-4b40-ad15-b14ab205f9f0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030054 Apr 11 19:45:12 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 317/970] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:45:12 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:45:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [req-1ebb5d06-8a13-4e8d-b0c9-fa6f47ca43b4 req-30cb291c-006c-4fbd-a544-d7d60e44e748 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "589934d3-f72e-49d4-a230-1748ba0d5ee2", "name": "network-vif-plugged", "status": "completed", "tag": "42d318d4-06e2-42de-93b2-504f5a5a51e5"}]} {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:45:17 user devstack@n-api.service[72089]: DEBUG dbcounter [-] [72089] Writing DB stats nova_cell1:SELECT=53,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=72089) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:45:17 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-1ebb5d06-8a13-4e8d-b0c9-fa6f47ca43b4 req-30cb291c-006c-4fbd-a544-d7d60e44e748 service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:45:17 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-1ebb5d06-8a13-4e8d-b0c9-fa6f47ca43b4 req-30cb291c-006c-4fbd-a544-d7d60e44e748 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:45:17 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-1ebb5d06-8a13-4e8d-b0c9-fa6f47ca43b4 req-30cb291c-006c-4fbd-a544-d7d60e44e748 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:45:17 user devstack@n-api.service[72089]: INFO nova.api.openstack.compute.server_external_events [req-1ebb5d06-8a13-4e8d-b0c9-fa6f47ca43b4 req-30cb291c-006c-4fbd-a544-d7d60e44e748 service nova] Creating event network-vif-plugged:42d318d4-06e2-42de-93b2-504f5a5a51e5 for instance 589934d3-f72e-49d4-a230-1748ba0d5ee2 on user Apr 11 19:45:17 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [req-1ebb5d06-8a13-4e8d-b0c9-fa6f47ca43b4 req-30cb291c-006c-4fbd-a544-d7d60e44e748 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036579 Apr 11 19:45:17 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 332/971] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:45:17 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:45:19 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [req-e0d0834e-8b92-4964-b6c2-ed950ffd2c38 req-45d33778-d58c-42ff-94df-5dacef315d4b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "589934d3-f72e-49d4-a230-1748ba0d5ee2", "name": "network-vif-plugged", "status": "completed", "tag": "42d318d4-06e2-42de-93b2-504f5a5a51e5"}]} {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:45:19 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-e0d0834e-8b92-4964-b6c2-ed950ffd2c38 req-45d33778-d58c-42ff-94df-5dacef315d4b service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:45:19 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-e0d0834e-8b92-4964-b6c2-ed950ffd2c38 req-45d33778-d58c-42ff-94df-5dacef315d4b service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:45:19 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-e0d0834e-8b92-4964-b6c2-ed950ffd2c38 req-45d33778-d58c-42ff-94df-5dacef315d4b service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:45:19 user devstack@n-api.service[72090]: INFO nova.api.openstack.compute.server_external_events [req-e0d0834e-8b92-4964-b6c2-ed950ffd2c38 req-45d33778-d58c-42ff-94df-5dacef315d4b service nova] Creating event network-vif-plugged:42d318d4-06e2-42de-93b2-504f5a5a51e5 for instance 589934d3-f72e-49d4-a230-1748ba0d5ee2 on user Apr 11 19:45:19 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [req-e0d0834e-8b92-4964-b6c2-ed950ffd2c38 req-45d33778-d58c-42ff-94df-5dacef315d4b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035265 Apr 11 19:45:19 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 323/972] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:45:19 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:45:42 user devstack@n-api.service[72088]: DEBUG dbcounter [-] [72088] Writing DB stats nova_cell0:SELECT=2 {{(pid=72088) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:45:42 user devstack@n-api.service[72088]: DEBUG dbcounter [-] [72088] Writing DB stats nova_cell0:SELECT=6 {{(pid=72088) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:45:42 user devstack@n-api.service[72088]: DEBUG dbcounter [-] [72088] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=3 {{(pid=72088) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:45:42 user devstack@n-api.service[72088]: DEBUG dbcounter [-] [72088] Writing DB stats nova_cell1:SELECT=51,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=72088) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:45:42 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [None req-9e8e5bbd-b5ea-4525-a274-0baf983594ce tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Calling method '>' {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:45:42 user devstack@n-api.service[72088]: DEBUG nova.compute.api [None req-9e8e5bbd-b5ea-4525-a274-0baf983594ce tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] [instance: bf0a75f5-2f44-4687-af12-046f6761fee2] Fetching instance by UUID {{(pid=72088) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:45:42 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-9e8e5bbd-b5ea-4525-a274-0baf983594ce tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:45:42 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-9e8e5bbd-b5ea-4525-a274-0baf983594ce tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:45:42 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-9e8e5bbd-b5ea-4525-a274-0baf983594ce tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:45:42 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-9e8e5bbd-b5ea-4525-a274-0baf983594ce tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:45:42 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-9e8e5bbd-b5ea-4525-a274-0baf983594ce tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:45:42 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-9e8e5bbd-b5ea-4525-a274-0baf983594ce tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:45:42 user devstack@n-api.service[72088]: INFO nova.api.openstack.wsgi [None req-9e8e5bbd-b5ea-4525-a274-0baf983594ce tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] HTTP exception thrown: Instance bf0a75f5-2f44-4687-af12-046f6761fee2 could not be found. Apr 11 19:45:42 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [None req-9e8e5bbd-b5ea-4525-a274-0baf983594ce tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Request method failure captured: Apr 11 19:45:42 user devstack@n-api.service[72088]: request: GET /compute/v2.1/servers/bf0a75f5-2f44-4687-af12-046f6761fee2 HTTP/1.1 Apr 11 19:45:42 user devstack@n-api.service[72088]: Accept: application/json Apr 11 19:45:42 user devstack@n-api.service[72088]: Accept-Encoding: identity Apr 11 19:45:42 user devstack@n-api.service[72088]: Connection: close Apr 11 19:45:42 user devstack@n-api.service[72088]: Content-Length: 0 Apr 11 19:45:42 user devstack@n-api.service[72088]: Content-Type: application/json Apr 11 19:45:42 user devstack@n-api.service[72088]: Host: 10.0.0.210 Apr 11 19:45:42 user devstack@n-api.service[72088]: Openstack-System-Scope: None Apr 11 19:45:42 user devstack@n-api.service[72088]: User-Agent: python-urllib3/1.26.15 Apr 11 19:45:42 user devstack@n-api.service[72088]: X-Auth-Token: gAAAAABkNbUs3sGO0rC9Wf1HLL6y1zTXQ2xF2dMBaRGrgCkjSdBXMgDkz15sqaczXa_JcLLMjTSvFMatkt2Ta8S0VFlkGMqdbOYT7FNOzdcAgJLJI5j09-UAdp8WgiUM6SYPHBZLPS_ENQDMUXHUhrQJgHrsBuBOiq0wzxzQWDwcJRw-4wyoV9E Apr 11 19:45:42 user devstack@n-api.service[72088]: X-Domain-Id: None Apr 11 19:45:42 user devstack@n-api.service[72088]: X-Domain-Name: None Apr 11 19:45:42 user devstack@n-api.service[72088]: X-Identity-Status: Confirmed Apr 11 19:45:42 user devstack@n-api.service[72088]: X-Is-Admin-Project: True Apr 11 19:45:42 user devstack@n-api.service[72088]: X-Project-Domain-Id: default Apr 11 19:45:42 user devstack@n-api.service[72088]: X-Project-Domain-Name: Default Apr 11 19:45:42 user devstack@n-api.service[72088]: X-Project-Id: b8e3a291c54b49db8e12a88ba41865e3 Apr 11 19:45:42 user devstack@n-api.service[72088]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1429831687 Apr 11 19:45:42 user devstack@n-api.service[72088]: X-Role: reader,member Apr 11 19:45:42 user devstack@n-api.service[72088]: X-Roles: reader,member Apr 11 19:45:42 user devstack@n-api.service[72088]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b8e3a291c54b49db8e12a88ba41865e3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/b8e3a291c54b49db8e12a88ba41865e3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b8e3a291c54b49db8e12a88ba41865e3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 11 19:45:42 user devstack@n-api.service[72088]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1429831687 Apr 11 19:45:42 user devstack@n-api.service[72088]: X-Tenant-Id: b8e3a291c54b49db8e12a88ba41865e3 Apr 11 19:45:42 user devstack@n-api.service[72088]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1429831687 Apr 11 19:45:42 user devstack@n-api.service[72088]: X-User: tempest-ServerRescueNegativeTestJSON-1429831687-project-member Apr 11 19:45:42 user devstack@n-api.service[72088]: X-User-Domain-Id: default Apr 11 19:45:42 user devstack@n-api.service[72088]: X-User-Domain-Name: Default Apr 11 19:45:42 user devstack@n-api.service[72088]: X-User-Id: ba7f82b529e74d99838b6264b94d823b Apr 11 19:45:42 user devstack@n-api.service[72088]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1429831687-project-member Apr 11 19:45:42 user devstack@n-api.service[72088]: method: > Apr 11 19:45:42 user devstack@n-api.service[72088]: exception: Instance bf0a75f5-2f44-4687-af12-046f6761fee2 could not be found. Apr 11 19:45:42 user devstack@n-api.service[72088]: action_args: {'id': 'bf0a75f5-2f44-4687-af12-046f6761fee2'} Apr 11 19:45:42 user devstack@n-api.service[72088]: {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 19:45:42 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:45:42 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 19:45:42 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 19:45:42 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 19:45:42 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 19:45:42 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 19:45:42 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 19:45:42 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 19:45:42 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 19:45:42 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bf0a75f5-2f44-4687-af12-046f6761fee2 could not be found. Apr 11 19:45:42 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi Apr 11 19:45:42 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 19:45:42 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi Apr 11 19:45:42 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:45:42 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 19:45:42 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 19:45:42 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 19:45:42 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 19:45:42 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 19:45:42 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 19:45:42 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 19:45:42 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 19:45:42 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 19:45:42 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 19:45:42 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 19:45:42 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 19:45:42 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bf0a75f5-2f44-4687-af12-046f6761fee2 could not be found. Apr 11 19:45:42 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi Apr 11 19:45:42 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 19:45:42 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi Apr 11 19:45:42 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:45:42 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 19:45:42 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 19:45:42 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 19:45:42 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 19:45:42 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bf0a75f5-2f44-4687-af12-046f6761fee2 could not be found. Apr 11 19:45:42 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi Apr 11 19:45:42 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [None req-9e8e5bbd-b5ea-4525-a274-0baf983594ce tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Returning 404 to user: Instance bf0a75f5-2f44-4687-af12-046f6761fee2 could not be found. {{(pid=72088) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 19:45:42 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [None req-9e8e5bbd-b5ea-4525-a274-0baf983594ce tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bf0a75f5-2f44-4687-af12-046f6761fee2" status: 404 len: 111 microversion: 2.1 time: 0.039529 Apr 11 19:45:42 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 318/973] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 19:45:42 2023] GET /compute/v2.1/servers/bf0a75f5-2f44-4687-af12-046f6761fee2 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 19:45:42 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [None req-a82d36f0-0b49-4c8e-b2af-6a44cfb466ad tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Calling method '.version_select at 0x7f119d959750>' {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:45:42 user devstack@n-api.service[72089]: DEBUG dbcounter [-] [72089] Writing DB stats nova_cell0:SELECT=2 {{(pid=72089) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:45:42 user devstack@n-api.service[72089]: DEBUG dbcounter [-] [72089] Writing DB stats nova_api:SELECT=31,nova_api:UPDATE=1 {{(pid=72089) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:45:42 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [None req-a82d36f0-0b49-4c8e-b2af-6a44cfb466ad tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1079379697" status: 202 len: 0 microversion: 2.1 time: 0.037615 Apr 11 19:45:42 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 333/974] 10.0.0.210 () {62 vars in 1298 bytes} [Tue Apr 11 19:45:42 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1079379697 => generated 0 bytes in 40 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 19:45:44 user devstack@n-api.service[72090]: DEBUG dbcounter [-] [72090] Writing DB stats nova_api:SELECT=27,nova_api:UPDATE=1 {{(pid=72090) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:45:44 user devstack@n-api.service[72090]: DEBUG dbcounter [-] [72090] Writing DB stats nova_cell1:SELECT=58,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=72090) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:45:44 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [None req-a424d8fa-51c0-439b-8d24-94e1a00623a6 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Calling method '>' {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:45:44 user devstack@n-api.service[72090]: DEBUG nova.compute.api [None req-a424d8fa-51c0-439b-8d24-94e1a00623a6 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] [instance: f633037d-87d0-4dda-aa33-3cc9c3191080] Fetching instance by UUID {{(pid=72090) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:45:44 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-a424d8fa-51c0-439b-8d24-94e1a00623a6 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:45:44 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-a424d8fa-51c0-439b-8d24-94e1a00623a6 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:45:44 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-a424d8fa-51c0-439b-8d24-94e1a00623a6 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:45:44 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-a424d8fa-51c0-439b-8d24-94e1a00623a6 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:45:44 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-a424d8fa-51c0-439b-8d24-94e1a00623a6 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:45:44 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-a424d8fa-51c0-439b-8d24-94e1a00623a6 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:45:44 user devstack@n-api.service[72090]: DEBUG nova.policy [None req-a424d8fa-51c0-439b-8d24-94e1a00623a6 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05fb551c320a48f98a4ec00a7f7492d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60a7381a31b84e97a068528f90813773', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72090) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:45:44 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [None req-a424d8fa-51c0-439b-8d24-94e1a00623a6 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f633037d-87d0-4dda-aa33-3cc9c3191080" status: 200 len: 1554 microversion: 2.1 time: 0.161269 Apr 11 19:45:44 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 324/975] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 19:45:44 2023] GET /compute/v2.1/servers/f633037d-87d0-4dda-aa33-3cc9c3191080 => generated 1554 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:45:45 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [None req-6d7fb239-65d0-40e7-9099-409a706d065c tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Calling method '>' {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:45:45 user devstack@n-api.service[72088]: DEBUG nova.compute.api [None req-6d7fb239-65d0-40e7-9099-409a706d065c tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] [instance: 6f2616ce-4924-4b82-996a-2596ae8856a4] Fetching instance by UUID {{(pid=72088) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:45:45 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-6d7fb239-65d0-40e7-9099-409a706d065c tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:45:45 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-6d7fb239-65d0-40e7-9099-409a706d065c tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:45:45 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-6d7fb239-65d0-40e7-9099-409a706d065c tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:45:45 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-6d7fb239-65d0-40e7-9099-409a706d065c tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:45:45 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-6d7fb239-65d0-40e7-9099-409a706d065c tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:45:45 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-6d7fb239-65d0-40e7-9099-409a706d065c tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:45:45 user devstack@n-api.service[72088]: DEBUG nova.compute.api [None req-6d7fb239-65d0-40e7-9099-409a706d065c tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] [instance: 6f2616ce-4924-4b82-996a-2596ae8856a4] Going to try to terminate instance {{(pid=72088) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 11 19:45:45 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [None req-6d7fb239-65d0-40e7-9099-409a706d065c tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/6f2616ce-4924-4b82-996a-2596ae8856a4" status: 204 len: 0 microversion: 2.1 time: 0.138648 Apr 11 19:45:45 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 319/976] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 19:45:45 2023] DELETE /compute/v2.1/servers/6f2616ce-4924-4b82-996a-2596ae8856a4 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 11 19:45:45 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [None req-b59f66b7-0c1b-45bb-a484-2d62913323dd tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Calling method '>' {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:45:45 user devstack@n-api.service[72089]: DEBUG nova.compute.api [None req-b59f66b7-0c1b-45bb-a484-2d62913323dd tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] [instance: 6f2616ce-4924-4b82-996a-2596ae8856a4] Fetching instance by UUID {{(pid=72089) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:45:45 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-b59f66b7-0c1b-45bb-a484-2d62913323dd tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:45:45 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-b59f66b7-0c1b-45bb-a484-2d62913323dd tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:45:45 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-b59f66b7-0c1b-45bb-a484-2d62913323dd tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:45:45 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-b59f66b7-0c1b-45bb-a484-2d62913323dd tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:45:45 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-b59f66b7-0c1b-45bb-a484-2d62913323dd tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:45:45 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-b59f66b7-0c1b-45bb-a484-2d62913323dd tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:45:45 user devstack@n-api.service[72089]: DEBUG nova.policy [None req-b59f66b7-0c1b-45bb-a484-2d62913323dd tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba7f82b529e74d99838b6264b94d823b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e3a291c54b49db8e12a88ba41865e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72089) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:45:45 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [None req-b59f66b7-0c1b-45bb-a484-2d62913323dd tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6f2616ce-4924-4b82-996a-2596ae8856a4" status: 200 len: 1497 microversion: 2.1 time: 0.168297 Apr 11 19:45:45 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 334/977] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 19:45:45 2023] GET /compute/v2.1/servers/6f2616ce-4924-4b82-996a-2596ae8856a4 => generated 1497 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:45:46 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [req-69f32f62-9cd1-4ea6-963d-72824a7e4b19 req-ad61a6a9-e7b6-4389-8ec0-a4a81629d7b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f2616ce-4924-4b82-996a-2596ae8856a4", "name": "network-vif-unplugged", "status": "completed", "tag": "1c929bc1-2708-4e38-80b3-354812ccb529"}]} {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:45:46 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-69f32f62-9cd1-4ea6-963d-72824a7e4b19 req-ad61a6a9-e7b6-4389-8ec0-a4a81629d7b2 service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:45:46 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-69f32f62-9cd1-4ea6-963d-72824a7e4b19 req-ad61a6a9-e7b6-4389-8ec0-a4a81629d7b2 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:45:46 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-69f32f62-9cd1-4ea6-963d-72824a7e4b19 req-ad61a6a9-e7b6-4389-8ec0-a4a81629d7b2 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:45:46 user devstack@n-api.service[72090]: INFO nova.api.openstack.compute.server_external_events [req-69f32f62-9cd1-4ea6-963d-72824a7e4b19 req-ad61a6a9-e7b6-4389-8ec0-a4a81629d7b2 service nova] Creating event network-vif-unplugged:1c929bc1-2708-4e38-80b3-354812ccb529 for instance 6f2616ce-4924-4b82-996a-2596ae8856a4 on user Apr 11 19:45:46 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [req-69f32f62-9cd1-4ea6-963d-72824a7e4b19 req-ad61a6a9-e7b6-4389-8ec0-a4a81629d7b2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.028984 Apr 11 19:45:46 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 325/978] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:45:46 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:45:46 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [req-dbe162e3-a6c2-4c43-b09f-a79e892fa88d req-225205fd-af66-47f6-8e6e-5f98ab1f5f29 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f2616ce-4924-4b82-996a-2596ae8856a4", "name": "network-vif-deleted", "tag": "1c929bc1-2708-4e38-80b3-354812ccb529"}]} {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:45:46 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-dbe162e3-a6c2-4c43-b09f-a79e892fa88d req-225205fd-af66-47f6-8e6e-5f98ab1f5f29 service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:45:46 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-dbe162e3-a6c2-4c43-b09f-a79e892fa88d req-225205fd-af66-47f6-8e6e-5f98ab1f5f29 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:45:46 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-dbe162e3-a6c2-4c43-b09f-a79e892fa88d req-225205fd-af66-47f6-8e6e-5f98ab1f5f29 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:45:46 user devstack@n-api.service[72088]: INFO nova.api.openstack.compute.server_external_events [req-dbe162e3-a6c2-4c43-b09f-a79e892fa88d req-225205fd-af66-47f6-8e6e-5f98ab1f5f29 service nova] Creating event network-vif-deleted:1c929bc1-2708-4e38-80b3-354812ccb529 for instance 6f2616ce-4924-4b82-996a-2596ae8856a4 on user Apr 11 19:45:46 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [req-dbe162e3-a6c2-4c43-b09f-a79e892fa88d req-225205fd-af66-47f6-8e6e-5f98ab1f5f29 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033844 Apr 11 19:45:46 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 320/979] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:45:46 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:45:48 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [req-ef9636a4-a3d0-4a8e-9e36-6f25c57b6e8b req-c3150457-495f-4813-ae16-6fb897930cb5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f2616ce-4924-4b82-996a-2596ae8856a4", "name": "network-vif-plugged", "status": "completed", "tag": "1c929bc1-2708-4e38-80b3-354812ccb529"}]} {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:45:48 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-ef9636a4-a3d0-4a8e-9e36-6f25c57b6e8b req-c3150457-495f-4813-ae16-6fb897930cb5 service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:45:48 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-ef9636a4-a3d0-4a8e-9e36-6f25c57b6e8b req-c3150457-495f-4813-ae16-6fb897930cb5 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:45:48 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-ef9636a4-a3d0-4a8e-9e36-6f25c57b6e8b req-c3150457-495f-4813-ae16-6fb897930cb5 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:45:48 user devstack@n-api.service[72089]: INFO nova.api.openstack.compute.server_external_events [req-ef9636a4-a3d0-4a8e-9e36-6f25c57b6e8b req-c3150457-495f-4813-ae16-6fb897930cb5 service nova] Creating event network-vif-plugged:1c929bc1-2708-4e38-80b3-354812ccb529 for instance 6f2616ce-4924-4b82-996a-2596ae8856a4 on user Apr 11 19:45:48 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [req-ef9636a4-a3d0-4a8e-9e36-6f25c57b6e8b req-c3150457-495f-4813-ae16-6fb897930cb5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030496 Apr 11 19:45:48 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 335/980] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:45:48 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:45:49 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [None req-9a9c7f3c-8b35-4382-afa8-325bb24691b4 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Calling method '>' {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:45:49 user devstack@n-api.service[72090]: DEBUG nova.compute.api [None req-9a9c7f3c-8b35-4382-afa8-325bb24691b4 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] [instance: 6b110aaa-0f26-4bab-8f3e-d22edb5a5072] Fetching instance by UUID {{(pid=72090) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:45:49 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-9a9c7f3c-8b35-4382-afa8-325bb24691b4 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:45:49 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-9a9c7f3c-8b35-4382-afa8-325bb24691b4 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:45:49 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-9a9c7f3c-8b35-4382-afa8-325bb24691b4 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:45:49 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-9a9c7f3c-8b35-4382-afa8-325bb24691b4 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:45:49 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-9a9c7f3c-8b35-4382-afa8-325bb24691b4 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:45:49 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-9a9c7f3c-8b35-4382-afa8-325bb24691b4 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:45:49 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [None req-9a9c7f3c-8b35-4382-afa8-325bb24691b4 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6b110aaa-0f26-4bab-8f3e-d22edb5a5072/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044890 Apr 11 19:45:49 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 326/981] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Apr 11 19:45:49 2023] GET /compute/v2.1/servers/6b110aaa-0f26-4bab-8f3e-d22edb5a5072/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 11 19:45:51 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [None req-ada272bc-b065-4312-a088-3b34a54089dc tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "038ca727-7ccc-42a5-babc-99b70d2e4dea"}} {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:45:51 user devstack@n-api.service[72088]: DEBUG nova.compute.api [None req-ada272bc-b065-4312-a088-3b34a54089dc tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] [instance: 6b110aaa-0f26-4bab-8f3e-d22edb5a5072] Fetching instance by UUID {{(pid=72088) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:45:51 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-ada272bc-b065-4312-a088-3b34a54089dc tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:45:51 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-ada272bc-b065-4312-a088-3b34a54089dc tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:45:51 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-ada272bc-b065-4312-a088-3b34a54089dc tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:45:51 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-ada272bc-b065-4312-a088-3b34a54089dc tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:45:51 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-ada272bc-b065-4312-a088-3b34a54089dc tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:45:51 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-ada272bc-b065-4312-a088-3b34a54089dc tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:45:51 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [None req-ada272bc-b065-4312-a088-3b34a54089dc tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] 10.0.0.210 "POST /compute/v2.1/servers/6b110aaa-0f26-4bab-8f3e-d22edb5a5072/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.267022 Apr 11 19:45:51 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 321/982] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Apr 11 19:45:51 2023] POST /compute/v2.1/servers/6b110aaa-0f26-4bab-8f3e-d22edb5a5072/os-volume_attachments => generated 194 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:45:54 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [None req-908d8c8e-0a12-43fc-a2f1-1840676f959a tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Calling method '>' {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:45:54 user devstack@n-api.service[72089]: DEBUG nova.compute.api [None req-908d8c8e-0a12-43fc-a2f1-1840676f959a tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] [instance: 9e2d23e8-2d2e-4b3e-94d8-01b17242dac5] Fetching instance by UUID {{(pid=72089) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:45:54 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-908d8c8e-0a12-43fc-a2f1-1840676f959a tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:45:54 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-908d8c8e-0a12-43fc-a2f1-1840676f959a tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:45:54 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-908d8c8e-0a12-43fc-a2f1-1840676f959a tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:45:54 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-908d8c8e-0a12-43fc-a2f1-1840676f959a tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:45:54 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-908d8c8e-0a12-43fc-a2f1-1840676f959a tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:45:54 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-908d8c8e-0a12-43fc-a2f1-1840676f959a tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:45:54 user devstack@n-api.service[72089]: INFO nova.api.openstack.wsgi [None req-908d8c8e-0a12-43fc-a2f1-1840676f959a tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] HTTP exception thrown: Instance 9e2d23e8-2d2e-4b3e-94d8-01b17242dac5 could not be found. Apr 11 19:45:54 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [None req-908d8c8e-0a12-43fc-a2f1-1840676f959a tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Request method failure captured: Apr 11 19:45:54 user devstack@n-api.service[72089]: request: GET /compute/v2.1/servers/9e2d23e8-2d2e-4b3e-94d8-01b17242dac5 HTTP/1.1 Apr 11 19:45:54 user devstack@n-api.service[72089]: Accept: application/json Apr 11 19:45:54 user devstack@n-api.service[72089]: Accept-Encoding: identity Apr 11 19:45:54 user devstack@n-api.service[72089]: Connection: close Apr 11 19:45:54 user devstack@n-api.service[72089]: Content-Length: 0 Apr 11 19:45:54 user devstack@n-api.service[72089]: Content-Type: application/json Apr 11 19:45:54 user devstack@n-api.service[72089]: Host: 10.0.0.210 Apr 11 19:45:54 user devstack@n-api.service[72089]: Openstack-System-Scope: None Apr 11 19:45:54 user devstack@n-api.service[72089]: User-Agent: python-urllib3/1.26.15 Apr 11 19:45:54 user devstack@n-api.service[72089]: X-Auth-Token: gAAAAABkNbQnEMwb9bokVGqy8IBkwGOZTlbefW9-gCGma1Q9aMCf7rErAs3NuXcPCnuWAMFMb4o5vJ-bB4xPFTn6y2WKU9I0pItmZHu7i_RppKkEiULwNqNywUZ2M-d73QMTy5dW3-OZVF1Bf-qwJagrp481OxGYQGqOEgWnBHPks1h4PLepPQA Apr 11 19:45:54 user devstack@n-api.service[72089]: X-Domain-Id: None Apr 11 19:45:54 user devstack@n-api.service[72089]: X-Domain-Name: None Apr 11 19:45:54 user devstack@n-api.service[72089]: X-Identity-Status: Confirmed Apr 11 19:45:54 user devstack@n-api.service[72089]: X-Is-Admin-Project: True Apr 11 19:45:54 user devstack@n-api.service[72089]: X-Openstack-Nova-Api-Version: 2.87 Apr 11 19:45:54 user devstack@n-api.service[72089]: X-Project-Domain-Id: default Apr 11 19:45:54 user devstack@n-api.service[72089]: X-Project-Domain-Name: Default Apr 11 19:45:54 user devstack@n-api.service[72089]: X-Project-Id: eb91586feb3f4a4c84fa8c2183baaf8c Apr 11 19:45:54 user devstack@n-api.service[72089]: X-Project-Name: tempest-ServerBootFromVolumeStableRescueTest-863156619 Apr 11 19:45:54 user devstack@n-api.service[72089]: X-Role: reader,member Apr 11 19:45:54 user devstack@n-api.service[72089]: X-Roles: reader,member Apr 11 19:45:54 user devstack@n-api.service[72089]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/eb91586feb3f4a4c84fa8c2183baaf8c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/eb91586feb3f4a4c84fa8c2183baaf8c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/eb91586feb3f4a4c84fa8c2183baaf8c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 11 19:45:54 user devstack@n-api.service[72089]: X-Tenant: tempest-ServerBootFromVolumeStableRescueTest-863156619 Apr 11 19:45:54 user devstack@n-api.service[72089]: X-Tenant-Id: eb91586feb3f4a4c84fa8c2183baaf8c Apr 11 19:45:54 user devstack@n-api.service[72089]: X-Tenant-Name: tempest-ServerBootFromVolumeStableRescueTest-863156619 Apr 11 19:45:54 user devstack@n-api.service[72089]: X-User: tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member Apr 11 19:45:54 user devstack@n-api.service[72089]: X-User-Domain-Id: default Apr 11 19:45:54 user devstack@n-api.service[72089]: X-User-Domain-Name: Default Apr 11 19:45:54 user devstack@n-api.service[72089]: X-User-Id: 1b3adca432b04d70818a51d1366f5c6d Apr 11 19:45:54 user devstack@n-api.service[72089]: X-User-Name: tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member Apr 11 19:45:54 user devstack@n-api.service[72089]: method: > Apr 11 19:45:54 user devstack@n-api.service[72089]: exception: Instance 9e2d23e8-2d2e-4b3e-94d8-01b17242dac5 could not be found. Apr 11 19:45:54 user devstack@n-api.service[72089]: action_args: {'id': '9e2d23e8-2d2e-4b3e-94d8-01b17242dac5'} Apr 11 19:45:54 user devstack@n-api.service[72089]: {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 19:45:54 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:45:54 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 19:45:54 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 19:45:54 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 19:45:54 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 19:45:54 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 19:45:54 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 19:45:54 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 19:45:54 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 19:45:54 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9e2d23e8-2d2e-4b3e-94d8-01b17242dac5 could not be found. Apr 11 19:45:54 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi Apr 11 19:45:54 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 19:45:54 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi Apr 11 19:45:54 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:45:54 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 19:45:54 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 19:45:54 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 19:45:54 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 19:45:54 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 19:45:54 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 19:45:54 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 19:45:54 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 19:45:54 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 19:45:54 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 19:45:54 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 19:45:54 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 19:45:54 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9e2d23e8-2d2e-4b3e-94d8-01b17242dac5 could not be found. Apr 11 19:45:54 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi Apr 11 19:45:54 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 19:45:54 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi Apr 11 19:45:54 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:45:54 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 19:45:54 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 19:45:54 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 19:45:54 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 19:45:54 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9e2d23e8-2d2e-4b3e-94d8-01b17242dac5 could not be found. Apr 11 19:45:54 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi Apr 11 19:45:54 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [None req-908d8c8e-0a12-43fc-a2f1-1840676f959a tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Returning 404 to user: Instance 9e2d23e8-2d2e-4b3e-94d8-01b17242dac5 could not be found. {{(pid=72089) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 19:45:54 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [None req-908d8c8e-0a12-43fc-a2f1-1840676f959a tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9e2d23e8-2d2e-4b3e-94d8-01b17242dac5" status: 404 len: 111 microversion: 2.87 time: 0.074378 Apr 11 19:45:54 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 336/983] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 19:45:54 2023] GET /compute/v2.1/servers/9e2d23e8-2d2e-4b3e-94d8-01b17242dac5 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 11 19:45:58 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [None req-001c88bc-6d8c-450a-9786-6a0ca2236893 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Calling method '>' {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:45:58 user devstack@n-api.service[72090]: DEBUG nova.compute.api [None req-001c88bc-6d8c-450a-9786-6a0ca2236893 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] [instance: 589934d3-f72e-49d4-a230-1748ba0d5ee2] Fetching instance by UUID {{(pid=72090) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:45:58 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-001c88bc-6d8c-450a-9786-6a0ca2236893 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:45:58 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-001c88bc-6d8c-450a-9786-6a0ca2236893 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:45:58 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-001c88bc-6d8c-450a-9786-6a0ca2236893 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:45:58 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-001c88bc-6d8c-450a-9786-6a0ca2236893 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:45:58 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-001c88bc-6d8c-450a-9786-6a0ca2236893 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:45:58 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-001c88bc-6d8c-450a-9786-6a0ca2236893 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:45:58 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [None req-df800ed7-04ee-48ca-b79a-ce0b75c0e537 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Calling method '>' {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:45:58 user devstack@n-api.service[72088]: DEBUG nova.compute.api [None req-df800ed7-04ee-48ca-b79a-ce0b75c0e537 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] [instance: 6b110aaa-0f26-4bab-8f3e-d22edb5a5072] Fetching instance by UUID {{(pid=72088) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:45:58 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-df800ed7-04ee-48ca-b79a-ce0b75c0e537 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:45:58 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-df800ed7-04ee-48ca-b79a-ce0b75c0e537 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:45:58 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-df800ed7-04ee-48ca-b79a-ce0b75c0e537 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:45:58 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-df800ed7-04ee-48ca-b79a-ce0b75c0e537 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:45:58 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-df800ed7-04ee-48ca-b79a-ce0b75c0e537 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:45:58 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-df800ed7-04ee-48ca-b79a-ce0b75c0e537 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:45:58 user devstack@n-api.service[72088]: DEBUG nova.objects.instance [None req-df800ed7-04ee-48ca-b79a-ce0b75c0e537 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Lazy-loading 'services' on Instance uuid 6b110aaa-0f26-4bab-8f3e-d22edb5a5072 {{(pid=72088) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 11 19:45:58 user devstack@n-api.service[72090]: DEBUG nova.policy [None req-001c88bc-6d8c-450a-9786-6a0ca2236893 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf262cd03f4a41c4956d8784cf37d86d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caba0618fc743e7bfb2dd866a511df9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72090) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:45:58 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [None req-001c88bc-6d8c-450a-9786-6a0ca2236893 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] 10.0.0.210 "GET /compute/v2.1/servers/589934d3-f72e-49d4-a230-1748ba0d5ee2" status: 200 len: 1440 microversion: 2.1 time: 0.182127 Apr 11 19:45:58 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 327/984] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 19:45:58 2023] GET /compute/v2.1/servers/589934d3-f72e-49d4-a230-1748ba0d5ee2 => generated 1440 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:45:58 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [None req-df800ed7-04ee-48ca-b79a-ce0b75c0e537 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/6b110aaa-0f26-4bab-8f3e-d22edb5a5072/os-volume_attachments/038ca727-7ccc-42a5-babc-99b70d2e4dea" status: 202 len: 0 microversion: 2.1 time: 0.222834 Apr 11 19:45:58 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 322/985] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Apr 11 19:45:58 2023] DELETE /compute/v2.1/servers/6b110aaa-0f26-4bab-8f3e-d22edb5a5072/os-volume_attachments/038ca727-7ccc-42a5-babc-99b70d2e4dea => generated 0 bytes in 228 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 19:45:58 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [None req-4a979ff5-c138-4255-89a0-1e32851a9f5e tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Calling method '>' {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:45:58 user devstack@n-api.service[72089]: DEBUG nova.compute.api [None req-4a979ff5-c138-4255-89a0-1e32851a9f5e tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] [instance: 6b110aaa-0f26-4bab-8f3e-d22edb5a5072] Fetching instance by UUID {{(pid=72089) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:45:58 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-4a979ff5-c138-4255-89a0-1e32851a9f5e tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:45:58 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-4a979ff5-c138-4255-89a0-1e32851a9f5e tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:45:58 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-4a979ff5-c138-4255-89a0-1e32851a9f5e tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:45:58 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-4a979ff5-c138-4255-89a0-1e32851a9f5e tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:45:58 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-4a979ff5-c138-4255-89a0-1e32851a9f5e tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:45:58 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-4a979ff5-c138-4255-89a0-1e32851a9f5e tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:45:58 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [None req-4a979ff5-c138-4255-89a0-1e32851a9f5e tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6b110aaa-0f26-4bab-8f3e-d22edb5a5072/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061236 Apr 11 19:45:58 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 337/986] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Apr 11 19:45:58 2023] GET /compute/v2.1/servers/6b110aaa-0f26-4bab-8f3e-d22edb5a5072/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:46:35 user devstack@n-api.service[72090]: DEBUG dbcounter [-] [72090] Writing DB stats nova_api:SELECT=8 {{(pid=72090) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:46:35 user devstack@n-api.service[72090]: DEBUG dbcounter [-] [72090] Writing DB stats nova_cell1:SELECT=20 {{(pid=72090) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:46:36 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [None req-3ac1371c-1a79-4101-849d-516849fff1cb tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Calling method '>' {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:46:36 user devstack@n-api.service[72090]: DEBUG nova.compute.api [None req-3ac1371c-1a79-4101-849d-516849fff1cb tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] [instance: 6f2616ce-4924-4b82-996a-2596ae8856a4] Fetching instance by UUID {{(pid=72090) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:46:36 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-3ac1371c-1a79-4101-849d-516849fff1cb tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:46:36 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-3ac1371c-1a79-4101-849d-516849fff1cb tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:46:36 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-3ac1371c-1a79-4101-849d-516849fff1cb tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:46:36 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-3ac1371c-1a79-4101-849d-516849fff1cb tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:46:36 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-3ac1371c-1a79-4101-849d-516849fff1cb tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:46:36 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-3ac1371c-1a79-4101-849d-516849fff1cb tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:46:36 user devstack@n-api.service[72090]: INFO nova.api.openstack.wsgi [None req-3ac1371c-1a79-4101-849d-516849fff1cb tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] HTTP exception thrown: Instance 6f2616ce-4924-4b82-996a-2596ae8856a4 could not be found. Apr 11 19:46:36 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [None req-3ac1371c-1a79-4101-849d-516849fff1cb tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Request method failure captured: Apr 11 19:46:36 user devstack@n-api.service[72090]: request: GET /compute/v2.1/servers/6f2616ce-4924-4b82-996a-2596ae8856a4 HTTP/1.1 Apr 11 19:46:36 user devstack@n-api.service[72090]: Accept: application/json Apr 11 19:46:36 user devstack@n-api.service[72090]: Accept-Encoding: identity Apr 11 19:46:36 user devstack@n-api.service[72090]: Connection: close Apr 11 19:46:36 user devstack@n-api.service[72090]: Content-Length: 0 Apr 11 19:46:36 user devstack@n-api.service[72090]: Content-Type: application/json Apr 11 19:46:36 user devstack@n-api.service[72090]: Host: 10.0.0.210 Apr 11 19:46:36 user devstack@n-api.service[72090]: Openstack-System-Scope: None Apr 11 19:46:36 user devstack@n-api.service[72090]: User-Agent: python-urllib3/1.26.15 Apr 11 19:46:36 user devstack@n-api.service[72090]: X-Auth-Token: gAAAAABkNbUs3sGO0rC9Wf1HLL6y1zTXQ2xF2dMBaRGrgCkjSdBXMgDkz15sqaczXa_JcLLMjTSvFMatkt2Ta8S0VFlkGMqdbOYT7FNOzdcAgJLJI5j09-UAdp8WgiUM6SYPHBZLPS_ENQDMUXHUhrQJgHrsBuBOiq0wzxzQWDwcJRw-4wyoV9E Apr 11 19:46:36 user devstack@n-api.service[72090]: X-Domain-Id: None Apr 11 19:46:36 user devstack@n-api.service[72090]: X-Domain-Name: None Apr 11 19:46:36 user devstack@n-api.service[72090]: X-Identity-Status: Confirmed Apr 11 19:46:36 user devstack@n-api.service[72090]: X-Is-Admin-Project: True Apr 11 19:46:36 user devstack@n-api.service[72090]: X-Project-Domain-Id: default Apr 11 19:46:36 user devstack@n-api.service[72090]: X-Project-Domain-Name: Default Apr 11 19:46:36 user devstack@n-api.service[72090]: X-Project-Id: b8e3a291c54b49db8e12a88ba41865e3 Apr 11 19:46:36 user devstack@n-api.service[72090]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1429831687 Apr 11 19:46:36 user devstack@n-api.service[72090]: X-Role: reader,member Apr 11 19:46:36 user devstack@n-api.service[72090]: X-Roles: reader,member Apr 11 19:46:36 user devstack@n-api.service[72090]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b8e3a291c54b49db8e12a88ba41865e3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/b8e3a291c54b49db8e12a88ba41865e3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b8e3a291c54b49db8e12a88ba41865e3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 11 19:46:36 user devstack@n-api.service[72090]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1429831687 Apr 11 19:46:36 user devstack@n-api.service[72090]: X-Tenant-Id: b8e3a291c54b49db8e12a88ba41865e3 Apr 11 19:46:36 user devstack@n-api.service[72090]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1429831687 Apr 11 19:46:36 user devstack@n-api.service[72090]: X-User: tempest-ServerRescueNegativeTestJSON-1429831687-project-member Apr 11 19:46:36 user devstack@n-api.service[72090]: X-User-Domain-Id: default Apr 11 19:46:36 user devstack@n-api.service[72090]: X-User-Domain-Name: Default Apr 11 19:46:36 user devstack@n-api.service[72090]: X-User-Id: ba7f82b529e74d99838b6264b94d823b Apr 11 19:46:36 user devstack@n-api.service[72090]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1429831687-project-member Apr 11 19:46:36 user devstack@n-api.service[72090]: method: > Apr 11 19:46:36 user devstack@n-api.service[72090]: exception: Instance 6f2616ce-4924-4b82-996a-2596ae8856a4 could not be found. Apr 11 19:46:36 user devstack@n-api.service[72090]: action_args: {'id': '6f2616ce-4924-4b82-996a-2596ae8856a4'} Apr 11 19:46:36 user devstack@n-api.service[72090]: {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 19:46:36 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:46:36 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 19:46:36 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 19:46:36 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 19:46:36 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 19:46:36 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 19:46:36 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 19:46:36 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 19:46:36 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 19:46:36 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6f2616ce-4924-4b82-996a-2596ae8856a4 could not be found. Apr 11 19:46:36 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi Apr 11 19:46:36 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 19:46:36 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi Apr 11 19:46:36 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:46:36 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 19:46:36 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 19:46:36 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 19:46:36 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 19:46:36 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 19:46:36 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 19:46:36 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 19:46:36 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 19:46:36 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 19:46:36 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 19:46:36 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 19:46:36 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 19:46:36 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6f2616ce-4924-4b82-996a-2596ae8856a4 could not be found. Apr 11 19:46:36 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi Apr 11 19:46:36 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 19:46:36 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi Apr 11 19:46:36 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:46:36 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 19:46:36 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 19:46:36 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 19:46:36 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 19:46:36 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6f2616ce-4924-4b82-996a-2596ae8856a4 could not be found. Apr 11 19:46:36 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi Apr 11 19:46:36 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [None req-3ac1371c-1a79-4101-849d-516849fff1cb tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Returning 404 to user: Instance 6f2616ce-4924-4b82-996a-2596ae8856a4 could not be found. {{(pid=72090) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 19:46:36 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [None req-3ac1371c-1a79-4101-849d-516849fff1cb tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6f2616ce-4924-4b82-996a-2596ae8856a4" status: 404 len: 111 microversion: 2.1 time: 0.214893 Apr 11 19:46:36 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 328/987] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 19:46:35 2023] GET /compute/v2.1/servers/6f2616ce-4924-4b82-996a-2596ae8856a4 => generated 111 bytes in 216 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 19:46:36 user devstack@n-api.service[72088]: DEBUG dbcounter [-] [72088] Writing DB stats nova_api:SELECT=15,nova_api:UPDATE=1 {{(pid=72088) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:46:36 user devstack@n-api.service[72088]: DEBUG dbcounter [-] [72088] Writing DB stats nova_cell1:SELECT=39,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=72088) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:46:36 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [None req-97847ca9-db33-4855-98c0-0e525bcb0c5d tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Calling method '>' {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:46:36 user devstack@n-api.service[72088]: DEBUG nova.compute.api [None req-97847ca9-db33-4855-98c0-0e525bcb0c5d tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] [instance: 267c17c1-f0b6-4e18-8c18-5e5bbe8a2251] Fetching instance by UUID {{(pid=72088) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:46:36 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-97847ca9-db33-4855-98c0-0e525bcb0c5d tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:46:36 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-97847ca9-db33-4855-98c0-0e525bcb0c5d tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:46:36 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-97847ca9-db33-4855-98c0-0e525bcb0c5d tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:46:36 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-97847ca9-db33-4855-98c0-0e525bcb0c5d tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:46:36 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-97847ca9-db33-4855-98c0-0e525bcb0c5d tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:46:36 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-97847ca9-db33-4855-98c0-0e525bcb0c5d tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:46:36 user devstack@n-api.service[72088]: DEBUG nova.compute.api [None req-97847ca9-db33-4855-98c0-0e525bcb0c5d tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] [instance: 267c17c1-f0b6-4e18-8c18-5e5bbe8a2251] Going to try to terminate instance {{(pid=72088) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 11 19:46:36 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [None req-97847ca9-db33-4855-98c0-0e525bcb0c5d tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/267c17c1-f0b6-4e18-8c18-5e5bbe8a2251" status: 204 len: 0 microversion: 2.1 time: 0.145011 Apr 11 19:46:36 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 323/988] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 19:46:36 2023] DELETE /compute/v2.1/servers/267c17c1-f0b6-4e18-8c18-5e5bbe8a2251 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 11 19:46:36 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [None req-58e8bbaf-c316-4122-9b7d-e991369fd341 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Calling method '>' {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:46:36 user devstack@n-api.service[72089]: DEBUG nova.compute.api [None req-58e8bbaf-c316-4122-9b7d-e991369fd341 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] [instance: 267c17c1-f0b6-4e18-8c18-5e5bbe8a2251] Fetching instance by UUID {{(pid=72089) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:46:36 user devstack@n-api.service[72089]: DEBUG dbcounter [-] [72089] Writing DB stats nova_api:SELECT=11,nova_api:DELETE=1 {{(pid=72089) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:46:36 user devstack@n-api.service[72089]: DEBUG dbcounter [-] [72089] Writing DB stats nova_cell1:SELECT=18 {{(pid=72089) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:46:36 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-58e8bbaf-c316-4122-9b7d-e991369fd341 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:46:36 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-58e8bbaf-c316-4122-9b7d-e991369fd341 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:46:36 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-58e8bbaf-c316-4122-9b7d-e991369fd341 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:46:36 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-58e8bbaf-c316-4122-9b7d-e991369fd341 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:46:36 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-58e8bbaf-c316-4122-9b7d-e991369fd341 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:46:36 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-58e8bbaf-c316-4122-9b7d-e991369fd341 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:46:36 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [req-d5af9127-31ba-4649-ae53-5808f30ac3e4 req-30506e2c-3233-495e-93ff-65004a20b734 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "267c17c1-f0b6-4e18-8c18-5e5bbe8a2251", "name": "network-vif-unplugged", "status": "completed", "tag": "06fea704-e356-4605-811e-aac91617290e"}]} {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:46:36 user devstack@n-api.service[72089]: DEBUG nova.policy [None req-58e8bbaf-c316-4122-9b7d-e991369fd341 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba7f82b529e74d99838b6264b94d823b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e3a291c54b49db8e12a88ba41865e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72089) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:46:36 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-d5af9127-31ba-4649-ae53-5808f30ac3e4 req-30506e2c-3233-495e-93ff-65004a20b734 service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:46:36 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-d5af9127-31ba-4649-ae53-5808f30ac3e4 req-30506e2c-3233-495e-93ff-65004a20b734 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:46:36 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-d5af9127-31ba-4649-ae53-5808f30ac3e4 req-30506e2c-3233-495e-93ff-65004a20b734 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:46:36 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [None req-58e8bbaf-c316-4122-9b7d-e991369fd341 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] 10.0.0.210 "GET /compute/v2.1/servers/267c17c1-f0b6-4e18-8c18-5e5bbe8a2251" status: 200 len: 1510 microversion: 2.1 time: 0.267982 Apr 11 19:46:36 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 338/989] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 19:46:36 2023] GET /compute/v2.1/servers/267c17c1-f0b6-4e18-8c18-5e5bbe8a2251 => generated 1510 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:46:36 user devstack@n-api.service[72090]: INFO nova.api.openstack.compute.server_external_events [req-d5af9127-31ba-4649-ae53-5808f30ac3e4 req-30506e2c-3233-495e-93ff-65004a20b734 service nova] Creating event network-vif-unplugged:06fea704-e356-4605-811e-aac91617290e for instance 267c17c1-f0b6-4e18-8c18-5e5bbe8a2251 on user Apr 11 19:46:36 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [req-d5af9127-31ba-4649-ae53-5808f30ac3e4 req-30506e2c-3233-495e-93ff-65004a20b734 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033184 Apr 11 19:46:36 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 329/990] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:46:36 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:46:37 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [req-a3d24c82-df90-4e6e-bfae-2e518fbaf8c6 req-0819ac2e-177f-4964-8416-86a969d76c28 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "267c17c1-f0b6-4e18-8c18-5e5bbe8a2251", "name": "network-vif-deleted", "tag": "06fea704-e356-4605-811e-aac91617290e"}]} {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:46:37 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-a3d24c82-df90-4e6e-bfae-2e518fbaf8c6 req-0819ac2e-177f-4964-8416-86a969d76c28 service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:46:37 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-a3d24c82-df90-4e6e-bfae-2e518fbaf8c6 req-0819ac2e-177f-4964-8416-86a969d76c28 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:46:37 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-a3d24c82-df90-4e6e-bfae-2e518fbaf8c6 req-0819ac2e-177f-4964-8416-86a969d76c28 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:46:37 user devstack@n-api.service[72088]: INFO nova.api.openstack.compute.server_external_events [req-a3d24c82-df90-4e6e-bfae-2e518fbaf8c6 req-0819ac2e-177f-4964-8416-86a969d76c28 service nova] Creating event network-vif-deleted:06fea704-e356-4605-811e-aac91617290e for instance 267c17c1-f0b6-4e18-8c18-5e5bbe8a2251 on user Apr 11 19:46:37 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [req-a3d24c82-df90-4e6e-bfae-2e518fbaf8c6 req-0819ac2e-177f-4964-8416-86a969d76c28 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034963 Apr 11 19:46:37 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 324/991] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:46:37 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:46:38 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [req-a4d11359-ef7e-4e71-93a0-73e682db54f4 req-717ac6ee-1088-48ef-b96e-407b18d3fa06 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "267c17c1-f0b6-4e18-8c18-5e5bbe8a2251", "name": "network-vif-plugged", "status": "completed", "tag": "06fea704-e356-4605-811e-aac91617290e"}, {"server_uuid": "267c17c1-f0b6-4e18-8c18-5e5bbe8a2251", "name": "network-vif-plugged", "status": "completed", "tag": "06fea704-e356-4605-811e-aac91617290e"}]} {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:46:38 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-a4d11359-ef7e-4e71-93a0-73e682db54f4 req-717ac6ee-1088-48ef-b96e-407b18d3fa06 service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:46:38 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-a4d11359-ef7e-4e71-93a0-73e682db54f4 req-717ac6ee-1088-48ef-b96e-407b18d3fa06 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:46:38 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-a4d11359-ef7e-4e71-93a0-73e682db54f4 req-717ac6ee-1088-48ef-b96e-407b18d3fa06 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:46:38 user devstack@n-api.service[72089]: INFO nova.api.openstack.compute.server_external_events [req-a4d11359-ef7e-4e71-93a0-73e682db54f4 req-717ac6ee-1088-48ef-b96e-407b18d3fa06 service nova] Creating event network-vif-plugged:06fea704-e356-4605-811e-aac91617290e for instance 267c17c1-f0b6-4e18-8c18-5e5bbe8a2251 on user Apr 11 19:46:38 user devstack@n-api.service[72089]: INFO nova.api.openstack.compute.server_external_events [req-a4d11359-ef7e-4e71-93a0-73e682db54f4 req-717ac6ee-1088-48ef-b96e-407b18d3fa06 service nova] Creating event network-vif-plugged:06fea704-e356-4605-811e-aac91617290e for instance 267c17c1-f0b6-4e18-8c18-5e5bbe8a2251 on user Apr 11 19:46:38 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [req-a4d11359-ef7e-4e71-93a0-73e682db54f4 req-717ac6ee-1088-48ef-b96e-407b18d3fa06 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.052744 Apr 11 19:46:38 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 339/992] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:46:38 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:46:44 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [None req-0f3edeaa-188d-4e1e-84c7-eb660fa806cd tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:46:44 user devstack@n-api.service[72090]: DEBUG nova.compute.api [None req-0f3edeaa-188d-4e1e-84c7-eb660fa806cd tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] [instance: f633037d-87d0-4dda-aa33-3cc9c3191080] Fetching instance by UUID {{(pid=72090) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:46:44 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-0f3edeaa-188d-4e1e-84c7-eb660fa806cd tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:46:44 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-0f3edeaa-188d-4e1e-84c7-eb660fa806cd tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:46:44 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-0f3edeaa-188d-4e1e-84c7-eb660fa806cd tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:46:44 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-0f3edeaa-188d-4e1e-84c7-eb660fa806cd tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:46:44 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-0f3edeaa-188d-4e1e-84c7-eb660fa806cd tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:46:44 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-0f3edeaa-188d-4e1e-84c7-eb660fa806cd tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:46:44 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [None req-0f3edeaa-188d-4e1e-84c7-eb660fa806cd tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] 10.0.0.210 "POST /compute/v2.1/servers/f633037d-87d0-4dda-aa33-3cc9c3191080/action" status: 204 len: 0 microversion: 2.1 time: 0.079747 Apr 11 19:46:44 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 330/993] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Apr 11 19:46:44 2023] POST /compute/v2.1/servers/f633037d-87d0-4dda-aa33-3cc9c3191080/action => generated 0 bytes in 82 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 11 19:46:44 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [None req-e3eb3da1-6e66-48c6-ac71-507ce5f96899 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Calling method '>' {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:46:44 user devstack@n-api.service[72088]: DEBUG nova.compute.api [None req-e3eb3da1-6e66-48c6-ac71-507ce5f96899 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] [instance: f633037d-87d0-4dda-aa33-3cc9c3191080] Fetching instance by UUID {{(pid=72088) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:46:44 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-e3eb3da1-6e66-48c6-ac71-507ce5f96899 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:46:44 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-e3eb3da1-6e66-48c6-ac71-507ce5f96899 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:46:44 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-e3eb3da1-6e66-48c6-ac71-507ce5f96899 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:46:44 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-e3eb3da1-6e66-48c6-ac71-507ce5f96899 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:46:44 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-e3eb3da1-6e66-48c6-ac71-507ce5f96899 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:46:44 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-e3eb3da1-6e66-48c6-ac71-507ce5f96899 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:46:45 user devstack@n-api.service[72088]: DEBUG nova.policy [None req-e3eb3da1-6e66-48c6-ac71-507ce5f96899 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05fb551c320a48f98a4ec00a7f7492d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60a7381a31b84e97a068528f90813773', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72088) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:46:45 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [None req-e3eb3da1-6e66-48c6-ac71-507ce5f96899 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f633037d-87d0-4dda-aa33-3cc9c3191080" status: 200 len: 1554 microversion: 2.1 time: 0.173379 Apr 11 19:46:45 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 325/994] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 19:46:44 2023] GET /compute/v2.1/servers/f633037d-87d0-4dda-aa33-3cc9c3191080 => generated 1554 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:46:49 user devstack@n-api.service[72089]: DEBUG dbcounter [-] [72089] Writing DB stats nova_api:SELECT=4 {{(pid=72089) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:46:49 user devstack@n-api.service[72089]: DEBUG dbcounter [-] [72089] Writing DB stats nova_cell1:SELECT=8 {{(pid=72089) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:46:49 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [None req-6fdeeef5-4de2-4287-85a3-1579f4bb1287 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Calling method '>' {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:46:49 user devstack@n-api.service[72089]: DEBUG nova.compute.api [None req-6fdeeef5-4de2-4287-85a3-1579f4bb1287 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] [instance: 6b110aaa-0f26-4bab-8f3e-d22edb5a5072] Fetching instance by UUID {{(pid=72089) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:46:49 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-6fdeeef5-4de2-4287-85a3-1579f4bb1287 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:46:49 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-6fdeeef5-4de2-4287-85a3-1579f4bb1287 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:46:49 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-6fdeeef5-4de2-4287-85a3-1579f4bb1287 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:46:49 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-6fdeeef5-4de2-4287-85a3-1579f4bb1287 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:46:49 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-6fdeeef5-4de2-4287-85a3-1579f4bb1287 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:46:49 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-6fdeeef5-4de2-4287-85a3-1579f4bb1287 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:46:49 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [None req-6fdeeef5-4de2-4287-85a3-1579f4bb1287 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6b110aaa-0f26-4bab-8f3e-d22edb5a5072/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048153 Apr 11 19:46:49 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 340/995] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Apr 11 19:46:49 2023] GET /compute/v2.1/servers/6b110aaa-0f26-4bab-8f3e-d22edb5a5072/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 11 19:46:50 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [None req-536552a4-2d7a-44d2-bc4d-00845a5f44cf tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "207baeec-84ed-4c06-9ec9-ffa8bae0bac8"}} {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:46:50 user devstack@n-api.service[72090]: DEBUG nova.compute.api [None req-536552a4-2d7a-44d2-bc4d-00845a5f44cf tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] [instance: 6b110aaa-0f26-4bab-8f3e-d22edb5a5072] Fetching instance by UUID {{(pid=72090) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:46:50 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-536552a4-2d7a-44d2-bc4d-00845a5f44cf tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:46:50 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-536552a4-2d7a-44d2-bc4d-00845a5f44cf tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:46:50 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-536552a4-2d7a-44d2-bc4d-00845a5f44cf tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:46:50 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-536552a4-2d7a-44d2-bc4d-00845a5f44cf tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:46:50 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-536552a4-2d7a-44d2-bc4d-00845a5f44cf tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:46:50 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-536552a4-2d7a-44d2-bc4d-00845a5f44cf tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:46:51 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [None req-536552a4-2d7a-44d2-bc4d-00845a5f44cf tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] 10.0.0.210 "POST /compute/v2.1/servers/6b110aaa-0f26-4bab-8f3e-d22edb5a5072/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.286168 Apr 11 19:46:51 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 331/996] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Apr 11 19:46:50 2023] POST /compute/v2.1/servers/6b110aaa-0f26-4bab-8f3e-d22edb5a5072/os-volume_attachments => generated 194 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:46:58 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [None req-21bf8e88-daa9-4f09-8dce-6dd0c03568ae tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Calling method '>' {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:46:58 user devstack@n-api.service[72088]: DEBUG nova.compute.api [None req-21bf8e88-daa9-4f09-8dce-6dd0c03568ae tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] [instance: 589934d3-f72e-49d4-a230-1748ba0d5ee2] Fetching instance by UUID {{(pid=72088) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:46:58 user devstack@n-api.service[72088]: DEBUG dbcounter [-] [72088] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=72088) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:46:58 user devstack@n-api.service[72088]: DEBUG dbcounter [-] [72088] Writing DB stats nova_cell1:SELECT=23,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=72088) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:46:58 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-21bf8e88-daa9-4f09-8dce-6dd0c03568ae tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:46:58 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-21bf8e88-daa9-4f09-8dce-6dd0c03568ae tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:46:58 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-21bf8e88-daa9-4f09-8dce-6dd0c03568ae tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:46:58 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-21bf8e88-daa9-4f09-8dce-6dd0c03568ae tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:46:58 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-21bf8e88-daa9-4f09-8dce-6dd0c03568ae tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:46:58 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-21bf8e88-daa9-4f09-8dce-6dd0c03568ae tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:46:59 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [None req-880acfa4-c7ab-4d52-b14a-703a96579f93 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Calling method '>' {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:46:59 user devstack@n-api.service[72089]: DEBUG nova.compute.api [None req-880acfa4-c7ab-4d52-b14a-703a96579f93 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] [instance: 6b110aaa-0f26-4bab-8f3e-d22edb5a5072] Fetching instance by UUID {{(pid=72089) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:46:59 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-880acfa4-c7ab-4d52-b14a-703a96579f93 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:46:59 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-880acfa4-c7ab-4d52-b14a-703a96579f93 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:46:59 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-880acfa4-c7ab-4d52-b14a-703a96579f93 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:46:59 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-880acfa4-c7ab-4d52-b14a-703a96579f93 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:46:59 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-880acfa4-c7ab-4d52-b14a-703a96579f93 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:46:59 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-880acfa4-c7ab-4d52-b14a-703a96579f93 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:46:59 user devstack@n-api.service[72088]: DEBUG nova.policy [None req-21bf8e88-daa9-4f09-8dce-6dd0c03568ae tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf262cd03f4a41c4956d8784cf37d86d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caba0618fc743e7bfb2dd866a511df9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72088) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:46:59 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [None req-21bf8e88-daa9-4f09-8dce-6dd0c03568ae tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] 10.0.0.210 "GET /compute/v2.1/servers/589934d3-f72e-49d4-a230-1748ba0d5ee2" status: 200 len: 1440 microversion: 2.1 time: 0.258271 Apr 11 19:46:59 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 326/997] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 19:46:58 2023] GET /compute/v2.1/servers/589934d3-f72e-49d4-a230-1748ba0d5ee2 => generated 1440 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:46:59 user devstack@n-api.service[72089]: DEBUG nova.objects.instance [None req-880acfa4-c7ab-4d52-b14a-703a96579f93 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Lazy-loading 'services' on Instance uuid 6b110aaa-0f26-4bab-8f3e-d22edb5a5072 {{(pid=72089) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 11 19:46:59 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [None req-880acfa4-c7ab-4d52-b14a-703a96579f93 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/6b110aaa-0f26-4bab-8f3e-d22edb5a5072/os-volume_attachments/207baeec-84ed-4c06-9ec9-ffa8bae0bac8" status: 202 len: 0 microversion: 2.1 time: 0.229942 Apr 11 19:46:59 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 341/998] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Apr 11 19:46:59 2023] DELETE /compute/v2.1/servers/6b110aaa-0f26-4bab-8f3e-d22edb5a5072/os-volume_attachments/207baeec-84ed-4c06-9ec9-ffa8bae0bac8 => generated 0 bytes in 231 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 19:46:59 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [None req-558ab634-d83f-495a-8a93-f6e97d32a166 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Calling method '>' {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:46:59 user devstack@n-api.service[72090]: DEBUG nova.compute.api [None req-558ab634-d83f-495a-8a93-f6e97d32a166 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] [instance: 6b110aaa-0f26-4bab-8f3e-d22edb5a5072] Fetching instance by UUID {{(pid=72090) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:46:59 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-558ab634-d83f-495a-8a93-f6e97d32a166 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:46:59 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-558ab634-d83f-495a-8a93-f6e97d32a166 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:46:59 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-558ab634-d83f-495a-8a93-f6e97d32a166 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:46:59 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-558ab634-d83f-495a-8a93-f6e97d32a166 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:46:59 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-558ab634-d83f-495a-8a93-f6e97d32a166 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:46:59 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-558ab634-d83f-495a-8a93-f6e97d32a166 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:46:59 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [None req-558ab634-d83f-495a-8a93-f6e97d32a166 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6b110aaa-0f26-4bab-8f3e-d22edb5a5072/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.071259 Apr 11 19:46:59 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 332/999] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Apr 11 19:46:59 2023] GET /compute/v2.1/servers/6b110aaa-0f26-4bab-8f3e-d22edb5a5072/os-volume_attachments => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 11 19:47:00 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [req-406bfe28-4b8b-49a9-9910-cfaa20403f86 req-7f99c817-c0d5-4c1a-a943-5afff9c8ec93 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "589934d3-f72e-49d4-a230-1748ba0d5ee2", "tag": "42d318d4-06e2-42de-93b2-504f5a5a51e5"}]} {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:47:00 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-406bfe28-4b8b-49a9-9910-cfaa20403f86 req-7f99c817-c0d5-4c1a-a943-5afff9c8ec93 service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:47:00 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-406bfe28-4b8b-49a9-9910-cfaa20403f86 req-7f99c817-c0d5-4c1a-a943-5afff9c8ec93 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:47:00 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-406bfe28-4b8b-49a9-9910-cfaa20403f86 req-7f99c817-c0d5-4c1a-a943-5afff9c8ec93 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:47:00 user devstack@n-api.service[72088]: INFO nova.api.openstack.compute.server_external_events [req-406bfe28-4b8b-49a9-9910-cfaa20403f86 req-7f99c817-c0d5-4c1a-a943-5afff9c8ec93 service nova] Creating event network-changed:42d318d4-06e2-42de-93b2-504f5a5a51e5 for instance 589934d3-f72e-49d4-a230-1748ba0d5ee2 on user Apr 11 19:47:00 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [req-406bfe28-4b8b-49a9-9910-cfaa20403f86 req-7f99c817-c0d5-4c1a-a943-5afff9c8ec93 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043455 Apr 11 19:47:00 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 327/1000] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:47:00 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:47:02 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [None req-6cda8961-537a-48f1-8d4a-c39fbf704fd2 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Calling method '>' {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:47:02 user devstack@n-api.service[72089]: DEBUG nova.compute.api [None req-6cda8961-537a-48f1-8d4a-c39fbf704fd2 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] [instance: 589934d3-f72e-49d4-a230-1748ba0d5ee2] Fetching instance by UUID {{(pid=72089) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:47:02 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-6cda8961-537a-48f1-8d4a-c39fbf704fd2 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:47:02 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-6cda8961-537a-48f1-8d4a-c39fbf704fd2 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:47:02 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-6cda8961-537a-48f1-8d4a-c39fbf704fd2 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:47:02 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [req-a4da0fbf-251e-4a6b-8aa0-c93b1bc5bc11 req-6db94353-c4c8-4a4e-a36a-01a37fd8fb77 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "589934d3-f72e-49d4-a230-1748ba0d5ee2", "tag": "42d318d4-06e2-42de-93b2-504f5a5a51e5"}]} {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:47:02 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-6cda8961-537a-48f1-8d4a-c39fbf704fd2 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:47:02 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-6cda8961-537a-48f1-8d4a-c39fbf704fd2 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:47:02 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-6cda8961-537a-48f1-8d4a-c39fbf704fd2 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:47:02 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-a4da0fbf-251e-4a6b-8aa0-c93b1bc5bc11 req-6db94353-c4c8-4a4e-a36a-01a37fd8fb77 service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:47:02 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-a4da0fbf-251e-4a6b-8aa0-c93b1bc5bc11 req-6db94353-c4c8-4a4e-a36a-01a37fd8fb77 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:47:02 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-a4da0fbf-251e-4a6b-8aa0-c93b1bc5bc11 req-6db94353-c4c8-4a4e-a36a-01a37fd8fb77 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:47:02 user devstack@n-api.service[72090]: INFO nova.api.openstack.compute.server_external_events [req-a4da0fbf-251e-4a6b-8aa0-c93b1bc5bc11 req-6db94353-c4c8-4a4e-a36a-01a37fd8fb77 service nova] Creating event network-changed:42d318d4-06e2-42de-93b2-504f5a5a51e5 for instance 589934d3-f72e-49d4-a230-1748ba0d5ee2 on user Apr 11 19:47:02 user devstack@n-api.service[72089]: DEBUG nova.compute.api [None req-6cda8961-537a-48f1-8d4a-c39fbf704fd2 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] [instance: 589934d3-f72e-49d4-a230-1748ba0d5ee2] Going to try to terminate instance {{(pid=72089) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 11 19:47:02 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [req-a4da0fbf-251e-4a6b-8aa0-c93b1bc5bc11 req-6db94353-c4c8-4a4e-a36a-01a37fd8fb77 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032090 Apr 11 19:47:02 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 333/1001] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:47:02 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 11 19:47:02 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [None req-6cda8961-537a-48f1-8d4a-c39fbf704fd2 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/589934d3-f72e-49d4-a230-1748ba0d5ee2" status: 204 len: 0 microversion: 2.1 time: 0.118684 Apr 11 19:47:02 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 342/1002] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 19:47:02 2023] DELETE /compute/v2.1/servers/589934d3-f72e-49d4-a230-1748ba0d5ee2 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 11 19:47:02 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [None req-6081760c-59d1-4a3b-8adf-a3dfb9ea2a22 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Calling method '>' {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:47:02 user devstack@n-api.service[72088]: DEBUG nova.compute.api [None req-6081760c-59d1-4a3b-8adf-a3dfb9ea2a22 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] [instance: 589934d3-f72e-49d4-a230-1748ba0d5ee2] Fetching instance by UUID {{(pid=72088) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:47:02 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-6081760c-59d1-4a3b-8adf-a3dfb9ea2a22 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:47:02 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-6081760c-59d1-4a3b-8adf-a3dfb9ea2a22 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:47:02 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-6081760c-59d1-4a3b-8adf-a3dfb9ea2a22 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:47:02 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-6081760c-59d1-4a3b-8adf-a3dfb9ea2a22 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:47:02 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-6081760c-59d1-4a3b-8adf-a3dfb9ea2a22 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:47:02 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-6081760c-59d1-4a3b-8adf-a3dfb9ea2a22 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:47:02 user devstack@n-api.service[72088]: DEBUG nova.policy [None req-6081760c-59d1-4a3b-8adf-a3dfb9ea2a22 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf262cd03f4a41c4956d8784cf37d86d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caba0618fc743e7bfb2dd866a511df9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72088) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:47:02 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [None req-6081760c-59d1-4a3b-8adf-a3dfb9ea2a22 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] 10.0.0.210 "GET /compute/v2.1/servers/589934d3-f72e-49d4-a230-1748ba0d5ee2" status: 200 len: 1563 microversion: 2.1 time: 0.168890 Apr 11 19:47:02 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 328/1003] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 19:47:02 2023] GET /compute/v2.1/servers/589934d3-f72e-49d4-a230-1748ba0d5ee2 => generated 1563 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:47:04 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [req-010500e4-d036-4e77-8fe8-f672c7605eca req-ced4f526-1581-4bd8-98e8-ed656a86d433 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "589934d3-f72e-49d4-a230-1748ba0d5ee2", "name": "network-vif-deleted", "tag": "42d318d4-06e2-42de-93b2-504f5a5a51e5"}]} {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:47:04 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-010500e4-d036-4e77-8fe8-f672c7605eca req-ced4f526-1581-4bd8-98e8-ed656a86d433 service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:47:04 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-010500e4-d036-4e77-8fe8-f672c7605eca req-ced4f526-1581-4bd8-98e8-ed656a86d433 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:47:04 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-010500e4-d036-4e77-8fe8-f672c7605eca req-ced4f526-1581-4bd8-98e8-ed656a86d433 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:47:04 user devstack@n-api.service[72090]: INFO nova.api.openstack.compute.server_external_events [req-010500e4-d036-4e77-8fe8-f672c7605eca req-ced4f526-1581-4bd8-98e8-ed656a86d433 service nova] Creating event network-vif-deleted:42d318d4-06e2-42de-93b2-504f5a5a51e5 for instance 589934d3-f72e-49d4-a230-1748ba0d5ee2 on user Apr 11 19:47:04 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [req-010500e4-d036-4e77-8fe8-f672c7605eca req-ced4f526-1581-4bd8-98e8-ed656a86d433 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034160 Apr 11 19:47:04 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 334/1004] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:47:04 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:47:04 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [req-bf18f577-9ad4-41d7-9752-274b1dba6f73 req-d7a43f8b-9e4e-4e97-b1cf-cb3ff052d73b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "589934d3-f72e-49d4-a230-1748ba0d5ee2", "name": "network-vif-unplugged", "status": "completed", "tag": "42d318d4-06e2-42de-93b2-504f5a5a51e5"}, {"server_uuid": "589934d3-f72e-49d4-a230-1748ba0d5ee2", "name": "network-vif-plugged", "status": "completed", "tag": "42d318d4-06e2-42de-93b2-504f5a5a51e5"}]} {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:47:04 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-bf18f577-9ad4-41d7-9752-274b1dba6f73 req-d7a43f8b-9e4e-4e97-b1cf-cb3ff052d73b service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:47:04 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-bf18f577-9ad4-41d7-9752-274b1dba6f73 req-d7a43f8b-9e4e-4e97-b1cf-cb3ff052d73b service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:47:04 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-bf18f577-9ad4-41d7-9752-274b1dba6f73 req-d7a43f8b-9e4e-4e97-b1cf-cb3ff052d73b service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:47:04 user devstack@n-api.service[72089]: INFO nova.api.openstack.compute.server_external_events [req-bf18f577-9ad4-41d7-9752-274b1dba6f73 req-d7a43f8b-9e4e-4e97-b1cf-cb3ff052d73b service nova] Creating event network-vif-unplugged:42d318d4-06e2-42de-93b2-504f5a5a51e5 for instance 589934d3-f72e-49d4-a230-1748ba0d5ee2 on user Apr 11 19:47:04 user devstack@n-api.service[72089]: INFO nova.api.openstack.compute.server_external_events [req-bf18f577-9ad4-41d7-9752-274b1dba6f73 req-d7a43f8b-9e4e-4e97-b1cf-cb3ff052d73b service nova] Creating event network-vif-plugged:42d318d4-06e2-42de-93b2-504f5a5a51e5 for instance 589934d3-f72e-49d4-a230-1748ba0d5ee2 on user Apr 11 19:47:04 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [req-bf18f577-9ad4-41d7-9752-274b1dba6f73 req-d7a43f8b-9e4e-4e97-b1cf-cb3ff052d73b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.030718 Apr 11 19:47:04 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 343/1005] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:47:04 2023] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:47:26 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [None req-0ce39c12-a4e0-4a12-af1e-628e619b4586 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Calling method '>' {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:47:26 user devstack@n-api.service[72088]: DEBUG nova.compute.api [None req-0ce39c12-a4e0-4a12-af1e-628e619b4586 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] [instance: 267c17c1-f0b6-4e18-8c18-5e5bbe8a2251] Fetching instance by UUID {{(pid=72088) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:47:26 user devstack@n-api.service[72088]: DEBUG dbcounter [-] [72088] Writing DB stats nova_api:SELECT=6 {{(pid=72088) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:47:26 user devstack@n-api.service[72088]: DEBUG dbcounter [-] [72088] Writing DB stats nova_cell1:SELECT=14 {{(pid=72088) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:47:26 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-0ce39c12-a4e0-4a12-af1e-628e619b4586 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:47:26 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-0ce39c12-a4e0-4a12-af1e-628e619b4586 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:47:26 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-0ce39c12-a4e0-4a12-af1e-628e619b4586 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:47:26 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-0ce39c12-a4e0-4a12-af1e-628e619b4586 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:47:26 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-0ce39c12-a4e0-4a12-af1e-628e619b4586 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:47:26 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-0ce39c12-a4e0-4a12-af1e-628e619b4586 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:47:26 user devstack@n-api.service[72088]: INFO nova.api.openstack.wsgi [None req-0ce39c12-a4e0-4a12-af1e-628e619b4586 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] HTTP exception thrown: Instance 267c17c1-f0b6-4e18-8c18-5e5bbe8a2251 could not be found. Apr 11 19:47:26 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [None req-0ce39c12-a4e0-4a12-af1e-628e619b4586 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Request method failure captured: Apr 11 19:47:26 user devstack@n-api.service[72088]: request: GET /compute/v2.1/servers/267c17c1-f0b6-4e18-8c18-5e5bbe8a2251 HTTP/1.1 Apr 11 19:47:26 user devstack@n-api.service[72088]: Accept: application/json Apr 11 19:47:26 user devstack@n-api.service[72088]: Accept-Encoding: identity Apr 11 19:47:26 user devstack@n-api.service[72088]: Connection: close Apr 11 19:47:26 user devstack@n-api.service[72088]: Content-Length: 0 Apr 11 19:47:26 user devstack@n-api.service[72088]: Content-Type: application/json Apr 11 19:47:26 user devstack@n-api.service[72088]: Host: 10.0.0.210 Apr 11 19:47:26 user devstack@n-api.service[72088]: Openstack-System-Scope: None Apr 11 19:47:26 user devstack@n-api.service[72088]: User-Agent: python-urllib3/1.26.15 Apr 11 19:47:26 user devstack@n-api.service[72088]: X-Auth-Token: gAAAAABkNbUs3sGO0rC9Wf1HLL6y1zTXQ2xF2dMBaRGrgCkjSdBXMgDkz15sqaczXa_JcLLMjTSvFMatkt2Ta8S0VFlkGMqdbOYT7FNOzdcAgJLJI5j09-UAdp8WgiUM6SYPHBZLPS_ENQDMUXHUhrQJgHrsBuBOiq0wzxzQWDwcJRw-4wyoV9E Apr 11 19:47:26 user devstack@n-api.service[72088]: X-Domain-Id: None Apr 11 19:47:26 user devstack@n-api.service[72088]: X-Domain-Name: None Apr 11 19:47:26 user devstack@n-api.service[72088]: X-Identity-Status: Confirmed Apr 11 19:47:26 user devstack@n-api.service[72088]: X-Is-Admin-Project: True Apr 11 19:47:26 user devstack@n-api.service[72088]: X-Project-Domain-Id: default Apr 11 19:47:26 user devstack@n-api.service[72088]: X-Project-Domain-Name: Default Apr 11 19:47:26 user devstack@n-api.service[72088]: X-Project-Id: b8e3a291c54b49db8e12a88ba41865e3 Apr 11 19:47:26 user devstack@n-api.service[72088]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1429831687 Apr 11 19:47:26 user devstack@n-api.service[72088]: X-Role: reader,member Apr 11 19:47:26 user devstack@n-api.service[72088]: X-Roles: reader,member Apr 11 19:47:26 user devstack@n-api.service[72088]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b8e3a291c54b49db8e12a88ba41865e3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/b8e3a291c54b49db8e12a88ba41865e3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b8e3a291c54b49db8e12a88ba41865e3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 11 19:47:26 user devstack@n-api.service[72088]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1429831687 Apr 11 19:47:26 user devstack@n-api.service[72088]: X-Tenant-Id: b8e3a291c54b49db8e12a88ba41865e3 Apr 11 19:47:26 user devstack@n-api.service[72088]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1429831687 Apr 11 19:47:26 user devstack@n-api.service[72088]: X-User: tempest-ServerRescueNegativeTestJSON-1429831687-project-member Apr 11 19:47:26 user devstack@n-api.service[72088]: X-User-Domain-Id: default Apr 11 19:47:26 user devstack@n-api.service[72088]: X-User-Domain-Name: Default Apr 11 19:47:26 user devstack@n-api.service[72088]: X-User-Id: ba7f82b529e74d99838b6264b94d823b Apr 11 19:47:26 user devstack@n-api.service[72088]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1429831687-project-member Apr 11 19:47:26 user devstack@n-api.service[72088]: method: > Apr 11 19:47:26 user devstack@n-api.service[72088]: exception: Instance 267c17c1-f0b6-4e18-8c18-5e5bbe8a2251 could not be found. Apr 11 19:47:26 user devstack@n-api.service[72088]: action_args: {'id': '267c17c1-f0b6-4e18-8c18-5e5bbe8a2251'} Apr 11 19:47:26 user devstack@n-api.service[72088]: {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 19:47:26 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:47:26 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 19:47:26 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 19:47:26 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 19:47:26 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 19:47:26 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 19:47:26 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 19:47:26 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 19:47:26 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 19:47:26 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 267c17c1-f0b6-4e18-8c18-5e5bbe8a2251 could not be found. Apr 11 19:47:26 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi Apr 11 19:47:26 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 19:47:26 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi Apr 11 19:47:26 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:47:26 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 19:47:26 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 19:47:26 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 19:47:26 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 19:47:26 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 19:47:26 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 19:47:26 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 19:47:26 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 19:47:26 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 19:47:26 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 19:47:26 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 19:47:26 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 19:47:26 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 267c17c1-f0b6-4e18-8c18-5e5bbe8a2251 could not be found. Apr 11 19:47:26 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi Apr 11 19:47:26 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 19:47:26 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi Apr 11 19:47:26 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:47:26 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 19:47:26 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 19:47:26 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 19:47:26 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 19:47:26 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 267c17c1-f0b6-4e18-8c18-5e5bbe8a2251 could not be found. Apr 11 19:47:26 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi Apr 11 19:47:26 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [None req-0ce39c12-a4e0-4a12-af1e-628e619b4586 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Returning 404 to user: Instance 267c17c1-f0b6-4e18-8c18-5e5bbe8a2251 could not be found. {{(pid=72088) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 19:47:26 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [None req-0ce39c12-a4e0-4a12-af1e-628e619b4586 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] 10.0.0.210 "GET /compute/v2.1/servers/267c17c1-f0b6-4e18-8c18-5e5bbe8a2251" status: 404 len: 111 microversion: 2.1 time: 0.030602 Apr 11 19:47:26 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 329/1006] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 19:47:26 2023] GET /compute/v2.1/servers/267c17c1-f0b6-4e18-8c18-5e5bbe8a2251 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 19:47:35 user devstack@n-api.service[72090]: DEBUG dbcounter [-] [72090] Writing DB stats nova_api:SELECT=14 {{(pid=72090) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:47:35 user devstack@n-api.service[72090]: DEBUG dbcounter [-] [72090] Writing DB stats nova_cell1:SELECT=36,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=72090) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:47:35 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [None req-22acd3fd-42b0-4d35-b858-402f90cd8c32 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Calling method '>' {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:47:35 user devstack@n-api.service[72090]: DEBUG nova.compute.api [None req-22acd3fd-42b0-4d35-b858-402f90cd8c32 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] [instance: f633037d-87d0-4dda-aa33-3cc9c3191080] Fetching instance by UUID {{(pid=72090) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:47:35 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-22acd3fd-42b0-4d35-b858-402f90cd8c32 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:47:35 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-22acd3fd-42b0-4d35-b858-402f90cd8c32 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:47:35 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-22acd3fd-42b0-4d35-b858-402f90cd8c32 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:47:35 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-22acd3fd-42b0-4d35-b858-402f90cd8c32 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:47:35 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-22acd3fd-42b0-4d35-b858-402f90cd8c32 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:47:35 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-22acd3fd-42b0-4d35-b858-402f90cd8c32 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:47:35 user devstack@n-api.service[72090]: DEBUG nova.policy [None req-22acd3fd-42b0-4d35-b858-402f90cd8c32 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05fb551c320a48f98a4ec00a7f7492d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60a7381a31b84e97a068528f90813773', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72090) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:47:35 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [None req-22acd3fd-42b0-4d35-b858-402f90cd8c32 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f633037d-87d0-4dda-aa33-3cc9c3191080" status: 200 len: 1546 microversion: 2.1 time: 0.227595 Apr 11 19:47:35 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 335/1007] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 19:47:35 2023] GET /compute/v2.1/servers/f633037d-87d0-4dda-aa33-3cc9c3191080 => generated 1546 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:47:48 user devstack@n-api.service[72089]: DEBUG dbcounter [-] [72089] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=72089) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:47:48 user devstack@n-api.service[72089]: DEBUG dbcounter [-] [72089] Writing DB stats nova_cell1:SELECT=32,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=72089) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:47:48 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [None req-fd54712e-6190-4c63-8130-52c820e12c75 tempest-VolumesActionsTest-283035711 tempest-VolumesActionsTest-283035711-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-467460675", "imageRef": "4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b", "flavorRef": "42", "networks": [{"uuid": "50e7af77-f722-402c-963f-0bfb77a025f7"}]}} {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:47:48 user devstack@n-api.service[72089]: DEBUG nova.network.neutron [None req-fd54712e-6190-4c63-8130-52c820e12c75 tempest-VolumesActionsTest-283035711 tempest-VolumesActionsTest-283035711-project-member] validate_networks() for [('50e7af77-f722-402c-963f-0bfb77a025f7', None, None, None, None, None)] {{(pid=72089) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 11 19:47:49 user devstack@n-api.service[72089]: DEBUG nova.virt.hardware [None req-fd54712e-6190-4c63-8130-52c820e12c75 tempest-VolumesActionsTest-283035711 tempest-VolumesActionsTest-283035711-project-member] Flavor limits 0:0:0 {{(pid=72089) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 19:47:49 user devstack@n-api.service[72089]: DEBUG nova.virt.hardware [None req-fd54712e-6190-4c63-8130-52c820e12c75 tempest-VolumesActionsTest-283035711 tempest-VolumesActionsTest-283035711-project-member] Image limits 0:0:0 {{(pid=72089) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 19:47:49 user devstack@n-api.service[72089]: DEBUG nova.virt.hardware [None req-fd54712e-6190-4c63-8130-52c820e12c75 tempest-VolumesActionsTest-283035711 tempest-VolumesActionsTest-283035711-project-member] Flavor pref 0:0:0 {{(pid=72089) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 19:47:49 user devstack@n-api.service[72089]: DEBUG nova.virt.hardware [None req-fd54712e-6190-4c63-8130-52c820e12c75 tempest-VolumesActionsTest-283035711 tempest-VolumesActionsTest-283035711-project-member] Image pref 0:0:0 {{(pid=72089) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 19:47:49 user devstack@n-api.service[72089]: DEBUG nova.virt.hardware [None req-fd54712e-6190-4c63-8130-52c820e12c75 tempest-VolumesActionsTest-283035711 tempest-VolumesActionsTest-283035711-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72089) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 19:47:49 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-fd54712e-6190-4c63-8130-52c820e12c75 tempest-VolumesActionsTest-283035711 tempest-VolumesActionsTest-283035711-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:47:49 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-fd54712e-6190-4c63-8130-52c820e12c75 tempest-VolumesActionsTest-283035711 tempest-VolumesActionsTest-283035711-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:47:49 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-fd54712e-6190-4c63-8130-52c820e12c75 tempest-VolumesActionsTest-283035711 tempest-VolumesActionsTest-283035711-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:47:49 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-fd54712e-6190-4c63-8130-52c820e12c75 tempest-VolumesActionsTest-283035711 tempest-VolumesActionsTest-283035711-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:47:49 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-fd54712e-6190-4c63-8130-52c820e12c75 tempest-VolumesActionsTest-283035711 tempest-VolumesActionsTest-283035711-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:47:49 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-fd54712e-6190-4c63-8130-52c820e12c75 tempest-VolumesActionsTest-283035711 tempest-VolumesActionsTest-283035711-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:47:49 user devstack@n-api.service[72089]: DEBUG nova.quota [None req-fd54712e-6190-4c63-8130-52c820e12c75 tempest-VolumesActionsTest-283035711 tempest-VolumesActionsTest-283035711-project-member] Getting quotas for project 56b09d8c9ff94045a36fdc454f8875e8. Resources: {'ram', 'instances', 'cores'} {{(pid=72089) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 19:47:49 user devstack@n-api.service[72089]: DEBUG nova.quota [None req-fd54712e-6190-4c63-8130-52c820e12c75 tempest-VolumesActionsTest-283035711 tempest-VolumesActionsTest-283035711-project-member] Getting quotas for user 98feebb43745423299d602c50d09d982 and project 56b09d8c9ff94045a36fdc454f8875e8. Resources: {'ram', 'instances', 'cores'} {{(pid=72089) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 19:47:49 user devstack@n-api.service[72089]: DEBUG nova.compute.api [None req-fd54712e-6190-4c63-8130-52c820e12c75 tempest-VolumesActionsTest-283035711 tempest-VolumesActionsTest-283035711-project-member] Going to run 1 instances... {{(pid=72089) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 11 19:47:49 user devstack@n-api.service[72089]: DEBUG nova.compute.api [None req-fd54712e-6190-4c63-8130-52c820e12c75 tempest-VolumesActionsTest-283035711 tempest-VolumesActionsTest-283035711-project-member] [instance: e5a20eb7-20f0-4adc-bd8c-b9bf25c46c04] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=72089) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 11 19:47:49 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [None req-fd54712e-6190-4c63-8130-52c820e12c75 tempest-VolumesActionsTest-283035711 tempest-VolumesActionsTest-283035711-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.713715 Apr 11 19:47:49 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 344/1008] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 11 19:47:48 2023] POST /compute/v2.1/servers => generated 378 bytes in 715 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 11 19:47:49 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [None req-c5b7eecf-e7b5-44bc-9701-d873056ac805 tempest-VolumesActionsTest-283035711 tempest-VolumesActionsTest-283035711-project-member] Calling method '>' {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:47:49 user devstack@n-api.service[72088]: DEBUG nova.compute.api [None req-c5b7eecf-e7b5-44bc-9701-d873056ac805 tempest-VolumesActionsTest-283035711 tempest-VolumesActionsTest-283035711-project-member] [instance: e5a20eb7-20f0-4adc-bd8c-b9bf25c46c04] Fetching instance by UUID {{(pid=72088) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:47:49 user devstack@n-api.service[72088]: DEBUG dbcounter [-] [72088] Writing DB stats nova_api:SELECT=2 {{(pid=72088) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:47:49 user devstack@n-api.service[72088]: DEBUG dbcounter [-] [72088] Writing DB stats nova_cell1:SELECT=2 {{(pid=72088) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:47:49 user devstack@n-api.service[72088]: DEBUG nova.policy [None req-c5b7eecf-e7b5-44bc-9701-d873056ac805 tempest-VolumesActionsTest-283035711 tempest-VolumesActionsTest-283035711-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98feebb43745423299d602c50d09d982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56b09d8c9ff94045a36fdc454f8875e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72088) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:47:49 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [None req-c5b7eecf-e7b5-44bc-9701-d873056ac805 tempest-VolumesActionsTest-283035711 tempest-VolumesActionsTest-283035711-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e5a20eb7-20f0-4adc-bd8c-b9bf25c46c04" status: 200 len: 1207 microversion: 2.1 time: 0.118897 Apr 11 19:47:49 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 330/1009] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 19:47:49 2023] GET /compute/v2.1/servers/e5a20eb7-20f0-4adc-bd8c-b9bf25c46c04 => generated 1207 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:47:49 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [None req-a6d4b385-53f1-4d2a-bcab-4828b3c0a73f tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Calling method '>' {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:47:49 user devstack@n-api.service[72090]: DEBUG nova.compute.api [None req-a6d4b385-53f1-4d2a-bcab-4828b3c0a73f tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] [instance: 6b110aaa-0f26-4bab-8f3e-d22edb5a5072] Fetching instance by UUID {{(pid=72090) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:47:49 user devstack@n-api.service[72090]: DEBUG dbcounter [-] [72090] Writing DB stats nova_api:SELECT=2 {{(pid=72090) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:47:49 user devstack@n-api.service[72090]: DEBUG dbcounter [-] [72090] Writing DB stats nova_cell1:SELECT=6 {{(pid=72090) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:47:49 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-a6d4b385-53f1-4d2a-bcab-4828b3c0a73f tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:47:49 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-a6d4b385-53f1-4d2a-bcab-4828b3c0a73f tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:47:49 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-a6d4b385-53f1-4d2a-bcab-4828b3c0a73f tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:47:49 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-a6d4b385-53f1-4d2a-bcab-4828b3c0a73f tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:47:49 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-a6d4b385-53f1-4d2a-bcab-4828b3c0a73f tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:47:49 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-a6d4b385-53f1-4d2a-bcab-4828b3c0a73f tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:47:49 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [None req-a6d4b385-53f1-4d2a-bcab-4828b3c0a73f tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6b110aaa-0f26-4bab-8f3e-d22edb5a5072/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049728 Apr 11 19:47:49 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 336/1010] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Apr 11 19:47:49 2023] GET /compute/v2.1/servers/6b110aaa-0f26-4bab-8f3e-d22edb5a5072/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 11 19:47:51 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [req-e3fc8356-5ab2-4944-a496-0f6ade81f9b0 req-664044fe-6641-4482-9032-f6dece245d9b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e5a20eb7-20f0-4adc-bd8c-b9bf25c46c04", "tag": "91ae7fad-1a68-4881-8048-4fab8fcfe90a"}]} {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:47:51 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-e3fc8356-5ab2-4944-a496-0f6ade81f9b0 req-664044fe-6641-4482-9032-f6dece245d9b service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:47:51 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-e3fc8356-5ab2-4944-a496-0f6ade81f9b0 req-664044fe-6641-4482-9032-f6dece245d9b service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:47:51 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-e3fc8356-5ab2-4944-a496-0f6ade81f9b0 req-664044fe-6641-4482-9032-f6dece245d9b service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:47:51 user devstack@n-api.service[72089]: INFO nova.api.openstack.compute.server_external_events [req-e3fc8356-5ab2-4944-a496-0f6ade81f9b0 req-664044fe-6641-4482-9032-f6dece245d9b service nova] Creating event network-changed:91ae7fad-1a68-4881-8048-4fab8fcfe90a for instance e5a20eb7-20f0-4adc-bd8c-b9bf25c46c04 on user Apr 11 19:47:51 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [req-e3fc8356-5ab2-4944-a496-0f6ade81f9b0 req-664044fe-6641-4482-9032-f6dece245d9b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029087 Apr 11 19:47:51 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 345/1011] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:47:51 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:47:52 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [None req-f5be9d25-5b84-4c55-9a4b-409335e1ef06 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Calling method '>' {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:47:52 user devstack@n-api.service[72088]: DEBUG nova.compute.api [None req-f5be9d25-5b84-4c55-9a4b-409335e1ef06 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] [instance: 589934d3-f72e-49d4-a230-1748ba0d5ee2] Fetching instance by UUID {{(pid=72088) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:47:52 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-f5be9d25-5b84-4c55-9a4b-409335e1ef06 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:47:52 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-f5be9d25-5b84-4c55-9a4b-409335e1ef06 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:47:52 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-f5be9d25-5b84-4c55-9a4b-409335e1ef06 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:47:52 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-f5be9d25-5b84-4c55-9a4b-409335e1ef06 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:47:52 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-f5be9d25-5b84-4c55-9a4b-409335e1ef06 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:47:52 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-f5be9d25-5b84-4c55-9a4b-409335e1ef06 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:47:52 user devstack@n-api.service[72088]: INFO nova.api.openstack.wsgi [None req-f5be9d25-5b84-4c55-9a4b-409335e1ef06 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] HTTP exception thrown: Instance 589934d3-f72e-49d4-a230-1748ba0d5ee2 could not be found. Apr 11 19:47:52 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [None req-f5be9d25-5b84-4c55-9a4b-409335e1ef06 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Request method failure captured: Apr 11 19:47:52 user devstack@n-api.service[72088]: request: GET /compute/v2.1/servers/589934d3-f72e-49d4-a230-1748ba0d5ee2 HTTP/1.1 Apr 11 19:47:52 user devstack@n-api.service[72088]: Accept: application/json Apr 11 19:47:52 user devstack@n-api.service[72088]: Accept-Encoding: identity Apr 11 19:47:52 user devstack@n-api.service[72088]: Connection: close Apr 11 19:47:52 user devstack@n-api.service[72088]: Content-Length: 0 Apr 11 19:47:52 user devstack@n-api.service[72088]: Content-Type: application/json Apr 11 19:47:52 user devstack@n-api.service[72088]: Host: 10.0.0.210 Apr 11 19:47:52 user devstack@n-api.service[72088]: Openstack-System-Scope: None Apr 11 19:47:52 user devstack@n-api.service[72088]: User-Agent: python-urllib3/1.26.15 Apr 11 19:47:52 user devstack@n-api.service[72088]: X-Auth-Token: gAAAAABkNbWuPL7tpG6O55jvFSGO371AELCQlFZHf6FrRxh7vClaI6XXjuETFNQG4Gook2-ws7z2jCWcd2rLpcqQWtWmqjJ0M2xKefxUzDSsHikQ381w5ena7_2Zjp6vyHkrh7PG-gVY2vEL8dYAJIJ3D9B2mOuFBAai8zWGdpQnauKzi-Qcl_M Apr 11 19:47:52 user devstack@n-api.service[72088]: X-Domain-Id: None Apr 11 19:47:52 user devstack@n-api.service[72088]: X-Domain-Name: None Apr 11 19:47:52 user devstack@n-api.service[72088]: X-Identity-Status: Confirmed Apr 11 19:47:52 user devstack@n-api.service[72088]: X-Is-Admin-Project: True Apr 11 19:47:52 user devstack@n-api.service[72088]: X-Project-Domain-Id: default Apr 11 19:47:52 user devstack@n-api.service[72088]: X-Project-Domain-Name: Default Apr 11 19:47:52 user devstack@n-api.service[72088]: X-Project-Id: 2caba0618fc743e7bfb2dd866a511df9 Apr 11 19:47:52 user devstack@n-api.service[72088]: X-Project-Name: tempest-TestVolumeBootPattern-935343500 Apr 11 19:47:52 user devstack@n-api.service[72088]: X-Role: reader,member Apr 11 19:47:52 user devstack@n-api.service[72088]: X-Roles: reader,member Apr 11 19:47:52 user devstack@n-api.service[72088]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2caba0618fc743e7bfb2dd866a511df9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/2caba0618fc743e7bfb2dd866a511df9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2caba0618fc743e7bfb2dd866a511df9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 11 19:47:52 user devstack@n-api.service[72088]: X-Tenant: tempest-TestVolumeBootPattern-935343500 Apr 11 19:47:52 user devstack@n-api.service[72088]: X-Tenant-Id: 2caba0618fc743e7bfb2dd866a511df9 Apr 11 19:47:52 user devstack@n-api.service[72088]: X-Tenant-Name: tempest-TestVolumeBootPattern-935343500 Apr 11 19:47:52 user devstack@n-api.service[72088]: X-User: tempest-TestVolumeBootPattern-935343500-project-member Apr 11 19:47:52 user devstack@n-api.service[72088]: X-User-Domain-Id: default Apr 11 19:47:52 user devstack@n-api.service[72088]: X-User-Domain-Name: Default Apr 11 19:47:52 user devstack@n-api.service[72088]: X-User-Id: cf262cd03f4a41c4956d8784cf37d86d Apr 11 19:47:52 user devstack@n-api.service[72088]: X-User-Name: tempest-TestVolumeBootPattern-935343500-project-member Apr 11 19:47:52 user devstack@n-api.service[72088]: method: > Apr 11 19:47:52 user devstack@n-api.service[72088]: exception: Instance 589934d3-f72e-49d4-a230-1748ba0d5ee2 could not be found. Apr 11 19:47:52 user devstack@n-api.service[72088]: action_args: {'id': '589934d3-f72e-49d4-a230-1748ba0d5ee2'} Apr 11 19:47:52 user devstack@n-api.service[72088]: {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 19:47:52 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:47:52 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 19:47:52 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 19:47:52 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 19:47:52 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 19:47:52 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 19:47:52 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 19:47:52 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 19:47:52 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 19:47:52 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 589934d3-f72e-49d4-a230-1748ba0d5ee2 could not be found. Apr 11 19:47:52 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi Apr 11 19:47:52 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 19:47:52 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi Apr 11 19:47:52 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:47:52 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 19:47:52 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 19:47:52 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 19:47:52 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 19:47:52 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 19:47:52 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 19:47:52 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 19:47:52 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 19:47:52 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 19:47:52 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 19:47:52 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 19:47:52 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 19:47:52 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 589934d3-f72e-49d4-a230-1748ba0d5ee2 could not be found. Apr 11 19:47:52 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi Apr 11 19:47:52 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 19:47:52 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi Apr 11 19:47:52 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:47:52 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 19:47:52 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 19:47:52 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 19:47:52 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 19:47:52 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 589934d3-f72e-49d4-a230-1748ba0d5ee2 could not be found. Apr 11 19:47:52 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi Apr 11 19:47:52 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [None req-f5be9d25-5b84-4c55-9a4b-409335e1ef06 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Returning 404 to user: Instance 589934d3-f72e-49d4-a230-1748ba0d5ee2 could not be found. {{(pid=72088) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 19:47:52 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [None req-f5be9d25-5b84-4c55-9a4b-409335e1ef06 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] 10.0.0.210 "GET /compute/v2.1/servers/589934d3-f72e-49d4-a230-1748ba0d5ee2" status: 404 len: 111 microversion: 2.1 time: 0.045924 Apr 11 19:47:52 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 331/1012] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 19:47:52 2023] GET /compute/v2.1/servers/589934d3-f72e-49d4-a230-1748ba0d5ee2 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 19:47:53 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [req-7ca11c1e-2975-46bb-997e-9da8838b8fc7 req-a4dacb5c-9efa-4975-96cd-8fdb330ed640 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5a20eb7-20f0-4adc-bd8c-b9bf25c46c04", "name": "network-vif-plugged", "status": "completed", "tag": "91ae7fad-1a68-4881-8048-4fab8fcfe90a"}]} {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:47:53 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-7ca11c1e-2975-46bb-997e-9da8838b8fc7 req-a4dacb5c-9efa-4975-96cd-8fdb330ed640 service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:47:53 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-7ca11c1e-2975-46bb-997e-9da8838b8fc7 req-a4dacb5c-9efa-4975-96cd-8fdb330ed640 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:47:53 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-7ca11c1e-2975-46bb-997e-9da8838b8fc7 req-a4dacb5c-9efa-4975-96cd-8fdb330ed640 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:47:53 user devstack@n-api.service[72090]: INFO nova.api.openstack.compute.server_external_events [req-7ca11c1e-2975-46bb-997e-9da8838b8fc7 req-a4dacb5c-9efa-4975-96cd-8fdb330ed640 service nova] Creating event network-vif-plugged:91ae7fad-1a68-4881-8048-4fab8fcfe90a for instance e5a20eb7-20f0-4adc-bd8c-b9bf25c46c04 on user Apr 11 19:47:53 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [req-7ca11c1e-2975-46bb-997e-9da8838b8fc7 req-a4dacb5c-9efa-4975-96cd-8fdb330ed640 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032125 Apr 11 19:47:53 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 337/1013] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:47:53 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:47:55 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [None req-2ce1dc6c-e591-4515-aac3-0472888a2362 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Calling method '>' {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:47:55 user devstack@n-api.service[72089]: DEBUG nova.compute.api [None req-2ce1dc6c-e591-4515-aac3-0472888a2362 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] [instance: a66c1d51-e194-424d-a37c-d308544774c6] Fetching instance by UUID {{(pid=72089) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:47:55 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-2ce1dc6c-e591-4515-aac3-0472888a2362 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:47:55 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-2ce1dc6c-e591-4515-aac3-0472888a2362 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:47:55 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-2ce1dc6c-e591-4515-aac3-0472888a2362 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:47:55 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-2ce1dc6c-e591-4515-aac3-0472888a2362 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:47:55 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-2ce1dc6c-e591-4515-aac3-0472888a2362 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:47:55 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-2ce1dc6c-e591-4515-aac3-0472888a2362 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:47:55 user devstack@n-api.service[72089]: DEBUG nova.compute.api [None req-2ce1dc6c-e591-4515-aac3-0472888a2362 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] [instance: a66c1d51-e194-424d-a37c-d308544774c6] Going to try to terminate instance {{(pid=72089) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 11 19:47:55 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [req-caab2910-f655-48be-8875-9fd73d4966b4 req-076fc1f5-04b3-43c1-acd2-888d910c3898 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5a20eb7-20f0-4adc-bd8c-b9bf25c46c04", "name": "network-vif-plugged", "status": "completed", "tag": "91ae7fad-1a68-4881-8048-4fab8fcfe90a"}, {"name": "network-changed", "server_uuid": "a66c1d51-e194-424d-a37c-d308544774c6", "tag": "397ebb82-45b3-41ad-bbac-ef07140bf942"}]} {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:47:55 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [None req-2ce1dc6c-e591-4515-aac3-0472888a2362 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/a66c1d51-e194-424d-a37c-d308544774c6" status: 204 len: 0 microversion: 2.1 time: 0.127520 Apr 11 19:47:55 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 346/1014] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 19:47:55 2023] DELETE /compute/v2.1/servers/a66c1d51-e194-424d-a37c-d308544774c6 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 11 19:47:55 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [None req-f7bb5f26-b96f-4c86-83fc-25bbead5ddc2 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Calling method '>' {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:47:55 user devstack@n-api.service[72090]: DEBUG nova.compute.api [None req-f7bb5f26-b96f-4c86-83fc-25bbead5ddc2 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] [instance: a66c1d51-e194-424d-a37c-d308544774c6] Fetching instance by UUID {{(pid=72090) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:47:55 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-caab2910-f655-48be-8875-9fd73d4966b4 req-076fc1f5-04b3-43c1-acd2-888d910c3898 service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:47:55 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-caab2910-f655-48be-8875-9fd73d4966b4 req-076fc1f5-04b3-43c1-acd2-888d910c3898 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:47:55 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-caab2910-f655-48be-8875-9fd73d4966b4 req-076fc1f5-04b3-43c1-acd2-888d910c3898 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:47:55 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-f7bb5f26-b96f-4c86-83fc-25bbead5ddc2 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:47:55 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-f7bb5f26-b96f-4c86-83fc-25bbead5ddc2 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:47:55 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-f7bb5f26-b96f-4c86-83fc-25bbead5ddc2 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:47:55 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-f7bb5f26-b96f-4c86-83fc-25bbead5ddc2 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:47:55 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-f7bb5f26-b96f-4c86-83fc-25bbead5ddc2 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:47:55 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-f7bb5f26-b96f-4c86-83fc-25bbead5ddc2 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:47:55 user devstack@n-api.service[72088]: INFO nova.api.openstack.compute.server_external_events [req-caab2910-f655-48be-8875-9fd73d4966b4 req-076fc1f5-04b3-43c1-acd2-888d910c3898 service nova] Creating event network-vif-plugged:91ae7fad-1a68-4881-8048-4fab8fcfe90a for instance e5a20eb7-20f0-4adc-bd8c-b9bf25c46c04 on user Apr 11 19:47:55 user devstack@n-api.service[72088]: INFO nova.api.openstack.compute.server_external_events [req-caab2910-f655-48be-8875-9fd73d4966b4 req-076fc1f5-04b3-43c1-acd2-888d910c3898 service nova] Creating event network-changed:397ebb82-45b3-41ad-bbac-ef07140bf942 for instance a66c1d51-e194-424d-a37c-d308544774c6 on user Apr 11 19:47:55 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [req-caab2910-f655-48be-8875-9fd73d4966b4 req-076fc1f5-04b3-43c1-acd2-888d910c3898 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.049615 Apr 11 19:47:55 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 332/1015] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:47:55 2023] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:47:56 user devstack@n-api.service[72090]: DEBUG nova.policy [None req-f7bb5f26-b96f-4c86-83fc-25bbead5ddc2 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf262cd03f4a41c4956d8784cf37d86d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caba0618fc743e7bfb2dd866a511df9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72090) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:47:56 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [None req-f7bb5f26-b96f-4c86-83fc-25bbead5ddc2 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a66c1d51-e194-424d-a37c-d308544774c6" status: 200 len: 1565 microversion: 2.1 time: 0.323902 Apr 11 19:47:56 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 338/1016] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 19:47:55 2023] GET /compute/v2.1/servers/a66c1d51-e194-424d-a37c-d308544774c6 => generated 1565 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:47:56 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [req-20ce2f9d-2153-416d-b977-ffa434d7d433 req-3ec4c70f-28ec-412f-b65b-bcf8b6212191 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a66c1d51-e194-424d-a37c-d308544774c6", "name": "network-vif-unplugged", "status": "completed", "tag": "397ebb82-45b3-41ad-bbac-ef07140bf942"}]} {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:47:56 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-20ce2f9d-2153-416d-b977-ffa434d7d433 req-3ec4c70f-28ec-412f-b65b-bcf8b6212191 service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:47:56 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-20ce2f9d-2153-416d-b977-ffa434d7d433 req-3ec4c70f-28ec-412f-b65b-bcf8b6212191 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:47:56 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-20ce2f9d-2153-416d-b977-ffa434d7d433 req-3ec4c70f-28ec-412f-b65b-bcf8b6212191 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:47:56 user devstack@n-api.service[72089]: INFO nova.api.openstack.compute.server_external_events [req-20ce2f9d-2153-416d-b977-ffa434d7d433 req-3ec4c70f-28ec-412f-b65b-bcf8b6212191 service nova] Creating event network-vif-unplugged:397ebb82-45b3-41ad-bbac-ef07140bf942 for instance a66c1d51-e194-424d-a37c-d308544774c6 on user Apr 11 19:47:56 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [req-20ce2f9d-2153-416d-b977-ffa434d7d433 req-3ec4c70f-28ec-412f-b65b-bcf8b6212191 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.110385 Apr 11 19:47:56 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 347/1017] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:47:56 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:47:57 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [req-3cbabc95-39b5-4236-a335-72be11e34308 req-388fabd1-dcf4-43e7-be72-dc64a7bf552c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6b110aaa-0f26-4bab-8f3e-d22edb5a5072", "tag": "8d43789b-e200-409a-b819-09dd85859b3c"}]} {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:47:57 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-3cbabc95-39b5-4236-a335-72be11e34308 req-388fabd1-dcf4-43e7-be72-dc64a7bf552c service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:47:57 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-3cbabc95-39b5-4236-a335-72be11e34308 req-388fabd1-dcf4-43e7-be72-dc64a7bf552c service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:47:57 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-3cbabc95-39b5-4236-a335-72be11e34308 req-388fabd1-dcf4-43e7-be72-dc64a7bf552c service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:47:57 user devstack@n-api.service[72088]: INFO nova.api.openstack.compute.server_external_events [req-3cbabc95-39b5-4236-a335-72be11e34308 req-388fabd1-dcf4-43e7-be72-dc64a7bf552c service nova] Creating event network-changed:8d43789b-e200-409a-b819-09dd85859b3c for instance 6b110aaa-0f26-4bab-8f3e-d22edb5a5072 on user Apr 11 19:47:57 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [req-3cbabc95-39b5-4236-a335-72be11e34308 req-388fabd1-dcf4-43e7-be72-dc64a7bf552c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032441 Apr 11 19:47:57 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 333/1018] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:47:57 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:47:58 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [req-25c64154-8861-47ca-bcaf-3d8c8bec3f40 req-762493a1-0208-4ed6-8d31-783200a6bcfd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a66c1d51-e194-424d-a37c-d308544774c6", "name": "network-vif-plugged", "status": "completed", "tag": "397ebb82-45b3-41ad-bbac-ef07140bf942"}]} {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:47:58 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-25c64154-8861-47ca-bcaf-3d8c8bec3f40 req-762493a1-0208-4ed6-8d31-783200a6bcfd service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:47:58 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-25c64154-8861-47ca-bcaf-3d8c8bec3f40 req-762493a1-0208-4ed6-8d31-783200a6bcfd service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:47:58 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-25c64154-8861-47ca-bcaf-3d8c8bec3f40 req-762493a1-0208-4ed6-8d31-783200a6bcfd service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:47:58 user devstack@n-api.service[72090]: INFO nova.api.openstack.compute.server_external_events [req-25c64154-8861-47ca-bcaf-3d8c8bec3f40 req-762493a1-0208-4ed6-8d31-783200a6bcfd service nova] Creating event network-vif-plugged:397ebb82-45b3-41ad-bbac-ef07140bf942 for instance a66c1d51-e194-424d-a37c-d308544774c6 on user Apr 11 19:47:58 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [req-25c64154-8861-47ca-bcaf-3d8c8bec3f40 req-762493a1-0208-4ed6-8d31-783200a6bcfd service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055993 Apr 11 19:47:58 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 339/1019] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:47:58 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:47:58 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [None req-a38fc98d-8d97-47a6-81a1-9e257caf29d3 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Calling method '>' {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:47:58 user devstack@n-api.service[72089]: DEBUG nova.compute.api [None req-a38fc98d-8d97-47a6-81a1-9e257caf29d3 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] [instance: 6b110aaa-0f26-4bab-8f3e-d22edb5a5072] Fetching instance by UUID {{(pid=72089) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:47:58 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-a38fc98d-8d97-47a6-81a1-9e257caf29d3 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:47:58 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-a38fc98d-8d97-47a6-81a1-9e257caf29d3 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:47:58 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-a38fc98d-8d97-47a6-81a1-9e257caf29d3 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:47:58 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-a38fc98d-8d97-47a6-81a1-9e257caf29d3 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:47:58 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-a38fc98d-8d97-47a6-81a1-9e257caf29d3 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:47:58 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-a38fc98d-8d97-47a6-81a1-9e257caf29d3 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:47:58 user devstack@n-api.service[72089]: DEBUG nova.compute.api [None req-a38fc98d-8d97-47a6-81a1-9e257caf29d3 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] [instance: 6b110aaa-0f26-4bab-8f3e-d22edb5a5072] Going to try to terminate instance {{(pid=72089) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 11 19:47:59 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [None req-a38fc98d-8d97-47a6-81a1-9e257caf29d3 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/6b110aaa-0f26-4bab-8f3e-d22edb5a5072" status: 204 len: 0 microversion: 2.1 time: 0.182276 Apr 11 19:47:59 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 348/1020] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 19:47:58 2023] DELETE /compute/v2.1/servers/6b110aaa-0f26-4bab-8f3e-d22edb5a5072 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Apr 11 19:47:59 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [None req-705991ce-df89-45ac-aa7e-2567c327aa08 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Calling method '>' {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:47:59 user devstack@n-api.service[72088]: DEBUG nova.compute.api [None req-705991ce-df89-45ac-aa7e-2567c327aa08 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] [instance: 6b110aaa-0f26-4bab-8f3e-d22edb5a5072] Fetching instance by UUID {{(pid=72088) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:47:59 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-705991ce-df89-45ac-aa7e-2567c327aa08 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:47:59 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-705991ce-df89-45ac-aa7e-2567c327aa08 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:47:59 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-705991ce-df89-45ac-aa7e-2567c327aa08 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:47:59 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-705991ce-df89-45ac-aa7e-2567c327aa08 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:47:59 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-705991ce-df89-45ac-aa7e-2567c327aa08 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:47:59 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-705991ce-df89-45ac-aa7e-2567c327aa08 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:47:59 user devstack@n-api.service[72088]: DEBUG dbcounter [-] [72088] Writing DB stats nova_cell0:SELECT=2 {{(pid=72088) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:47:59 user devstack@n-api.service[72088]: DEBUG nova.policy [None req-705991ce-df89-45ac-aa7e-2567c327aa08 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b2a4a06b5354121ae49d85be8b02458', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f0373f7bf54eb8845340bd4e931ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72088) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:47:59 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [None req-705991ce-df89-45ac-aa7e-2567c327aa08 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6b110aaa-0f26-4bab-8f3e-d22edb5a5072" status: 200 len: 1573 microversion: 2.1 time: 0.349287 Apr 11 19:47:59 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 334/1021] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 19:47:59 2023] GET /compute/v2.1/servers/6b110aaa-0f26-4bab-8f3e-d22edb5a5072 => generated 1573 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:47:59 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [req-d6f6da33-977e-45b8-8485-42b42640c4ad req-b7027189-aadb-4b6c-95ce-f886ca65cd60 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a66c1d51-e194-424d-a37c-d308544774c6", "name": "network-vif-deleted", "tag": "397ebb82-45b3-41ad-bbac-ef07140bf942"}]} {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:47:59 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-d6f6da33-977e-45b8-8485-42b42640c4ad req-b7027189-aadb-4b6c-95ce-f886ca65cd60 service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:47:59 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-d6f6da33-977e-45b8-8485-42b42640c4ad req-b7027189-aadb-4b6c-95ce-f886ca65cd60 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:47:59 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-d6f6da33-977e-45b8-8485-42b42640c4ad req-b7027189-aadb-4b6c-95ce-f886ca65cd60 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:47:59 user devstack@n-api.service[72090]: INFO nova.api.openstack.compute.server_external_events [req-d6f6da33-977e-45b8-8485-42b42640c4ad req-b7027189-aadb-4b6c-95ce-f886ca65cd60 service nova] Creating event network-vif-deleted:397ebb82-45b3-41ad-bbac-ef07140bf942 for instance a66c1d51-e194-424d-a37c-d308544774c6 on user Apr 11 19:47:59 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [req-d6f6da33-977e-45b8-8485-42b42640c4ad req-b7027189-aadb-4b6c-95ce-f886ca65cd60 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032769 Apr 11 19:47:59 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 340/1022] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:47:59 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 11 19:48:00 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [req-4743f6f6-9b21-4036-9efe-7f46bf22470f req-650dfef6-7e76-47e5-a6e8-8e3dd346ec8a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b110aaa-0f26-4bab-8f3e-d22edb5a5072", "name": "network-vif-unplugged", "status": "completed", "tag": "8d43789b-e200-409a-b819-09dd85859b3c"}, {"server_uuid": "6b110aaa-0f26-4bab-8f3e-d22edb5a5072", "name": "network-vif-plugged", "status": "completed", "tag": "8d43789b-e200-409a-b819-09dd85859b3c"}]} {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:48:00 user devstack@n-api.service[72089]: DEBUG dbcounter [-] [72089] Writing DB stats nova_cell0:SELECT=2 {{(pid=72089) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:48:00 user devstack@n-api.service[72089]: DEBUG dbcounter [-] [72089] Writing DB stats nova_cell0:SELECT=6 {{(pid=72089) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:48:00 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-4743f6f6-9b21-4036-9efe-7f46bf22470f req-650dfef6-7e76-47e5-a6e8-8e3dd346ec8a service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:48:00 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-4743f6f6-9b21-4036-9efe-7f46bf22470f req-650dfef6-7e76-47e5-a6e8-8e3dd346ec8a service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:48:00 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-4743f6f6-9b21-4036-9efe-7f46bf22470f req-650dfef6-7e76-47e5-a6e8-8e3dd346ec8a service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:48:00 user devstack@n-api.service[72089]: INFO nova.api.openstack.compute.server_external_events [req-4743f6f6-9b21-4036-9efe-7f46bf22470f req-650dfef6-7e76-47e5-a6e8-8e3dd346ec8a service nova] Creating event network-vif-unplugged:8d43789b-e200-409a-b819-09dd85859b3c for instance 6b110aaa-0f26-4bab-8f3e-d22edb5a5072 on user Apr 11 19:48:00 user devstack@n-api.service[72089]: INFO nova.api.openstack.compute.server_external_events [req-4743f6f6-9b21-4036-9efe-7f46bf22470f req-650dfef6-7e76-47e5-a6e8-8e3dd346ec8a service nova] Creating event network-vif-plugged:8d43789b-e200-409a-b819-09dd85859b3c for instance 6b110aaa-0f26-4bab-8f3e-d22edb5a5072 on user Apr 11 19:48:00 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [req-4743f6f6-9b21-4036-9efe-7f46bf22470f req-650dfef6-7e76-47e5-a6e8-8e3dd346ec8a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.060794 Apr 11 19:48:00 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 349/1023] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:48:00 2023] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:48:02 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [req-b4b7f577-1abc-4611-84e1-a763105d7bea req-dd79c773-2488-466c-9728-0444d8ca5836 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b110aaa-0f26-4bab-8f3e-d22edb5a5072", "name": "network-vif-deleted", "tag": "8d43789b-e200-409a-b819-09dd85859b3c"}]} {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:48:02 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-b4b7f577-1abc-4611-84e1-a763105d7bea req-dd79c773-2488-466c-9728-0444d8ca5836 service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:48:02 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-b4b7f577-1abc-4611-84e1-a763105d7bea req-dd79c773-2488-466c-9728-0444d8ca5836 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:48:02 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-b4b7f577-1abc-4611-84e1-a763105d7bea req-dd79c773-2488-466c-9728-0444d8ca5836 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:48:02 user devstack@n-api.service[72088]: INFO nova.api.openstack.compute.server_external_events [req-b4b7f577-1abc-4611-84e1-a763105d7bea req-dd79c773-2488-466c-9728-0444d8ca5836 service nova] Creating event network-vif-deleted:8d43789b-e200-409a-b819-09dd85859b3c for instance 6b110aaa-0f26-4bab-8f3e-d22edb5a5072 on user Apr 11 19:48:02 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [req-b4b7f577-1abc-4611-84e1-a763105d7bea req-dd79c773-2488-466c-9728-0444d8ca5836 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029055 Apr 11 19:48:02 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 335/1024] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:48:02 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:48:35 user devstack@n-api.service[72090]: DEBUG dbcounter [-] [72090] Writing DB stats nova_api:SELECT=10 {{(pid=72090) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:48:35 user devstack@n-api.service[72090]: DEBUG dbcounter [-] [72090] Writing DB stats nova_cell1:SELECT=18 {{(pid=72090) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:48:35 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [None req-1525372c-af14-4f6f-bf05-26772590b24c tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Calling method '>' {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:48:35 user devstack@n-api.service[72090]: DEBUG nova.compute.api [None req-1525372c-af14-4f6f-bf05-26772590b24c tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] [instance: f633037d-87d0-4dda-aa33-3cc9c3191080] Fetching instance by UUID {{(pid=72090) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:48:35 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-1525372c-af14-4f6f-bf05-26772590b24c tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:48:35 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-1525372c-af14-4f6f-bf05-26772590b24c tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:48:35 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-1525372c-af14-4f6f-bf05-26772590b24c tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:48:35 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-1525372c-af14-4f6f-bf05-26772590b24c tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:48:35 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-1525372c-af14-4f6f-bf05-26772590b24c tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:48:35 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-1525372c-af14-4f6f-bf05-26772590b24c tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:48:35 user devstack@n-api.service[72090]: DEBUG nova.policy [None req-1525372c-af14-4f6f-bf05-26772590b24c tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05fb551c320a48f98a4ec00a7f7492d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60a7381a31b84e97a068528f90813773', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72090) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:48:35 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [None req-1525372c-af14-4f6f-bf05-26772590b24c tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f633037d-87d0-4dda-aa33-3cc9c3191080" status: 200 len: 1546 microversion: 2.1 time: 0.345355 Apr 11 19:48:35 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 341/1025] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 19:48:35 2023] GET /compute/v2.1/servers/f633037d-87d0-4dda-aa33-3cc9c3191080 => generated 1546 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:48:35 user devstack@n-api.service[72089]: DEBUG dbcounter [-] [72089] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=72089) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:48:35 user devstack@n-api.service[72089]: DEBUG dbcounter [-] [72089] Writing DB stats nova_cell1:SELECT=38,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=72089) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:48:35 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [None req-0a81e670-49ec-4588-a7b8-79fd5cf6f76a tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:48:35 user devstack@n-api.service[72089]: DEBUG nova.compute.api [None req-0a81e670-49ec-4588-a7b8-79fd5cf6f76a tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] [instance: f633037d-87d0-4dda-aa33-3cc9c3191080] Fetching instance by UUID {{(pid=72089) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:48:35 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-0a81e670-49ec-4588-a7b8-79fd5cf6f76a tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:48:35 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-0a81e670-49ec-4588-a7b8-79fd5cf6f76a tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:48:35 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-0a81e670-49ec-4588-a7b8-79fd5cf6f76a tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:48:35 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-0a81e670-49ec-4588-a7b8-79fd5cf6f76a tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:48:35 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-0a81e670-49ec-4588-a7b8-79fd5cf6f76a tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:48:35 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-0a81e670-49ec-4588-a7b8-79fd5cf6f76a tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:48:36 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [None req-0a81e670-49ec-4588-a7b8-79fd5cf6f76a tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] 10.0.0.210 "POST /compute/v2.1/servers/f633037d-87d0-4dda-aa33-3cc9c3191080/action" status: 200 len: 28419 microversion: 2.1 time: 0.270601 Apr 11 19:48:36 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 350/1026] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Apr 11 19:48:35 2023] POST /compute/v2.1/servers/f633037d-87d0-4dda-aa33-3cc9c3191080/action => generated 28419 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:48:36 user devstack@n-api.service[72088]: DEBUG dbcounter [-] [72088] Writing DB stats nova_api:SELECT=14 {{(pid=72088) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:48:36 user devstack@n-api.service[72088]: DEBUG dbcounter [-] [72088] Writing DB stats nova_cell1:SELECT=14 {{(pid=72088) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:48:36 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [None req-9f4b2fdb-aa43-4a20-865b-9f6f769b29a3 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Calling method '>' {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:48:36 user devstack@n-api.service[72088]: DEBUG nova.compute.api [None req-9f4b2fdb-aa43-4a20-865b-9f6f769b29a3 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] [instance: 478eb884-ba19-4a4b-b1eb-a2e59d6beef0] Fetching instance by UUID {{(pid=72088) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:48:36 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-9f4b2fdb-aa43-4a20-865b-9f6f769b29a3 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:48:36 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-9f4b2fdb-aa43-4a20-865b-9f6f769b29a3 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:48:36 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-9f4b2fdb-aa43-4a20-865b-9f6f769b29a3 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:48:36 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-9f4b2fdb-aa43-4a20-865b-9f6f769b29a3 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:48:36 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-9f4b2fdb-aa43-4a20-865b-9f6f769b29a3 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:48:36 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-9f4b2fdb-aa43-4a20-865b-9f6f769b29a3 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:48:36 user devstack@n-api.service[72088]: DEBUG nova.policy [None req-9f4b2fdb-aa43-4a20-865b-9f6f769b29a3 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05fb551c320a48f98a4ec00a7f7492d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60a7381a31b84e97a068528f90813773', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72088) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:48:36 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [None req-9f4b2fdb-aa43-4a20-865b-9f6f769b29a3 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] 10.0.0.210 "GET /compute/v2.1/servers/478eb884-ba19-4a4b-b1eb-a2e59d6beef0" status: 200 len: 1539 microversion: 2.1 time: 0.158612 Apr 11 19:48:36 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 336/1027] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 19:48:36 2023] GET /compute/v2.1/servers/478eb884-ba19-4a4b-b1eb-a2e59d6beef0 => generated 1539 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:48:39 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [None req-d806f405-4054-44a1-a371-ccb83394dee2 tempest-VolumesActionsTest-283035711 tempest-VolumesActionsTest-283035711-project-member] Calling method '>' {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:48:39 user devstack@n-api.service[72090]: DEBUG nova.compute.api [None req-d806f405-4054-44a1-a371-ccb83394dee2 tempest-VolumesActionsTest-283035711 tempest-VolumesActionsTest-283035711-project-member] [instance: e5a20eb7-20f0-4adc-bd8c-b9bf25c46c04] Fetching instance by UUID {{(pid=72090) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:48:39 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-d806f405-4054-44a1-a371-ccb83394dee2 tempest-VolumesActionsTest-283035711 tempest-VolumesActionsTest-283035711-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:48:39 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-d806f405-4054-44a1-a371-ccb83394dee2 tempest-VolumesActionsTest-283035711 tempest-VolumesActionsTest-283035711-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:48:39 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-d806f405-4054-44a1-a371-ccb83394dee2 tempest-VolumesActionsTest-283035711 tempest-VolumesActionsTest-283035711-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:48:39 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-d806f405-4054-44a1-a371-ccb83394dee2 tempest-VolumesActionsTest-283035711 tempest-VolumesActionsTest-283035711-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:48:39 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-d806f405-4054-44a1-a371-ccb83394dee2 tempest-VolumesActionsTest-283035711 tempest-VolumesActionsTest-283035711-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:48:39 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-d806f405-4054-44a1-a371-ccb83394dee2 tempest-VolumesActionsTest-283035711 tempest-VolumesActionsTest-283035711-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:48:39 user devstack@n-api.service[72090]: DEBUG nova.policy [None req-d806f405-4054-44a1-a371-ccb83394dee2 tempest-VolumesActionsTest-283035711 tempest-VolumesActionsTest-283035711-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98feebb43745423299d602c50d09d982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56b09d8c9ff94045a36fdc454f8875e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72090) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:48:39 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [None req-d806f405-4054-44a1-a371-ccb83394dee2 tempest-VolumesActionsTest-283035711 tempest-VolumesActionsTest-283035711-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e5a20eb7-20f0-4adc-bd8c-b9bf25c46c04" status: 200 len: 1485 microversion: 2.1 time: 0.147421 Apr 11 19:48:39 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 342/1028] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 19:48:39 2023] GET /compute/v2.1/servers/e5a20eb7-20f0-4adc-bd8c-b9bf25c46c04 => generated 1485 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:48:46 user devstack@n-api.service[72089]: DEBUG dbcounter [-] [72089] Writing DB stats nova_api:SELECT=2 {{(pid=72089) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:48:46 user devstack@n-api.service[72089]: DEBUG dbcounter [-] [72089] Writing DB stats nova_cell1:SELECT=4 {{(pid=72089) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:48:46 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [None req-2e6896ef-6a16-41be-bc59-ba36208c5582 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Calling method '>' {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:48:46 user devstack@n-api.service[72089]: DEBUG nova.compute.api [None req-2e6896ef-6a16-41be-bc59-ba36208c5582 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] [instance: a66c1d51-e194-424d-a37c-d308544774c6] Fetching instance by UUID {{(pid=72089) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:48:46 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-2e6896ef-6a16-41be-bc59-ba36208c5582 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:48:46 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-2e6896ef-6a16-41be-bc59-ba36208c5582 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:48:46 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-2e6896ef-6a16-41be-bc59-ba36208c5582 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:48:46 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-2e6896ef-6a16-41be-bc59-ba36208c5582 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:48:46 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-2e6896ef-6a16-41be-bc59-ba36208c5582 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:48:46 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-2e6896ef-6a16-41be-bc59-ba36208c5582 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:48:46 user devstack@n-api.service[72089]: INFO nova.api.openstack.wsgi [None req-2e6896ef-6a16-41be-bc59-ba36208c5582 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] HTTP exception thrown: Instance a66c1d51-e194-424d-a37c-d308544774c6 could not be found. Apr 11 19:48:46 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [None req-2e6896ef-6a16-41be-bc59-ba36208c5582 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Request method failure captured: Apr 11 19:48:46 user devstack@n-api.service[72089]: request: GET /compute/v2.1/servers/a66c1d51-e194-424d-a37c-d308544774c6 HTTP/1.1 Apr 11 19:48:46 user devstack@n-api.service[72089]: Accept: application/json Apr 11 19:48:46 user devstack@n-api.service[72089]: Accept-Encoding: identity Apr 11 19:48:46 user devstack@n-api.service[72089]: Connection: close Apr 11 19:48:46 user devstack@n-api.service[72089]: Content-Length: 0 Apr 11 19:48:46 user devstack@n-api.service[72089]: Content-Type: application/json Apr 11 19:48:46 user devstack@n-api.service[72089]: Host: 10.0.0.210 Apr 11 19:48:46 user devstack@n-api.service[72089]: Openstack-System-Scope: None Apr 11 19:48:46 user devstack@n-api.service[72089]: User-Agent: python-urllib3/1.26.15 Apr 11 19:48:46 user devstack@n-api.service[72089]: X-Auth-Token: gAAAAABkNbWuPL7tpG6O55jvFSGO371AELCQlFZHf6FrRxh7vClaI6XXjuETFNQG4Gook2-ws7z2jCWcd2rLpcqQWtWmqjJ0M2xKefxUzDSsHikQ381w5ena7_2Zjp6vyHkrh7PG-gVY2vEL8dYAJIJ3D9B2mOuFBAai8zWGdpQnauKzi-Qcl_M Apr 11 19:48:46 user devstack@n-api.service[72089]: X-Domain-Id: None Apr 11 19:48:46 user devstack@n-api.service[72089]: X-Domain-Name: None Apr 11 19:48:46 user devstack@n-api.service[72089]: X-Identity-Status: Confirmed Apr 11 19:48:46 user devstack@n-api.service[72089]: X-Is-Admin-Project: True Apr 11 19:48:46 user devstack@n-api.service[72089]: X-Project-Domain-Id: default Apr 11 19:48:46 user devstack@n-api.service[72089]: X-Project-Domain-Name: Default Apr 11 19:48:46 user devstack@n-api.service[72089]: X-Project-Id: 2caba0618fc743e7bfb2dd866a511df9 Apr 11 19:48:46 user devstack@n-api.service[72089]: X-Project-Name: tempest-TestVolumeBootPattern-935343500 Apr 11 19:48:46 user devstack@n-api.service[72089]: X-Role: reader,member Apr 11 19:48:46 user devstack@n-api.service[72089]: X-Roles: reader,member Apr 11 19:48:46 user devstack@n-api.service[72089]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2caba0618fc743e7bfb2dd866a511df9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/2caba0618fc743e7bfb2dd866a511df9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2caba0618fc743e7bfb2dd866a511df9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 11 19:48:46 user devstack@n-api.service[72089]: X-Tenant: tempest-TestVolumeBootPattern-935343500 Apr 11 19:48:46 user devstack@n-api.service[72089]: X-Tenant-Id: 2caba0618fc743e7bfb2dd866a511df9 Apr 11 19:48:46 user devstack@n-api.service[72089]: X-Tenant-Name: tempest-TestVolumeBootPattern-935343500 Apr 11 19:48:46 user devstack@n-api.service[72089]: X-User: tempest-TestVolumeBootPattern-935343500-project-member Apr 11 19:48:46 user devstack@n-api.service[72089]: X-User-Domain-Id: default Apr 11 19:48:46 user devstack@n-api.service[72089]: X-User-Domain-Name: Default Apr 11 19:48:46 user devstack@n-api.service[72089]: X-User-Id: cf262cd03f4a41c4956d8784cf37d86d Apr 11 19:48:46 user devstack@n-api.service[72089]: X-User-Name: tempest-TestVolumeBootPattern-935343500-project-member Apr 11 19:48:46 user devstack@n-api.service[72089]: method: > Apr 11 19:48:46 user devstack@n-api.service[72089]: exception: Instance a66c1d51-e194-424d-a37c-d308544774c6 could not be found. Apr 11 19:48:46 user devstack@n-api.service[72089]: action_args: {'id': 'a66c1d51-e194-424d-a37c-d308544774c6'} Apr 11 19:48:46 user devstack@n-api.service[72089]: {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 19:48:46 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:48:46 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 19:48:46 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 19:48:46 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 19:48:46 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 19:48:46 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 19:48:46 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 19:48:46 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 19:48:46 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 19:48:46 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a66c1d51-e194-424d-a37c-d308544774c6 could not be found. Apr 11 19:48:46 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi Apr 11 19:48:46 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 19:48:46 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi Apr 11 19:48:46 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:48:46 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 19:48:46 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 19:48:46 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 19:48:46 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 19:48:46 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 19:48:46 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 19:48:46 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 19:48:46 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 19:48:46 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 19:48:46 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 19:48:46 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 19:48:46 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 19:48:46 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a66c1d51-e194-424d-a37c-d308544774c6 could not be found. Apr 11 19:48:46 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi Apr 11 19:48:46 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 19:48:46 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi Apr 11 19:48:46 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:48:46 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 19:48:46 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 19:48:46 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 19:48:46 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 19:48:46 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a66c1d51-e194-424d-a37c-d308544774c6 could not be found. Apr 11 19:48:46 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi Apr 11 19:48:46 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [None req-2e6896ef-6a16-41be-bc59-ba36208c5582 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Returning 404 to user: Instance a66c1d51-e194-424d-a37c-d308544774c6 could not be found. {{(pid=72089) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 19:48:46 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [None req-2e6896ef-6a16-41be-bc59-ba36208c5582 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a66c1d51-e194-424d-a37c-d308544774c6" status: 404 len: 111 microversion: 2.1 time: 0.132451 Apr 11 19:48:46 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 351/1029] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 19:48:46 2023] GET /compute/v2.1/servers/a66c1d51-e194-424d-a37c-d308544774c6 => generated 111 bytes in 134 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 19:48:46 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [None req-abe7359c-eb29-4b3c-a96b-01b3d412f56b tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Calling method '>' {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:48:46 user devstack@n-api.service[72088]: DEBUG nova.compute.api [None req-abe7359c-eb29-4b3c-a96b-01b3d412f56b tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] [instance: 0a59d114-20ac-448e-a95a-d3501c914833] Fetching instance by UUID {{(pid=72088) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:48:46 user devstack@n-api.service[72088]: DEBUG dbcounter [-] [72088] Writing DB stats nova_api:SELECT=2 {{(pid=72088) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:48:46 user devstack@n-api.service[72088]: DEBUG dbcounter [-] [72088] Writing DB stats nova_cell1:SELECT=6 {{(pid=72088) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:48:46 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-abe7359c-eb29-4b3c-a96b-01b3d412f56b tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:48:46 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-abe7359c-eb29-4b3c-a96b-01b3d412f56b tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:48:46 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-abe7359c-eb29-4b3c-a96b-01b3d412f56b tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:48:46 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-abe7359c-eb29-4b3c-a96b-01b3d412f56b tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:48:46 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-abe7359c-eb29-4b3c-a96b-01b3d412f56b tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:48:46 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-abe7359c-eb29-4b3c-a96b-01b3d412f56b tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:48:46 user devstack@n-api.service[72088]: INFO nova.api.openstack.wsgi [None req-abe7359c-eb29-4b3c-a96b-01b3d412f56b tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] HTTP exception thrown: Instance 0a59d114-20ac-448e-a95a-d3501c914833 could not be found. Apr 11 19:48:46 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [None req-abe7359c-eb29-4b3c-a96b-01b3d412f56b tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Request method failure captured: Apr 11 19:48:46 user devstack@n-api.service[72088]: request: DELETE /compute/v2.1/servers/0a59d114-20ac-448e-a95a-d3501c914833 HTTP/1.1 Apr 11 19:48:46 user devstack@n-api.service[72088]: Accept: application/json Apr 11 19:48:46 user devstack@n-api.service[72088]: Accept-Encoding: identity Apr 11 19:48:46 user devstack@n-api.service[72088]: Connection: close Apr 11 19:48:46 user devstack@n-api.service[72088]: Content-Length: 0 Apr 11 19:48:46 user devstack@n-api.service[72088]: Content-Type: application/json Apr 11 19:48:46 user devstack@n-api.service[72088]: Host: 10.0.0.210 Apr 11 19:48:46 user devstack@n-api.service[72088]: Openstack-System-Scope: None Apr 11 19:48:46 user devstack@n-api.service[72088]: User-Agent: python-urllib3/1.26.15 Apr 11 19:48:46 user devstack@n-api.service[72088]: X-Auth-Token: gAAAAABkNbWuPL7tpG6O55jvFSGO371AELCQlFZHf6FrRxh7vClaI6XXjuETFNQG4Gook2-ws7z2jCWcd2rLpcqQWtWmqjJ0M2xKefxUzDSsHikQ381w5ena7_2Zjp6vyHkrh7PG-gVY2vEL8dYAJIJ3D9B2mOuFBAai8zWGdpQnauKzi-Qcl_M Apr 11 19:48:46 user devstack@n-api.service[72088]: X-Domain-Id: None Apr 11 19:48:46 user devstack@n-api.service[72088]: X-Domain-Name: None Apr 11 19:48:46 user devstack@n-api.service[72088]: X-Identity-Status: Confirmed Apr 11 19:48:46 user devstack@n-api.service[72088]: X-Is-Admin-Project: True Apr 11 19:48:46 user devstack@n-api.service[72088]: X-Project-Domain-Id: default Apr 11 19:48:46 user devstack@n-api.service[72088]: X-Project-Domain-Name: Default Apr 11 19:48:46 user devstack@n-api.service[72088]: X-Project-Id: 2caba0618fc743e7bfb2dd866a511df9 Apr 11 19:48:46 user devstack@n-api.service[72088]: X-Project-Name: tempest-TestVolumeBootPattern-935343500 Apr 11 19:48:46 user devstack@n-api.service[72088]: X-Role: reader,member Apr 11 19:48:46 user devstack@n-api.service[72088]: X-Roles: reader,member Apr 11 19:48:46 user devstack@n-api.service[72088]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2caba0618fc743e7bfb2dd866a511df9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/2caba0618fc743e7bfb2dd866a511df9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2caba0618fc743e7bfb2dd866a511df9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 11 19:48:46 user devstack@n-api.service[72088]: X-Tenant: tempest-TestVolumeBootPattern-935343500 Apr 11 19:48:46 user devstack@n-api.service[72088]: X-Tenant-Id: 2caba0618fc743e7bfb2dd866a511df9 Apr 11 19:48:46 user devstack@n-api.service[72088]: X-Tenant-Name: tempest-TestVolumeBootPattern-935343500 Apr 11 19:48:46 user devstack@n-api.service[72088]: X-User: tempest-TestVolumeBootPattern-935343500-project-member Apr 11 19:48:46 user devstack@n-api.service[72088]: X-User-Domain-Id: default Apr 11 19:48:46 user devstack@n-api.service[72088]: X-User-Domain-Name: Default Apr 11 19:48:46 user devstack@n-api.service[72088]: X-User-Id: cf262cd03f4a41c4956d8784cf37d86d Apr 11 19:48:46 user devstack@n-api.service[72088]: X-User-Name: tempest-TestVolumeBootPattern-935343500-project-member Apr 11 19:48:46 user devstack@n-api.service[72088]: method: > Apr 11 19:48:46 user devstack@n-api.service[72088]: exception: Instance 0a59d114-20ac-448e-a95a-d3501c914833 could not be found. Apr 11 19:48:46 user devstack@n-api.service[72088]: action_args: {'id': '0a59d114-20ac-448e-a95a-d3501c914833'} Apr 11 19:48:46 user devstack@n-api.service[72088]: {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 19:48:46 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:48:46 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 19:48:46 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 19:48:46 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 19:48:46 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 19:48:46 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 19:48:46 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 19:48:46 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 19:48:46 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 19:48:46 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0a59d114-20ac-448e-a95a-d3501c914833 could not be found. Apr 11 19:48:46 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi Apr 11 19:48:46 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 19:48:46 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi Apr 11 19:48:46 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:48:46 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 19:48:46 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 19:48:46 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 19:48:46 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 19:48:46 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 19:48:46 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 19:48:46 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 11 19:48:46 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 11 19:48:46 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 11 19:48:46 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 11 19:48:46 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 19:48:46 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 19:48:46 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 19:48:46 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 19:48:46 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0a59d114-20ac-448e-a95a-d3501c914833 could not be found. Apr 11 19:48:46 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi Apr 11 19:48:46 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 19:48:46 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi Apr 11 19:48:46 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:48:46 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 19:48:46 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 19:48:46 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 19:48:46 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 19:48:46 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0a59d114-20ac-448e-a95a-d3501c914833 could not be found. Apr 11 19:48:46 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi Apr 11 19:48:46 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [None req-abe7359c-eb29-4b3c-a96b-01b3d412f56b tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Returning 404 to user: Instance 0a59d114-20ac-448e-a95a-d3501c914833 could not be found. {{(pid=72088) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 19:48:46 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [None req-abe7359c-eb29-4b3c-a96b-01b3d412f56b tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/0a59d114-20ac-448e-a95a-d3501c914833" status: 404 len: 111 microversion: 2.1 time: 0.040167 Apr 11 19:48:46 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 337/1030] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 19:48:46 2023] DELETE /compute/v2.1/servers/0a59d114-20ac-448e-a95a-d3501c914833 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 19:48:46 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [None req-864d83e5-f337-4a9b-ae31-317fb1f6ac82 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Calling method '>' {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:48:46 user devstack@n-api.service[72090]: DEBUG nova.compute.api [None req-864d83e5-f337-4a9b-ae31-317fb1f6ac82 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] [instance: 0a59d114-20ac-448e-a95a-d3501c914833] Fetching instance by UUID {{(pid=72090) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:48:46 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-864d83e5-f337-4a9b-ae31-317fb1f6ac82 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:48:46 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-864d83e5-f337-4a9b-ae31-317fb1f6ac82 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:48:46 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-864d83e5-f337-4a9b-ae31-317fb1f6ac82 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:48:46 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-864d83e5-f337-4a9b-ae31-317fb1f6ac82 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:48:46 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-864d83e5-f337-4a9b-ae31-317fb1f6ac82 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:48:46 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-864d83e5-f337-4a9b-ae31-317fb1f6ac82 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:48:46 user devstack@n-api.service[72090]: INFO nova.api.openstack.wsgi [None req-864d83e5-f337-4a9b-ae31-317fb1f6ac82 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] HTTP exception thrown: Instance 0a59d114-20ac-448e-a95a-d3501c914833 could not be found. Apr 11 19:48:46 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [None req-864d83e5-f337-4a9b-ae31-317fb1f6ac82 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Request method failure captured: Apr 11 19:48:46 user devstack@n-api.service[72090]: request: GET /compute/v2.1/servers/0a59d114-20ac-448e-a95a-d3501c914833 HTTP/1.1 Apr 11 19:48:46 user devstack@n-api.service[72090]: Accept: application/json Apr 11 19:48:46 user devstack@n-api.service[72090]: Accept-Encoding: identity Apr 11 19:48:46 user devstack@n-api.service[72090]: Connection: close Apr 11 19:48:46 user devstack@n-api.service[72090]: Content-Length: 0 Apr 11 19:48:46 user devstack@n-api.service[72090]: Content-Type: application/json Apr 11 19:48:46 user devstack@n-api.service[72090]: Host: 10.0.0.210 Apr 11 19:48:46 user devstack@n-api.service[72090]: Openstack-System-Scope: None Apr 11 19:48:46 user devstack@n-api.service[72090]: User-Agent: python-urllib3/1.26.15 Apr 11 19:48:46 user devstack@n-api.service[72090]: X-Auth-Token: gAAAAABkNbWuPL7tpG6O55jvFSGO371AELCQlFZHf6FrRxh7vClaI6XXjuETFNQG4Gook2-ws7z2jCWcd2rLpcqQWtWmqjJ0M2xKefxUzDSsHikQ381w5ena7_2Zjp6vyHkrh7PG-gVY2vEL8dYAJIJ3D9B2mOuFBAai8zWGdpQnauKzi-Qcl_M Apr 11 19:48:46 user devstack@n-api.service[72090]: X-Domain-Id: None Apr 11 19:48:46 user devstack@n-api.service[72090]: X-Domain-Name: None Apr 11 19:48:46 user devstack@n-api.service[72090]: X-Identity-Status: Confirmed Apr 11 19:48:46 user devstack@n-api.service[72090]: X-Is-Admin-Project: True Apr 11 19:48:46 user devstack@n-api.service[72090]: X-Project-Domain-Id: default Apr 11 19:48:46 user devstack@n-api.service[72090]: X-Project-Domain-Name: Default Apr 11 19:48:46 user devstack@n-api.service[72090]: X-Project-Id: 2caba0618fc743e7bfb2dd866a511df9 Apr 11 19:48:46 user devstack@n-api.service[72090]: X-Project-Name: tempest-TestVolumeBootPattern-935343500 Apr 11 19:48:46 user devstack@n-api.service[72090]: X-Role: reader,member Apr 11 19:48:46 user devstack@n-api.service[72090]: X-Roles: reader,member Apr 11 19:48:46 user devstack@n-api.service[72090]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2caba0618fc743e7bfb2dd866a511df9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/2caba0618fc743e7bfb2dd866a511df9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2caba0618fc743e7bfb2dd866a511df9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 11 19:48:46 user devstack@n-api.service[72090]: X-Tenant: tempest-TestVolumeBootPattern-935343500 Apr 11 19:48:46 user devstack@n-api.service[72090]: X-Tenant-Id: 2caba0618fc743e7bfb2dd866a511df9 Apr 11 19:48:46 user devstack@n-api.service[72090]: X-Tenant-Name: tempest-TestVolumeBootPattern-935343500 Apr 11 19:48:46 user devstack@n-api.service[72090]: X-User: tempest-TestVolumeBootPattern-935343500-project-member Apr 11 19:48:46 user devstack@n-api.service[72090]: X-User-Domain-Id: default Apr 11 19:48:46 user devstack@n-api.service[72090]: X-User-Domain-Name: Default Apr 11 19:48:46 user devstack@n-api.service[72090]: X-User-Id: cf262cd03f4a41c4956d8784cf37d86d Apr 11 19:48:46 user devstack@n-api.service[72090]: X-User-Name: tempest-TestVolumeBootPattern-935343500-project-member Apr 11 19:48:46 user devstack@n-api.service[72090]: method: > Apr 11 19:48:46 user devstack@n-api.service[72090]: exception: Instance 0a59d114-20ac-448e-a95a-d3501c914833 could not be found. Apr 11 19:48:46 user devstack@n-api.service[72090]: action_args: {'id': '0a59d114-20ac-448e-a95a-d3501c914833'} Apr 11 19:48:46 user devstack@n-api.service[72090]: {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 19:48:46 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:48:46 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 19:48:46 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 19:48:46 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 19:48:46 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 19:48:46 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 19:48:46 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 19:48:46 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 19:48:46 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 19:48:46 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0a59d114-20ac-448e-a95a-d3501c914833 could not be found. Apr 11 19:48:46 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi Apr 11 19:48:46 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 19:48:46 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi Apr 11 19:48:46 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:48:46 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 19:48:46 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 19:48:46 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 19:48:46 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 19:48:46 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 19:48:46 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 19:48:46 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 19:48:46 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 19:48:46 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 19:48:46 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 19:48:46 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 19:48:46 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 19:48:46 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0a59d114-20ac-448e-a95a-d3501c914833 could not be found. Apr 11 19:48:46 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi Apr 11 19:48:46 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 19:48:46 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi Apr 11 19:48:46 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:48:46 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 19:48:46 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 19:48:46 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 19:48:46 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 19:48:46 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0a59d114-20ac-448e-a95a-d3501c914833 could not be found. Apr 11 19:48:46 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi Apr 11 19:48:46 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [None req-864d83e5-f337-4a9b-ae31-317fb1f6ac82 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Returning 404 to user: Instance 0a59d114-20ac-448e-a95a-d3501c914833 could not be found. {{(pid=72090) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 19:48:46 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [None req-864d83e5-f337-4a9b-ae31-317fb1f6ac82 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0a59d114-20ac-448e-a95a-d3501c914833" status: 404 len: 111 microversion: 2.1 time: 0.029521 Apr 11 19:48:46 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 343/1031] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 19:48:46 2023] GET /compute/v2.1/servers/0a59d114-20ac-448e-a95a-d3501c914833 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 19:48:48 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [None req-a1c8f509-d1b2-45f3-b808-e09b7ef7f141 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Calling method '.version_select at 0x7f119db74c10>' {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:48:48 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [None req-a1c8f509-d1b2-45f3-b808-e09b7ef7f141 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1844027973" status: 202 len: 0 microversion: 2.1 time: 0.029367 Apr 11 19:48:48 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 352/1032] 10.0.0.210 () {62 vars in 1340 bytes} [Tue Apr 11 19:48:48 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1844027973 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 19:48:49 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [None req-c92c777e-4404-45de-b8ee-7c831e303fb5 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Calling method '>' {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:48:49 user devstack@n-api.service[72088]: DEBUG nova.compute.api [None req-c92c777e-4404-45de-b8ee-7c831e303fb5 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] [instance: 6b110aaa-0f26-4bab-8f3e-d22edb5a5072] Fetching instance by UUID {{(pid=72088) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:48:49 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-c92c777e-4404-45de-b8ee-7c831e303fb5 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:48:49 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-c92c777e-4404-45de-b8ee-7c831e303fb5 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:48:49 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-c92c777e-4404-45de-b8ee-7c831e303fb5 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:48:49 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-c92c777e-4404-45de-b8ee-7c831e303fb5 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:48:49 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-c92c777e-4404-45de-b8ee-7c831e303fb5 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:48:49 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-c92c777e-4404-45de-b8ee-7c831e303fb5 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:48:49 user devstack@n-api.service[72088]: INFO nova.api.openstack.wsgi [None req-c92c777e-4404-45de-b8ee-7c831e303fb5 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] HTTP exception thrown: Instance 6b110aaa-0f26-4bab-8f3e-d22edb5a5072 could not be found. Apr 11 19:48:49 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [None req-c92c777e-4404-45de-b8ee-7c831e303fb5 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Request method failure captured: Apr 11 19:48:49 user devstack@n-api.service[72088]: request: GET /compute/v2.1/servers/6b110aaa-0f26-4bab-8f3e-d22edb5a5072 HTTP/1.1 Apr 11 19:48:49 user devstack@n-api.service[72088]: Accept: application/json Apr 11 19:48:49 user devstack@n-api.service[72088]: Accept-Encoding: identity Apr 11 19:48:49 user devstack@n-api.service[72088]: Connection: close Apr 11 19:48:49 user devstack@n-api.service[72088]: Content-Length: 0 Apr 11 19:48:49 user devstack@n-api.service[72088]: Content-Type: application/json Apr 11 19:48:49 user devstack@n-api.service[72088]: Host: 10.0.0.210 Apr 11 19:48:49 user devstack@n-api.service[72088]: Openstack-System-Scope: None Apr 11 19:48:49 user devstack@n-api.service[72088]: User-Agent: python-urllib3/1.26.15 Apr 11 19:48:49 user devstack@n-api.service[72088]: X-Auth-Token: gAAAAABkNbf4RQnHPDBKIGdSg0AKk5qCmGG1GaLkQfN8yZwsJsiPtX6qagqS3ccstlPHhqlVStdG1vIgjc9APLeChrUnXZU8NvwY5OzpPCIO6JtXrHfnG8vi0AX-9mprSzNYc93tT8NJ4l1kH6BmJob3m_sSjhuvqTq2_OwrT4ZLOArRvnGFTSE Apr 11 19:48:49 user devstack@n-api.service[72088]: X-Domain-Id: None Apr 11 19:48:49 user devstack@n-api.service[72088]: X-Domain-Name: None Apr 11 19:48:49 user devstack@n-api.service[72088]: X-Identity-Status: Confirmed Apr 11 19:48:49 user devstack@n-api.service[72088]: X-Is-Admin-Project: True Apr 11 19:48:49 user devstack@n-api.service[72088]: X-Project-Domain-Id: default Apr 11 19:48:49 user devstack@n-api.service[72088]: X-Project-Domain-Name: Default Apr 11 19:48:49 user devstack@n-api.service[72088]: X-Project-Id: 27f0373f7bf54eb8845340bd4e931ab2 Apr 11 19:48:49 user devstack@n-api.service[72088]: X-Project-Name: tempest-SnapshotDataIntegrityTests-450067073 Apr 11 19:48:49 user devstack@n-api.service[72088]: X-Role: reader,member Apr 11 19:48:49 user devstack@n-api.service[72088]: X-Roles: reader,member Apr 11 19:48:49 user devstack@n-api.service[72088]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/27f0373f7bf54eb8845340bd4e931ab2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/27f0373f7bf54eb8845340bd4e931ab2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/27f0373f7bf54eb8845340bd4e931ab2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 11 19:48:49 user devstack@n-api.service[72088]: X-Tenant: tempest-SnapshotDataIntegrityTests-450067073 Apr 11 19:48:49 user devstack@n-api.service[72088]: X-Tenant-Id: 27f0373f7bf54eb8845340bd4e931ab2 Apr 11 19:48:49 user devstack@n-api.service[72088]: X-Tenant-Name: tempest-SnapshotDataIntegrityTests-450067073 Apr 11 19:48:49 user devstack@n-api.service[72088]: X-User: tempest-SnapshotDataIntegrityTests-450067073-project-member Apr 11 19:48:49 user devstack@n-api.service[72088]: X-User-Domain-Id: default Apr 11 19:48:49 user devstack@n-api.service[72088]: X-User-Domain-Name: Default Apr 11 19:48:49 user devstack@n-api.service[72088]: X-User-Id: 9b2a4a06b5354121ae49d85be8b02458 Apr 11 19:48:49 user devstack@n-api.service[72088]: X-User-Name: tempest-SnapshotDataIntegrityTests-450067073-project-member Apr 11 19:48:49 user devstack@n-api.service[72088]: method: > Apr 11 19:48:49 user devstack@n-api.service[72088]: exception: Instance 6b110aaa-0f26-4bab-8f3e-d22edb5a5072 could not be found. Apr 11 19:48:49 user devstack@n-api.service[72088]: action_args: {'id': '6b110aaa-0f26-4bab-8f3e-d22edb5a5072'} Apr 11 19:48:49 user devstack@n-api.service[72088]: {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 19:48:49 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:48:49 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 19:48:49 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 19:48:49 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 19:48:49 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 19:48:49 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 19:48:49 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 19:48:49 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 19:48:49 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 19:48:49 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6b110aaa-0f26-4bab-8f3e-d22edb5a5072 could not be found. Apr 11 19:48:49 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi Apr 11 19:48:49 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 19:48:49 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi Apr 11 19:48:49 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:48:49 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 19:48:49 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 19:48:49 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 19:48:49 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 19:48:49 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 19:48:49 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 19:48:49 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 19:48:49 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 19:48:49 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 19:48:49 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 19:48:49 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 19:48:49 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 19:48:49 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6b110aaa-0f26-4bab-8f3e-d22edb5a5072 could not be found. Apr 11 19:48:49 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi Apr 11 19:48:49 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 19:48:49 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi Apr 11 19:48:49 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:48:49 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 19:48:49 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 19:48:49 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 19:48:49 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 19:48:49 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6b110aaa-0f26-4bab-8f3e-d22edb5a5072 could not be found. Apr 11 19:48:49 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi Apr 11 19:48:49 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [None req-c92c777e-4404-45de-b8ee-7c831e303fb5 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Returning 404 to user: Instance 6b110aaa-0f26-4bab-8f3e-d22edb5a5072 could not be found. {{(pid=72088) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 19:48:49 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [None req-c92c777e-4404-45de-b8ee-7c831e303fb5 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6b110aaa-0f26-4bab-8f3e-d22edb5a5072" status: 404 len: 111 microversion: 2.1 time: 0.031500 Apr 11 19:48:49 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 338/1033] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 19:48:49 2023] GET /compute/v2.1/servers/6b110aaa-0f26-4bab-8f3e-d22edb5a5072 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 19:48:49 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [None req-54aa3a68-5a68-46a6-b249-50226938a277 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Calling method '.version_select at 0x7f119db6b640>' {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:48:49 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [None req-54aa3a68-5a68-46a6-b249-50226938a277 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-SnapshotDataIntegrityTests-234136439" status: 202 len: 0 microversion: 2.1 time: 0.030969 Apr 11 19:48:49 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 344/1034] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Apr 11 19:48:49 2023] DELETE /compute/v2.1/os-keypairs/tempest-SnapshotDataIntegrityTests-234136439 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 19:49:36 user devstack@n-api.service[72089]: DEBUG dbcounter [-] [72089] Writing DB stats nova_cell1:SELECT=2 {{(pid=72089) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:49:36 user devstack@n-api.service[72089]: DEBUG dbcounter [-] [72089] Writing DB stats nova_api:SELECT=5,nova_api:DELETE=1 {{(pid=72089) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:49:36 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [None req-91ef5f4a-3992-4381-9d0c-638e047474a3 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Calling method '>' {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:49:36 user devstack@n-api.service[72089]: DEBUG nova.compute.api [None req-91ef5f4a-3992-4381-9d0c-638e047474a3 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] [instance: f633037d-87d0-4dda-aa33-3cc9c3191080] Fetching instance by UUID {{(pid=72089) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:49:36 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-91ef5f4a-3992-4381-9d0c-638e047474a3 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:49:36 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-91ef5f4a-3992-4381-9d0c-638e047474a3 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:49:36 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-91ef5f4a-3992-4381-9d0c-638e047474a3 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:49:36 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-91ef5f4a-3992-4381-9d0c-638e047474a3 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:49:36 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-91ef5f4a-3992-4381-9d0c-638e047474a3 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:49:36 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-91ef5f4a-3992-4381-9d0c-638e047474a3 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:49:36 user devstack@n-api.service[72089]: DEBUG nova.compute.api [None req-91ef5f4a-3992-4381-9d0c-638e047474a3 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] [instance: f633037d-87d0-4dda-aa33-3cc9c3191080] Going to try to terminate instance {{(pid=72089) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 11 19:49:36 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [None req-91ef5f4a-3992-4381-9d0c-638e047474a3 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/f633037d-87d0-4dda-aa33-3cc9c3191080" status: 204 len: 0 microversion: 2.1 time: 0.124359 Apr 11 19:49:36 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 353/1035] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 19:49:36 2023] DELETE /compute/v2.1/servers/f633037d-87d0-4dda-aa33-3cc9c3191080 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 11 19:49:36 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [None req-c7f029ac-7659-4e87-87c0-bb3ba6008b4f tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Calling method '>' {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:49:36 user devstack@n-api.service[72088]: DEBUG nova.compute.api [None req-c7f029ac-7659-4e87-87c0-bb3ba6008b4f tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] [instance: f633037d-87d0-4dda-aa33-3cc9c3191080] Fetching instance by UUID {{(pid=72088) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:49:36 user devstack@n-api.service[72088]: DEBUG dbcounter [-] [72088] Writing DB stats nova_api:SELECT=4 {{(pid=72088) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:49:36 user devstack@n-api.service[72088]: DEBUG dbcounter [-] [72088] Writing DB stats nova_cell1:SELECT=4 {{(pid=72088) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:49:36 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-c7f029ac-7659-4e87-87c0-bb3ba6008b4f tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:49:36 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-c7f029ac-7659-4e87-87c0-bb3ba6008b4f tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:49:36 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-c7f029ac-7659-4e87-87c0-bb3ba6008b4f tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:49:36 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-c7f029ac-7659-4e87-87c0-bb3ba6008b4f tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:49:36 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-c7f029ac-7659-4e87-87c0-bb3ba6008b4f tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:49:36 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-c7f029ac-7659-4e87-87c0-bb3ba6008b4f tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:49:36 user devstack@n-api.service[72088]: DEBUG nova.policy [None req-c7f029ac-7659-4e87-87c0-bb3ba6008b4f tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05fb551c320a48f98a4ec00a7f7492d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60a7381a31b84e97a068528f90813773', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72088) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:49:36 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [None req-c7f029ac-7659-4e87-87c0-bb3ba6008b4f tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f633037d-87d0-4dda-aa33-3cc9c3191080" status: 200 len: 1552 microversion: 2.1 time: 0.184559 Apr 11 19:49:36 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 339/1036] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 19:49:36 2023] GET /compute/v2.1/servers/f633037d-87d0-4dda-aa33-3cc9c3191080 => generated 1552 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 19:49:36 user devstack@n-api.service[72090]: DEBUG dbcounter [-] [72090] Writing DB stats nova_cell1:SELECT=14 {{(pid=72090) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:49:36 user devstack@n-api.service[72090]: DEBUG dbcounter [-] [72090] Writing DB stats nova_api:SELECT=9,nova_api:DELETE=1 {{(pid=72090) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:49:36 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [req-4d97b442-3224-4114-b71c-9b5f0bb82819 req-95c857c5-d515-4a5a-a3fe-3acb6c102115 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f633037d-87d0-4dda-aa33-3cc9c3191080", "name": "network-vif-unplugged", "status": "completed", "tag": "c3ef7018-189c-423e-b92b-b2b4a98dafce"}]} {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:49:36 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-4d97b442-3224-4114-b71c-9b5f0bb82819 req-95c857c5-d515-4a5a-a3fe-3acb6c102115 service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:49:36 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-4d97b442-3224-4114-b71c-9b5f0bb82819 req-95c857c5-d515-4a5a-a3fe-3acb6c102115 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:49:36 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-4d97b442-3224-4114-b71c-9b5f0bb82819 req-95c857c5-d515-4a5a-a3fe-3acb6c102115 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:49:36 user devstack@n-api.service[72090]: INFO nova.api.openstack.compute.server_external_events [req-4d97b442-3224-4114-b71c-9b5f0bb82819 req-95c857c5-d515-4a5a-a3fe-3acb6c102115 service nova] Creating event network-vif-unplugged:c3ef7018-189c-423e-b92b-b2b4a98dafce for instance f633037d-87d0-4dda-aa33-3cc9c3191080 on user Apr 11 19:49:36 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [req-4d97b442-3224-4114-b71c-9b5f0bb82819 req-95c857c5-d515-4a5a-a3fe-3acb6c102115 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.039184 Apr 11 19:49:36 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 345/1037] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:49:36 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:49:38 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [req-211f0597-a450-4af5-8bb4-636a3778f8e0 req-f53f8653-e53e-4721-ae70-6e22038008c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f633037d-87d0-4dda-aa33-3cc9c3191080", "name": "network-vif-deleted", "tag": "c3ef7018-189c-423e-b92b-b2b4a98dafce"}]} {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:49:38 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-211f0597-a450-4af5-8bb4-636a3778f8e0 req-f53f8653-e53e-4721-ae70-6e22038008c5 service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:49:38 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-211f0597-a450-4af5-8bb4-636a3778f8e0 req-f53f8653-e53e-4721-ae70-6e22038008c5 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:49:38 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-211f0597-a450-4af5-8bb4-636a3778f8e0 req-f53f8653-e53e-4721-ae70-6e22038008c5 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:49:38 user devstack@n-api.service[72089]: INFO nova.api.openstack.compute.server_external_events [req-211f0597-a450-4af5-8bb4-636a3778f8e0 req-f53f8653-e53e-4721-ae70-6e22038008c5 service nova] Creating event network-vif-deleted:c3ef7018-189c-423e-b92b-b2b4a98dafce for instance f633037d-87d0-4dda-aa33-3cc9c3191080 on user Apr 11 19:49:38 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [req-211f0597-a450-4af5-8bb4-636a3778f8e0 req-f53f8653-e53e-4721-ae70-6e22038008c5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029878 Apr 11 19:49:38 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 354/1038] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:49:38 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:49:38 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [req-153b3112-0fe1-4867-a953-850ea785c603 req-b499347f-2dab-469a-9fe5-0dd95c3a7d96 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f633037d-87d0-4dda-aa33-3cc9c3191080", "name": "network-vif-plugged", "status": "completed", "tag": "c3ef7018-189c-423e-b92b-b2b4a98dafce"}]} {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:49:38 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-153b3112-0fe1-4867-a953-850ea785c603 req-b499347f-2dab-469a-9fe5-0dd95c3a7d96 service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:49:38 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-153b3112-0fe1-4867-a953-850ea785c603 req-b499347f-2dab-469a-9fe5-0dd95c3a7d96 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:49:38 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-153b3112-0fe1-4867-a953-850ea785c603 req-b499347f-2dab-469a-9fe5-0dd95c3a7d96 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:49:38 user devstack@n-api.service[72088]: INFO nova.api.openstack.compute.server_external_events [req-153b3112-0fe1-4867-a953-850ea785c603 req-b499347f-2dab-469a-9fe5-0dd95c3a7d96 service nova] Creating event network-vif-plugged:c3ef7018-189c-423e-b92b-b2b4a98dafce for instance f633037d-87d0-4dda-aa33-3cc9c3191080 on user Apr 11 19:49:38 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [req-153b3112-0fe1-4867-a953-850ea785c603 req-b499347f-2dab-469a-9fe5-0dd95c3a7d96 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028725 Apr 11 19:49:38 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 340/1039] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:49:38 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:49:43 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [None req-9161d225-6d73-4c52-ad26-c1d30037428d tempest-VolumesActionsTest-283035711 tempest-VolumesActionsTest-283035711-project-member] Calling method '>' {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:49:43 user devstack@n-api.service[72090]: DEBUG nova.compute.api [None req-9161d225-6d73-4c52-ad26-c1d30037428d tempest-VolumesActionsTest-283035711 tempest-VolumesActionsTest-283035711-project-member] [instance: e5a20eb7-20f0-4adc-bd8c-b9bf25c46c04] Fetching instance by UUID {{(pid=72090) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:49:43 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-9161d225-6d73-4c52-ad26-c1d30037428d tempest-VolumesActionsTest-283035711 tempest-VolumesActionsTest-283035711-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:49:43 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-9161d225-6d73-4c52-ad26-c1d30037428d tempest-VolumesActionsTest-283035711 tempest-VolumesActionsTest-283035711-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:49:43 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-9161d225-6d73-4c52-ad26-c1d30037428d tempest-VolumesActionsTest-283035711 tempest-VolumesActionsTest-283035711-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:49:43 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-9161d225-6d73-4c52-ad26-c1d30037428d tempest-VolumesActionsTest-283035711 tempest-VolumesActionsTest-283035711-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:49:43 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-9161d225-6d73-4c52-ad26-c1d30037428d tempest-VolumesActionsTest-283035711 tempest-VolumesActionsTest-283035711-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:49:43 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-9161d225-6d73-4c52-ad26-c1d30037428d tempest-VolumesActionsTest-283035711 tempest-VolumesActionsTest-283035711-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:49:43 user devstack@n-api.service[72090]: DEBUG nova.compute.api [None req-9161d225-6d73-4c52-ad26-c1d30037428d tempest-VolumesActionsTest-283035711 tempest-VolumesActionsTest-283035711-project-member] [instance: e5a20eb7-20f0-4adc-bd8c-b9bf25c46c04] Going to try to terminate instance {{(pid=72090) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 11 19:49:43 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [None req-9161d225-6d73-4c52-ad26-c1d30037428d tempest-VolumesActionsTest-283035711 tempest-VolumesActionsTest-283035711-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/e5a20eb7-20f0-4adc-bd8c-b9bf25c46c04" status: 204 len: 0 microversion: 2.1 time: 0.147719 Apr 11 19:49:43 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 346/1040] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 19:49:43 2023] DELETE /compute/v2.1/servers/e5a20eb7-20f0-4adc-bd8c-b9bf25c46c04 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 11 19:49:43 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [None req-2eda2415-e64d-4218-8640-49b6388a0a66 tempest-VolumesActionsTest-283035711 tempest-VolumesActionsTest-283035711-project-member] Calling method '>' {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:49:43 user devstack@n-api.service[72089]: DEBUG nova.compute.api [None req-2eda2415-e64d-4218-8640-49b6388a0a66 tempest-VolumesActionsTest-283035711 tempest-VolumesActionsTest-283035711-project-member] [instance: e5a20eb7-20f0-4adc-bd8c-b9bf25c46c04] Fetching instance by UUID {{(pid=72089) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:49:43 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-2eda2415-e64d-4218-8640-49b6388a0a66 tempest-VolumesActionsTest-283035711 tempest-VolumesActionsTest-283035711-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:49:43 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-2eda2415-e64d-4218-8640-49b6388a0a66 tempest-VolumesActionsTest-283035711 tempest-VolumesActionsTest-283035711-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:49:43 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-2eda2415-e64d-4218-8640-49b6388a0a66 tempest-VolumesActionsTest-283035711 tempest-VolumesActionsTest-283035711-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:49:43 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-2eda2415-e64d-4218-8640-49b6388a0a66 tempest-VolumesActionsTest-283035711 tempest-VolumesActionsTest-283035711-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:49:43 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-2eda2415-e64d-4218-8640-49b6388a0a66 tempest-VolumesActionsTest-283035711 tempest-VolumesActionsTest-283035711-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:49:43 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-2eda2415-e64d-4218-8640-49b6388a0a66 tempest-VolumesActionsTest-283035711 tempest-VolumesActionsTest-283035711-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:49:43 user devstack@n-api.service[72089]: DEBUG nova.policy [None req-2eda2415-e64d-4218-8640-49b6388a0a66 tempest-VolumesActionsTest-283035711 tempest-VolumesActionsTest-283035711-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98feebb43745423299d602c50d09d982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56b09d8c9ff94045a36fdc454f8875e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72089) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:49:43 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [None req-2eda2415-e64d-4218-8640-49b6388a0a66 tempest-VolumesActionsTest-283035711 tempest-VolumesActionsTest-283035711-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e5a20eb7-20f0-4adc-bd8c-b9bf25c46c04" status: 200 len: 1491 microversion: 2.1 time: 0.225489 Apr 11 19:49:43 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 355/1041] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 19:49:43 2023] GET /compute/v2.1/servers/e5a20eb7-20f0-4adc-bd8c-b9bf25c46c04 => generated 1491 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:49:43 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [req-38983e0b-4056-4252-a7de-a8b02bc9f859 req-1f2b2984-78e7-4926-bfee-7e0872045ac6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5a20eb7-20f0-4adc-bd8c-b9bf25c46c04", "name": "network-vif-unplugged", "status": "completed", "tag": "91ae7fad-1a68-4881-8048-4fab8fcfe90a"}]} {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:49:43 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-38983e0b-4056-4252-a7de-a8b02bc9f859 req-1f2b2984-78e7-4926-bfee-7e0872045ac6 service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:49:43 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-38983e0b-4056-4252-a7de-a8b02bc9f859 req-1f2b2984-78e7-4926-bfee-7e0872045ac6 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:49:43 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-38983e0b-4056-4252-a7de-a8b02bc9f859 req-1f2b2984-78e7-4926-bfee-7e0872045ac6 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:49:43 user devstack@n-api.service[72088]: INFO nova.api.openstack.compute.server_external_events [req-38983e0b-4056-4252-a7de-a8b02bc9f859 req-1f2b2984-78e7-4926-bfee-7e0872045ac6 service nova] Creating event network-vif-unplugged:91ae7fad-1a68-4881-8048-4fab8fcfe90a for instance e5a20eb7-20f0-4adc-bd8c-b9bf25c46c04 on user Apr 11 19:49:43 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [req-38983e0b-4056-4252-a7de-a8b02bc9f859 req-1f2b2984-78e7-4926-bfee-7e0872045ac6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031461 Apr 11 19:49:43 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 341/1042] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:49:43 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:49:44 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [req-83c99ab6-959b-4b45-9759-241f61892de7 req-54a9151a-1fd1-4edd-b84f-4ff9d46bd0e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5a20eb7-20f0-4adc-bd8c-b9bf25c46c04", "name": "network-vif-deleted", "tag": "91ae7fad-1a68-4881-8048-4fab8fcfe90a"}]} {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:49:44 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-83c99ab6-959b-4b45-9759-241f61892de7 req-54a9151a-1fd1-4edd-b84f-4ff9d46bd0e3 service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:49:44 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-83c99ab6-959b-4b45-9759-241f61892de7 req-54a9151a-1fd1-4edd-b84f-4ff9d46bd0e3 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:49:44 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-83c99ab6-959b-4b45-9759-241f61892de7 req-54a9151a-1fd1-4edd-b84f-4ff9d46bd0e3 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:49:44 user devstack@n-api.service[72090]: INFO nova.api.openstack.compute.server_external_events [req-83c99ab6-959b-4b45-9759-241f61892de7 req-54a9151a-1fd1-4edd-b84f-4ff9d46bd0e3 service nova] Creating event network-vif-deleted:91ae7fad-1a68-4881-8048-4fab8fcfe90a for instance e5a20eb7-20f0-4adc-bd8c-b9bf25c46c04 on user Apr 11 19:49:44 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [req-83c99ab6-959b-4b45-9759-241f61892de7 req-54a9151a-1fd1-4edd-b84f-4ff9d46bd0e3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032966 Apr 11 19:49:44 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 347/1043] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:49:44 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:49:45 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [req-14fbbcd1-8d6d-477a-8451-29556d8e8cb4 req-2c3d6fe7-e8e8-4d95-9c6e-9603d3caabb5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5a20eb7-20f0-4adc-bd8c-b9bf25c46c04", "name": "network-vif-plugged", "status": "completed", "tag": "91ae7fad-1a68-4881-8048-4fab8fcfe90a"}]} {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:49:45 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-14fbbcd1-8d6d-477a-8451-29556d8e8cb4 req-2c3d6fe7-e8e8-4d95-9c6e-9603d3caabb5 service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:49:45 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-14fbbcd1-8d6d-477a-8451-29556d8e8cb4 req-2c3d6fe7-e8e8-4d95-9c6e-9603d3caabb5 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:49:45 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-14fbbcd1-8d6d-477a-8451-29556d8e8cb4 req-2c3d6fe7-e8e8-4d95-9c6e-9603d3caabb5 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:49:45 user devstack@n-api.service[72089]: INFO nova.api.openstack.compute.server_external_events [req-14fbbcd1-8d6d-477a-8451-29556d8e8cb4 req-2c3d6fe7-e8e8-4d95-9c6e-9603d3caabb5 service nova] Creating event network-vif-plugged:91ae7fad-1a68-4881-8048-4fab8fcfe90a for instance e5a20eb7-20f0-4adc-bd8c-b9bf25c46c04 on user Apr 11 19:49:45 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [req-14fbbcd1-8d6d-477a-8451-29556d8e8cb4 req-2c3d6fe7-e8e8-4d95-9c6e-9603d3caabb5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032707 Apr 11 19:49:45 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 356/1044] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:49:45 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:50:26 user devstack@n-api.service[72088]: DEBUG dbcounter [-] [72088] Writing DB stats nova_api:SELECT=6 {{(pid=72088) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:50:26 user devstack@n-api.service[72088]: DEBUG dbcounter [-] [72088] Writing DB stats nova_cell1:SELECT=10 {{(pid=72088) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:50:26 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [None req-8653e24c-d4e6-4b0c-90ed-6f819da581a5 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Calling method '>' {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:50:26 user devstack@n-api.service[72088]: DEBUG nova.compute.api [None req-8653e24c-d4e6-4b0c-90ed-6f819da581a5 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] [instance: f633037d-87d0-4dda-aa33-3cc9c3191080] Fetching instance by UUID {{(pid=72088) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:50:26 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-8653e24c-d4e6-4b0c-90ed-6f819da581a5 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:50:26 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-8653e24c-d4e6-4b0c-90ed-6f819da581a5 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:50:26 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-8653e24c-d4e6-4b0c-90ed-6f819da581a5 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:50:26 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-8653e24c-d4e6-4b0c-90ed-6f819da581a5 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:50:26 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-8653e24c-d4e6-4b0c-90ed-6f819da581a5 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:50:26 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-8653e24c-d4e6-4b0c-90ed-6f819da581a5 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:50:26 user devstack@n-api.service[72088]: INFO nova.api.openstack.wsgi [None req-8653e24c-d4e6-4b0c-90ed-6f819da581a5 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] HTTP exception thrown: Instance f633037d-87d0-4dda-aa33-3cc9c3191080 could not be found. Apr 11 19:50:26 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [None req-8653e24c-d4e6-4b0c-90ed-6f819da581a5 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Request method failure captured: Apr 11 19:50:26 user devstack@n-api.service[72088]: request: GET /compute/v2.1/servers/f633037d-87d0-4dda-aa33-3cc9c3191080 HTTP/1.1 Apr 11 19:50:26 user devstack@n-api.service[72088]: Accept: application/json Apr 11 19:50:26 user devstack@n-api.service[72088]: Accept-Encoding: identity Apr 11 19:50:26 user devstack@n-api.service[72088]: Connection: close Apr 11 19:50:26 user devstack@n-api.service[72088]: Content-Length: 0 Apr 11 19:50:26 user devstack@n-api.service[72088]: Content-Type: application/json Apr 11 19:50:26 user devstack@n-api.service[72088]: Host: 10.0.0.210 Apr 11 19:50:26 user devstack@n-api.service[72088]: Openstack-System-Scope: None Apr 11 19:50:26 user devstack@n-api.service[72088]: User-Agent: python-urllib3/1.26.15 Apr 11 19:50:26 user devstack@n-api.service[72088]: X-Auth-Token: gAAAAABkNbR4bCdkWtJpeyTsYZLFONPnT_zinIH4x1SzpVTs_DUY92yHhUdZ1Be5ca42ne_MV0QfkvMTUzrjmQhXISCBCO99II9OZKv9BampoJ3QG4FhhPTvET8iKhYbJ7Ipqcffw1qgQYkqrkjqNHSIVG9eRSX49OVMWaaVKfSqTXnjihDuVyI Apr 11 19:50:26 user devstack@n-api.service[72088]: X-Domain-Id: None Apr 11 19:50:26 user devstack@n-api.service[72088]: X-Domain-Name: None Apr 11 19:50:26 user devstack@n-api.service[72088]: X-Identity-Status: Confirmed Apr 11 19:50:26 user devstack@n-api.service[72088]: X-Is-Admin-Project: True Apr 11 19:50:26 user devstack@n-api.service[72088]: X-Project-Domain-Id: default Apr 11 19:50:26 user devstack@n-api.service[72088]: X-Project-Domain-Name: Default Apr 11 19:50:26 user devstack@n-api.service[72088]: X-Project-Id: 60a7381a31b84e97a068528f90813773 Apr 11 19:50:26 user devstack@n-api.service[72088]: X-Project-Name: tempest-ServerActionsTestJSON-37730514 Apr 11 19:50:26 user devstack@n-api.service[72088]: X-Role: reader,member Apr 11 19:50:26 user devstack@n-api.service[72088]: X-Roles: reader,member Apr 11 19:50:26 user devstack@n-api.service[72088]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/60a7381a31b84e97a068528f90813773"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/60a7381a31b84e97a068528f90813773"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/60a7381a31b84e97a068528f90813773"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 11 19:50:26 user devstack@n-api.service[72088]: X-Tenant: tempest-ServerActionsTestJSON-37730514 Apr 11 19:50:26 user devstack@n-api.service[72088]: X-Tenant-Id: 60a7381a31b84e97a068528f90813773 Apr 11 19:50:26 user devstack@n-api.service[72088]: X-Tenant-Name: tempest-ServerActionsTestJSON-37730514 Apr 11 19:50:26 user devstack@n-api.service[72088]: X-User: tempest-ServerActionsTestJSON-37730514-project-member Apr 11 19:50:26 user devstack@n-api.service[72088]: X-User-Domain-Id: default Apr 11 19:50:26 user devstack@n-api.service[72088]: X-User-Domain-Name: Default Apr 11 19:50:26 user devstack@n-api.service[72088]: X-User-Id: 05fb551c320a48f98a4ec00a7f7492d7 Apr 11 19:50:26 user devstack@n-api.service[72088]: X-User-Name: tempest-ServerActionsTestJSON-37730514-project-member Apr 11 19:50:26 user devstack@n-api.service[72088]: method: > Apr 11 19:50:26 user devstack@n-api.service[72088]: exception: Instance f633037d-87d0-4dda-aa33-3cc9c3191080 could not be found. Apr 11 19:50:26 user devstack@n-api.service[72088]: action_args: {'id': 'f633037d-87d0-4dda-aa33-3cc9c3191080'} Apr 11 19:50:26 user devstack@n-api.service[72088]: {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 19:50:26 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:50:26 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 19:50:26 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 19:50:26 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 19:50:26 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 19:50:26 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 19:50:26 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 19:50:26 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 19:50:26 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 19:50:26 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f633037d-87d0-4dda-aa33-3cc9c3191080 could not be found. Apr 11 19:50:26 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi Apr 11 19:50:26 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 19:50:26 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi Apr 11 19:50:26 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:50:26 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 19:50:26 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 19:50:26 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 19:50:26 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 19:50:26 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 19:50:26 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 19:50:26 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 19:50:26 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 19:50:26 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 19:50:26 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 19:50:26 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 19:50:26 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 19:50:26 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f633037d-87d0-4dda-aa33-3cc9c3191080 could not be found. Apr 11 19:50:26 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi Apr 11 19:50:26 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 19:50:26 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi Apr 11 19:50:26 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:50:26 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 19:50:26 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 19:50:26 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 19:50:26 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 19:50:26 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f633037d-87d0-4dda-aa33-3cc9c3191080 could not be found. Apr 11 19:50:26 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi Apr 11 19:50:26 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [None req-8653e24c-d4e6-4b0c-90ed-6f819da581a5 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Returning 404 to user: Instance f633037d-87d0-4dda-aa33-3cc9c3191080 could not be found. {{(pid=72088) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 19:50:26 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [None req-8653e24c-d4e6-4b0c-90ed-6f819da581a5 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f633037d-87d0-4dda-aa33-3cc9c3191080" status: 404 len: 111 microversion: 2.1 time: 0.031766 Apr 11 19:50:26 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 342/1045] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 19:50:26 2023] GET /compute/v2.1/servers/f633037d-87d0-4dda-aa33-3cc9c3191080 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 19:50:26 user devstack@n-api.service[72090]: DEBUG dbcounter [-] [72090] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=72090) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:50:26 user devstack@n-api.service[72090]: DEBUG dbcounter [-] [72090] Writing DB stats nova_cell1:SELECT=19,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=72090) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:50:26 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [None req-f8ed6fad-4d2a-4c0c-8b33-4f0e39c86bf5 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Calling method '>' {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:50:26 user devstack@n-api.service[72090]: DEBUG nova.compute.api [None req-f8ed6fad-4d2a-4c0c-8b33-4f0e39c86bf5 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] [instance: f633037d-87d0-4dda-aa33-3cc9c3191080] Fetching instance by UUID {{(pid=72090) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:50:26 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-f8ed6fad-4d2a-4c0c-8b33-4f0e39c86bf5 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:50:26 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-f8ed6fad-4d2a-4c0c-8b33-4f0e39c86bf5 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:50:26 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-f8ed6fad-4d2a-4c0c-8b33-4f0e39c86bf5 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:50:26 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-f8ed6fad-4d2a-4c0c-8b33-4f0e39c86bf5 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:50:26 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-f8ed6fad-4d2a-4c0c-8b33-4f0e39c86bf5 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:50:26 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-f8ed6fad-4d2a-4c0c-8b33-4f0e39c86bf5 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:50:26 user devstack@n-api.service[72090]: INFO nova.api.openstack.wsgi [None req-f8ed6fad-4d2a-4c0c-8b33-4f0e39c86bf5 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] HTTP exception thrown: Instance f633037d-87d0-4dda-aa33-3cc9c3191080 could not be found. Apr 11 19:50:26 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [None req-f8ed6fad-4d2a-4c0c-8b33-4f0e39c86bf5 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Request method failure captured: Apr 11 19:50:26 user devstack@n-api.service[72090]: request: DELETE /compute/v2.1/servers/f633037d-87d0-4dda-aa33-3cc9c3191080 HTTP/1.1 Apr 11 19:50:26 user devstack@n-api.service[72090]: Accept: application/json Apr 11 19:50:26 user devstack@n-api.service[72090]: Accept-Encoding: identity Apr 11 19:50:26 user devstack@n-api.service[72090]: Connection: close Apr 11 19:50:26 user devstack@n-api.service[72090]: Content-Length: 0 Apr 11 19:50:26 user devstack@n-api.service[72090]: Content-Type: application/json Apr 11 19:50:26 user devstack@n-api.service[72090]: Host: 10.0.0.210 Apr 11 19:50:26 user devstack@n-api.service[72090]: Openstack-System-Scope: None Apr 11 19:50:26 user devstack@n-api.service[72090]: User-Agent: python-urllib3/1.26.15 Apr 11 19:50:26 user devstack@n-api.service[72090]: X-Auth-Token: gAAAAABkNbR4bCdkWtJpeyTsYZLFONPnT_zinIH4x1SzpVTs_DUY92yHhUdZ1Be5ca42ne_MV0QfkvMTUzrjmQhXISCBCO99II9OZKv9BampoJ3QG4FhhPTvET8iKhYbJ7Ipqcffw1qgQYkqrkjqNHSIVG9eRSX49OVMWaaVKfSqTXnjihDuVyI Apr 11 19:50:26 user devstack@n-api.service[72090]: X-Domain-Id: None Apr 11 19:50:26 user devstack@n-api.service[72090]: X-Domain-Name: None Apr 11 19:50:26 user devstack@n-api.service[72090]: X-Identity-Status: Confirmed Apr 11 19:50:26 user devstack@n-api.service[72090]: X-Is-Admin-Project: True Apr 11 19:50:26 user devstack@n-api.service[72090]: X-Project-Domain-Id: default Apr 11 19:50:26 user devstack@n-api.service[72090]: X-Project-Domain-Name: Default Apr 11 19:50:26 user devstack@n-api.service[72090]: X-Project-Id: 60a7381a31b84e97a068528f90813773 Apr 11 19:50:26 user devstack@n-api.service[72090]: X-Project-Name: tempest-ServerActionsTestJSON-37730514 Apr 11 19:50:26 user devstack@n-api.service[72090]: X-Role: reader,member Apr 11 19:50:26 user devstack@n-api.service[72090]: X-Roles: reader,member Apr 11 19:50:26 user devstack@n-api.service[72090]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/60a7381a31b84e97a068528f90813773"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/60a7381a31b84e97a068528f90813773"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/60a7381a31b84e97a068528f90813773"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 11 19:50:26 user devstack@n-api.service[72090]: X-Tenant: tempest-ServerActionsTestJSON-37730514 Apr 11 19:50:26 user devstack@n-api.service[72090]: X-Tenant-Id: 60a7381a31b84e97a068528f90813773 Apr 11 19:50:26 user devstack@n-api.service[72090]: X-Tenant-Name: tempest-ServerActionsTestJSON-37730514 Apr 11 19:50:26 user devstack@n-api.service[72090]: X-User: tempest-ServerActionsTestJSON-37730514-project-member Apr 11 19:50:26 user devstack@n-api.service[72090]: X-User-Domain-Id: default Apr 11 19:50:26 user devstack@n-api.service[72090]: X-User-Domain-Name: Default Apr 11 19:50:26 user devstack@n-api.service[72090]: X-User-Id: 05fb551c320a48f98a4ec00a7f7492d7 Apr 11 19:50:26 user devstack@n-api.service[72090]: X-User-Name: tempest-ServerActionsTestJSON-37730514-project-member Apr 11 19:50:26 user devstack@n-api.service[72090]: method: > Apr 11 19:50:26 user devstack@n-api.service[72090]: exception: Instance f633037d-87d0-4dda-aa33-3cc9c3191080 could not be found. Apr 11 19:50:26 user devstack@n-api.service[72090]: action_args: {'id': 'f633037d-87d0-4dda-aa33-3cc9c3191080'} Apr 11 19:50:26 user devstack@n-api.service[72090]: {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 19:50:26 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:50:26 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 19:50:26 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 19:50:26 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 19:50:26 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 19:50:26 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 19:50:26 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 19:50:26 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 19:50:26 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 19:50:26 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f633037d-87d0-4dda-aa33-3cc9c3191080 could not be found. Apr 11 19:50:26 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi Apr 11 19:50:26 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 19:50:26 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi Apr 11 19:50:26 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:50:26 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 19:50:26 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 19:50:26 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 19:50:26 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 19:50:26 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 19:50:26 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 19:50:26 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 11 19:50:26 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 11 19:50:26 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 11 19:50:26 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 11 19:50:26 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 19:50:26 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 19:50:26 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 19:50:26 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 19:50:26 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f633037d-87d0-4dda-aa33-3cc9c3191080 could not be found. Apr 11 19:50:26 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi Apr 11 19:50:26 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 19:50:26 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi Apr 11 19:50:26 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:50:26 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 19:50:26 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 19:50:26 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 19:50:26 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 19:50:26 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f633037d-87d0-4dda-aa33-3cc9c3191080 could not be found. Apr 11 19:50:26 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi Apr 11 19:50:26 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [None req-f8ed6fad-4d2a-4c0c-8b33-4f0e39c86bf5 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Returning 404 to user: Instance f633037d-87d0-4dda-aa33-3cc9c3191080 could not be found. {{(pid=72090) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 19:50:26 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [None req-f8ed6fad-4d2a-4c0c-8b33-4f0e39c86bf5 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/f633037d-87d0-4dda-aa33-3cc9c3191080" status: 404 len: 111 microversion: 2.1 time: 0.035940 Apr 11 19:50:26 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 348/1046] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 19:50:26 2023] DELETE /compute/v2.1/servers/f633037d-87d0-4dda-aa33-3cc9c3191080 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 11 19:50:26 user devstack@n-api.service[72089]: DEBUG dbcounter [-] [72089] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=72089) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:50:26 user devstack@n-api.service[72089]: DEBUG dbcounter [-] [72089] Writing DB stats nova_cell1:SELECT=25,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=72089) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:50:26 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [None req-98974133-37d9-4aed-9319-f4a71cbc32d6 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Calling method '>' {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:50:26 user devstack@n-api.service[72089]: DEBUG nova.compute.api [None req-98974133-37d9-4aed-9319-f4a71cbc32d6 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] [instance: f633037d-87d0-4dda-aa33-3cc9c3191080] Fetching instance by UUID {{(pid=72089) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:50:26 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-98974133-37d9-4aed-9319-f4a71cbc32d6 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:50:26 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-98974133-37d9-4aed-9319-f4a71cbc32d6 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:50:26 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-98974133-37d9-4aed-9319-f4a71cbc32d6 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:50:26 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-98974133-37d9-4aed-9319-f4a71cbc32d6 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:50:26 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-98974133-37d9-4aed-9319-f4a71cbc32d6 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:50:26 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-98974133-37d9-4aed-9319-f4a71cbc32d6 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:50:26 user devstack@n-api.service[72089]: INFO nova.api.openstack.wsgi [None req-98974133-37d9-4aed-9319-f4a71cbc32d6 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] HTTP exception thrown: Instance f633037d-87d0-4dda-aa33-3cc9c3191080 could not be found. Apr 11 19:50:26 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [None req-98974133-37d9-4aed-9319-f4a71cbc32d6 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Request method failure captured: Apr 11 19:50:26 user devstack@n-api.service[72089]: request: GET /compute/v2.1/servers/f633037d-87d0-4dda-aa33-3cc9c3191080 HTTP/1.1 Apr 11 19:50:26 user devstack@n-api.service[72089]: Accept: application/json Apr 11 19:50:26 user devstack@n-api.service[72089]: Accept-Encoding: identity Apr 11 19:50:26 user devstack@n-api.service[72089]: Connection: close Apr 11 19:50:26 user devstack@n-api.service[72089]: Content-Length: 0 Apr 11 19:50:26 user devstack@n-api.service[72089]: Content-Type: application/json Apr 11 19:50:26 user devstack@n-api.service[72089]: Host: 10.0.0.210 Apr 11 19:50:26 user devstack@n-api.service[72089]: Openstack-System-Scope: None Apr 11 19:50:26 user devstack@n-api.service[72089]: User-Agent: python-urllib3/1.26.15 Apr 11 19:50:26 user devstack@n-api.service[72089]: X-Auth-Token: gAAAAABkNbR4bCdkWtJpeyTsYZLFONPnT_zinIH4x1SzpVTs_DUY92yHhUdZ1Be5ca42ne_MV0QfkvMTUzrjmQhXISCBCO99II9OZKv9BampoJ3QG4FhhPTvET8iKhYbJ7Ipqcffw1qgQYkqrkjqNHSIVG9eRSX49OVMWaaVKfSqTXnjihDuVyI Apr 11 19:50:26 user devstack@n-api.service[72089]: X-Domain-Id: None Apr 11 19:50:26 user devstack@n-api.service[72089]: X-Domain-Name: None Apr 11 19:50:26 user devstack@n-api.service[72089]: X-Identity-Status: Confirmed Apr 11 19:50:26 user devstack@n-api.service[72089]: X-Is-Admin-Project: True Apr 11 19:50:26 user devstack@n-api.service[72089]: X-Project-Domain-Id: default Apr 11 19:50:26 user devstack@n-api.service[72089]: X-Project-Domain-Name: Default Apr 11 19:50:26 user devstack@n-api.service[72089]: X-Project-Id: 60a7381a31b84e97a068528f90813773 Apr 11 19:50:26 user devstack@n-api.service[72089]: X-Project-Name: tempest-ServerActionsTestJSON-37730514 Apr 11 19:50:26 user devstack@n-api.service[72089]: X-Role: reader,member Apr 11 19:50:26 user devstack@n-api.service[72089]: X-Roles: reader,member Apr 11 19:50:26 user devstack@n-api.service[72089]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/60a7381a31b84e97a068528f90813773"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/60a7381a31b84e97a068528f90813773"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/60a7381a31b84e97a068528f90813773"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 11 19:50:26 user devstack@n-api.service[72089]: X-Tenant: tempest-ServerActionsTestJSON-37730514 Apr 11 19:50:26 user devstack@n-api.service[72089]: X-Tenant-Id: 60a7381a31b84e97a068528f90813773 Apr 11 19:50:26 user devstack@n-api.service[72089]: X-Tenant-Name: tempest-ServerActionsTestJSON-37730514 Apr 11 19:50:26 user devstack@n-api.service[72089]: X-User: tempest-ServerActionsTestJSON-37730514-project-member Apr 11 19:50:26 user devstack@n-api.service[72089]: X-User-Domain-Id: default Apr 11 19:50:26 user devstack@n-api.service[72089]: X-User-Domain-Name: Default Apr 11 19:50:26 user devstack@n-api.service[72089]: X-User-Id: 05fb551c320a48f98a4ec00a7f7492d7 Apr 11 19:50:26 user devstack@n-api.service[72089]: X-User-Name: tempest-ServerActionsTestJSON-37730514-project-member Apr 11 19:50:26 user devstack@n-api.service[72089]: method: > Apr 11 19:50:26 user devstack@n-api.service[72089]: exception: Instance f633037d-87d0-4dda-aa33-3cc9c3191080 could not be found. Apr 11 19:50:26 user devstack@n-api.service[72089]: action_args: {'id': 'f633037d-87d0-4dda-aa33-3cc9c3191080'} Apr 11 19:50:26 user devstack@n-api.service[72089]: {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 19:50:26 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:50:26 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 19:50:26 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 19:50:26 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 19:50:26 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 19:50:26 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 19:50:26 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 19:50:26 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 19:50:26 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 19:50:26 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f633037d-87d0-4dda-aa33-3cc9c3191080 could not be found. Apr 11 19:50:26 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi Apr 11 19:50:26 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 19:50:26 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi Apr 11 19:50:26 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:50:26 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 19:50:26 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 19:50:26 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 19:50:26 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 19:50:26 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 19:50:26 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 19:50:26 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 19:50:26 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 19:50:26 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 19:50:26 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 19:50:26 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 19:50:26 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 19:50:26 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f633037d-87d0-4dda-aa33-3cc9c3191080 could not be found. Apr 11 19:50:26 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi Apr 11 19:50:26 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 19:50:26 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi Apr 11 19:50:26 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:50:26 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 19:50:26 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 19:50:26 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 19:50:26 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 19:50:26 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f633037d-87d0-4dda-aa33-3cc9c3191080 could not be found. Apr 11 19:50:26 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi Apr 11 19:50:26 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [None req-98974133-37d9-4aed-9319-f4a71cbc32d6 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Returning 404 to user: Instance f633037d-87d0-4dda-aa33-3cc9c3191080 could not be found. {{(pid=72089) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 19:50:26 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [None req-98974133-37d9-4aed-9319-f4a71cbc32d6 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f633037d-87d0-4dda-aa33-3cc9c3191080" status: 404 len: 111 microversion: 2.1 time: 0.046789 Apr 11 19:50:26 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 357/1047] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 19:50:26 2023] GET /compute/v2.1/servers/f633037d-87d0-4dda-aa33-3cc9c3191080 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 19:50:26 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [None req-6880d8a6-d4ef-41ae-a9b4-36f1f48821c3 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Calling method '>' {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:50:26 user devstack@n-api.service[72088]: DEBUG nova.compute.api [None req-6880d8a6-d4ef-41ae-a9b4-36f1f48821c3 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] [instance: 478eb884-ba19-4a4b-b1eb-a2e59d6beef0] Fetching instance by UUID {{(pid=72088) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:50:26 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-6880d8a6-d4ef-41ae-a9b4-36f1f48821c3 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:50:26 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-6880d8a6-d4ef-41ae-a9b4-36f1f48821c3 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:50:26 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-6880d8a6-d4ef-41ae-a9b4-36f1f48821c3 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:50:26 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-6880d8a6-d4ef-41ae-a9b4-36f1f48821c3 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:50:26 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-6880d8a6-d4ef-41ae-a9b4-36f1f48821c3 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:50:26 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-6880d8a6-d4ef-41ae-a9b4-36f1f48821c3 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:50:26 user devstack@n-api.service[72088]: DEBUG nova.compute.api [None req-6880d8a6-d4ef-41ae-a9b4-36f1f48821c3 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] [instance: 478eb884-ba19-4a4b-b1eb-a2e59d6beef0] Going to try to terminate instance {{(pid=72088) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 11 19:50:27 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [None req-6880d8a6-d4ef-41ae-a9b4-36f1f48821c3 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/478eb884-ba19-4a4b-b1eb-a2e59d6beef0" status: 204 len: 0 microversion: 2.1 time: 0.187038 Apr 11 19:50:27 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 343/1048] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 19:50:26 2023] DELETE /compute/v2.1/servers/478eb884-ba19-4a4b-b1eb-a2e59d6beef0 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 11 19:50:27 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [None req-93848ba9-21dc-4112-b419-edaed9a3af76 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Calling method '>' {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:50:27 user devstack@n-api.service[72090]: DEBUG nova.compute.api [None req-93848ba9-21dc-4112-b419-edaed9a3af76 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] [instance: 478eb884-ba19-4a4b-b1eb-a2e59d6beef0] Fetching instance by UUID {{(pid=72090) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:50:27 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-93848ba9-21dc-4112-b419-edaed9a3af76 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:50:27 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-93848ba9-21dc-4112-b419-edaed9a3af76 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:50:27 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-93848ba9-21dc-4112-b419-edaed9a3af76 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:50:27 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-93848ba9-21dc-4112-b419-edaed9a3af76 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:50:27 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-93848ba9-21dc-4112-b419-edaed9a3af76 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:50:27 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-93848ba9-21dc-4112-b419-edaed9a3af76 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:50:27 user devstack@n-api.service[72090]: DEBUG nova.policy [None req-93848ba9-21dc-4112-b419-edaed9a3af76 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05fb551c320a48f98a4ec00a7f7492d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60a7381a31b84e97a068528f90813773', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72090) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:50:27 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [None req-93848ba9-21dc-4112-b419-edaed9a3af76 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] 10.0.0.210 "GET /compute/v2.1/servers/478eb884-ba19-4a4b-b1eb-a2e59d6beef0" status: 200 len: 1545 microversion: 2.1 time: 0.174772 Apr 11 19:50:27 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 349/1049] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 19:50:27 2023] GET /compute/v2.1/servers/478eb884-ba19-4a4b-b1eb-a2e59d6beef0 => generated 1545 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:50:27 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [req-2f5a68d9-46b5-4e64-bc13-de048bcd4ca2 req-6b7b621f-308f-497b-bc14-5fe2c2147915 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "478eb884-ba19-4a4b-b1eb-a2e59d6beef0", "name": "network-vif-unplugged", "status": "completed", "tag": "91ef79db-4548-423d-9022-b88dd7608438"}]} {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:50:27 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-2f5a68d9-46b5-4e64-bc13-de048bcd4ca2 req-6b7b621f-308f-497b-bc14-5fe2c2147915 service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:50:27 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-2f5a68d9-46b5-4e64-bc13-de048bcd4ca2 req-6b7b621f-308f-497b-bc14-5fe2c2147915 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:50:27 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-2f5a68d9-46b5-4e64-bc13-de048bcd4ca2 req-6b7b621f-308f-497b-bc14-5fe2c2147915 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:50:27 user devstack@n-api.service[72089]: INFO nova.api.openstack.compute.server_external_events [req-2f5a68d9-46b5-4e64-bc13-de048bcd4ca2 req-6b7b621f-308f-497b-bc14-5fe2c2147915 service nova] Creating event network-vif-unplugged:91ef79db-4548-423d-9022-b88dd7608438 for instance 478eb884-ba19-4a4b-b1eb-a2e59d6beef0 on user Apr 11 19:50:27 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [req-2f5a68d9-46b5-4e64-bc13-de048bcd4ca2 req-6b7b621f-308f-497b-bc14-5fe2c2147915 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033960 Apr 11 19:50:27 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 358/1050] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:50:27 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:50:29 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [req-d36298f0-09e1-4697-bf5b-04b48f9341ae req-97d71c5a-aa26-4923-a3a0-636df5af1076 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "478eb884-ba19-4a4b-b1eb-a2e59d6beef0", "name": "network-vif-plugged", "status": "completed", "tag": "91ef79db-4548-423d-9022-b88dd7608438"}, {"server_uuid": "478eb884-ba19-4a4b-b1eb-a2e59d6beef0", "name": "network-vif-deleted", "tag": "91ef79db-4548-423d-9022-b88dd7608438"}]} {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:50:29 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-d36298f0-09e1-4697-bf5b-04b48f9341ae req-97d71c5a-aa26-4923-a3a0-636df5af1076 service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:50:29 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-d36298f0-09e1-4697-bf5b-04b48f9341ae req-97d71c5a-aa26-4923-a3a0-636df5af1076 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:50:29 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-d36298f0-09e1-4697-bf5b-04b48f9341ae req-97d71c5a-aa26-4923-a3a0-636df5af1076 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:50:29 user devstack@n-api.service[72088]: INFO nova.api.openstack.compute.server_external_events [req-d36298f0-09e1-4697-bf5b-04b48f9341ae req-97d71c5a-aa26-4923-a3a0-636df5af1076 service nova] Creating event network-vif-plugged:91ef79db-4548-423d-9022-b88dd7608438 for instance 478eb884-ba19-4a4b-b1eb-a2e59d6beef0 on user Apr 11 19:50:29 user devstack@n-api.service[72088]: INFO nova.api.openstack.compute.server_external_events [req-d36298f0-09e1-4697-bf5b-04b48f9341ae req-97d71c5a-aa26-4923-a3a0-636df5af1076 service nova] Creating event network-vif-deleted:91ef79db-4548-423d-9022-b88dd7608438 for instance 478eb884-ba19-4a4b-b1eb-a2e59d6beef0 on user Apr 11 19:50:29 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [req-d36298f0-09e1-4697-bf5b-04b48f9341ae req-97d71c5a-aa26-4923-a3a0-636df5af1076 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.037845 Apr 11 19:50:29 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 344/1051] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:50:29 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:50:33 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [None req-4509f79d-62ed-42fa-9e3d-165a66969bb9 tempest-VolumesActionsTest-283035711 tempest-VolumesActionsTest-283035711-project-member] Calling method '>' {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:50:33 user devstack@n-api.service[72090]: DEBUG nova.compute.api [None req-4509f79d-62ed-42fa-9e3d-165a66969bb9 tempest-VolumesActionsTest-283035711 tempest-VolumesActionsTest-283035711-project-member] [instance: e5a20eb7-20f0-4adc-bd8c-b9bf25c46c04] Fetching instance by UUID {{(pid=72090) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:50:33 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-4509f79d-62ed-42fa-9e3d-165a66969bb9 tempest-VolumesActionsTest-283035711 tempest-VolumesActionsTest-283035711-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:50:33 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-4509f79d-62ed-42fa-9e3d-165a66969bb9 tempest-VolumesActionsTest-283035711 tempest-VolumesActionsTest-283035711-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:50:33 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-4509f79d-62ed-42fa-9e3d-165a66969bb9 tempest-VolumesActionsTest-283035711 tempest-VolumesActionsTest-283035711-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:50:33 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-4509f79d-62ed-42fa-9e3d-165a66969bb9 tempest-VolumesActionsTest-283035711 tempest-VolumesActionsTest-283035711-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:50:33 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-4509f79d-62ed-42fa-9e3d-165a66969bb9 tempest-VolumesActionsTest-283035711 tempest-VolumesActionsTest-283035711-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:50:33 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-4509f79d-62ed-42fa-9e3d-165a66969bb9 tempest-VolumesActionsTest-283035711 tempest-VolumesActionsTest-283035711-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:50:33 user devstack@n-api.service[72090]: INFO nova.api.openstack.wsgi [None req-4509f79d-62ed-42fa-9e3d-165a66969bb9 tempest-VolumesActionsTest-283035711 tempest-VolumesActionsTest-283035711-project-member] HTTP exception thrown: Instance e5a20eb7-20f0-4adc-bd8c-b9bf25c46c04 could not be found. Apr 11 19:50:33 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [None req-4509f79d-62ed-42fa-9e3d-165a66969bb9 tempest-VolumesActionsTest-283035711 tempest-VolumesActionsTest-283035711-project-member] Request method failure captured: Apr 11 19:50:33 user devstack@n-api.service[72090]: request: GET /compute/v2.1/servers/e5a20eb7-20f0-4adc-bd8c-b9bf25c46c04 HTTP/1.1 Apr 11 19:50:33 user devstack@n-api.service[72090]: Accept: application/json Apr 11 19:50:33 user devstack@n-api.service[72090]: Accept-Encoding: identity Apr 11 19:50:33 user devstack@n-api.service[72090]: Connection: close Apr 11 19:50:33 user devstack@n-api.service[72090]: Content-Length: 0 Apr 11 19:50:33 user devstack@n-api.service[72090]: Content-Type: application/json Apr 11 19:50:33 user devstack@n-api.service[72090]: Host: 10.0.0.210 Apr 11 19:50:33 user devstack@n-api.service[72090]: Openstack-System-Scope: None Apr 11 19:50:33 user devstack@n-api.service[72090]: User-Agent: python-urllib3/1.26.15 Apr 11 19:50:33 user devstack@n-api.service[72090]: X-Auth-Token: gAAAAABkNbli1cO80NsFljvLcvrgsLnrn1R9RXSdAMha5dvCE3xl5qO-Z2juMv9IbY7UdVbOXBIgXn0DjlgwJxL14aNB7ibpmLyg7c0Q4gLsr_IBBbRll3fpJkzuzxsWs9JKiVf4StIWxSRsYoGIqgSoM3lB64Vldv8kxN3Xc1asnKy9DuAjb1s Apr 11 19:50:33 user devstack@n-api.service[72090]: X-Domain-Id: None Apr 11 19:50:33 user devstack@n-api.service[72090]: X-Domain-Name: None Apr 11 19:50:33 user devstack@n-api.service[72090]: X-Identity-Status: Confirmed Apr 11 19:50:33 user devstack@n-api.service[72090]: X-Is-Admin-Project: True Apr 11 19:50:33 user devstack@n-api.service[72090]: X-Project-Domain-Id: default Apr 11 19:50:33 user devstack@n-api.service[72090]: X-Project-Domain-Name: Default Apr 11 19:50:33 user devstack@n-api.service[72090]: X-Project-Id: 56b09d8c9ff94045a36fdc454f8875e8 Apr 11 19:50:33 user devstack@n-api.service[72090]: X-Project-Name: tempest-VolumesActionsTest-283035711 Apr 11 19:50:33 user devstack@n-api.service[72090]: X-Role: reader,member Apr 11 19:50:33 user devstack@n-api.service[72090]: X-Roles: reader,member Apr 11 19:50:33 user devstack@n-api.service[72090]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/56b09d8c9ff94045a36fdc454f8875e8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/56b09d8c9ff94045a36fdc454f8875e8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/56b09d8c9ff94045a36fdc454f8875e8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 11 19:50:33 user devstack@n-api.service[72090]: X-Tenant: tempest-VolumesActionsTest-283035711 Apr 11 19:50:33 user devstack@n-api.service[72090]: X-Tenant-Id: 56b09d8c9ff94045a36fdc454f8875e8 Apr 11 19:50:33 user devstack@n-api.service[72090]: X-Tenant-Name: tempest-VolumesActionsTest-283035711 Apr 11 19:50:33 user devstack@n-api.service[72090]: X-User: tempest-VolumesActionsTest-283035711-project-member Apr 11 19:50:33 user devstack@n-api.service[72090]: X-User-Domain-Id: default Apr 11 19:50:33 user devstack@n-api.service[72090]: X-User-Domain-Name: Default Apr 11 19:50:33 user devstack@n-api.service[72090]: X-User-Id: 98feebb43745423299d602c50d09d982 Apr 11 19:50:33 user devstack@n-api.service[72090]: X-User-Name: tempest-VolumesActionsTest-283035711-project-member Apr 11 19:50:33 user devstack@n-api.service[72090]: method: > Apr 11 19:50:33 user devstack@n-api.service[72090]: exception: Instance e5a20eb7-20f0-4adc-bd8c-b9bf25c46c04 could not be found. Apr 11 19:50:33 user devstack@n-api.service[72090]: action_args: {'id': 'e5a20eb7-20f0-4adc-bd8c-b9bf25c46c04'} Apr 11 19:50:33 user devstack@n-api.service[72090]: {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 19:50:33 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:50:33 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 19:50:33 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 19:50:33 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 19:50:33 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 19:50:33 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 19:50:33 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 19:50:33 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 19:50:33 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 19:50:33 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e5a20eb7-20f0-4adc-bd8c-b9bf25c46c04 could not be found. Apr 11 19:50:33 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi Apr 11 19:50:33 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 19:50:33 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi Apr 11 19:50:33 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:50:33 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 19:50:33 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 19:50:33 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 19:50:33 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 19:50:33 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 19:50:33 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 19:50:33 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 19:50:33 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 19:50:33 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 19:50:33 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 19:50:33 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 19:50:33 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 19:50:33 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e5a20eb7-20f0-4adc-bd8c-b9bf25c46c04 could not be found. Apr 11 19:50:33 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi Apr 11 19:50:33 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 19:50:33 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi Apr 11 19:50:33 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:50:33 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 19:50:33 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 19:50:33 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 19:50:33 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 19:50:33 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e5a20eb7-20f0-4adc-bd8c-b9bf25c46c04 could not be found. Apr 11 19:50:33 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi Apr 11 19:50:33 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [None req-4509f79d-62ed-42fa-9e3d-165a66969bb9 tempest-VolumesActionsTest-283035711 tempest-VolumesActionsTest-283035711-project-member] Returning 404 to user: Instance e5a20eb7-20f0-4adc-bd8c-b9bf25c46c04 could not be found. {{(pid=72090) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 19:50:33 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [None req-4509f79d-62ed-42fa-9e3d-165a66969bb9 tempest-VolumesActionsTest-283035711 tempest-VolumesActionsTest-283035711-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e5a20eb7-20f0-4adc-bd8c-b9bf25c46c04" status: 404 len: 111 microversion: 2.1 time: 0.027320 Apr 11 19:50:33 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 350/1052] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 19:50:33 2023] GET /compute/v2.1/servers/e5a20eb7-20f0-4adc-bd8c-b9bf25c46c04 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 19:51:07 user devstack@n-api.service[72089]: DEBUG dbcounter [-] [72089] Writing DB stats nova_api:SELECT=4 {{(pid=72089) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:51:07 user devstack@n-api.service[72089]: DEBUG dbcounter [-] [72089] Writing DB stats nova_cell1:SELECT=4 {{(pid=72089) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:51:07 user devstack@n-api.service[72089]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 11 19:51:07 user devstack@n-api.service[72089]: Tue Apr 11 19:51:07 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs (ip 10.0.0.210) !!! Apr 11 19:51:07 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [None req-98d2815b-5161-42ce-9dbe-1c285723f7e0 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Action: 'create', calling method: .version_select at 0x7f119df883a0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1152467569", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI18204baiBVey1ZMWNZgAXku8ITr+T9lmJFBe0OUSjsJjhwMsoF8Nia2sCNNHRfU+aQv/nMbkic9XzbeqSSkUeyn6yJaTTLyXjcGyr2kpsbZzhhonDPPZJaRnKWHYbpug=="}} {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:51:07 user devstack@n-api.service[72089]: DEBUG nova.quota [None req-98d2815b-5161-42ce-9dbe-1c285723f7e0 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Getting quotas for project ae5919e23c6a4c54b3a05a422c232c9f. Resources: {'key_pairs'} {{(pid=72089) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 19:51:07 user devstack@n-api.service[72089]: DEBUG nova.quota [None req-98d2815b-5161-42ce-9dbe-1c285723f7e0 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Getting quotas for user 2fbfa8948ce64dff92344749d2f0f0c7 and project ae5919e23c6a4c54b3a05a422c232c9f. Resources: {'key_pairs'} {{(pid=72089) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 19:51:07 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [None req-98d2815b-5161-42ce-9dbe-1c285723f7e0 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.067349 Apr 11 19:51:07 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 359/1053] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Apr 11 19:51:07 2023] POST /compute/v2.1/os-keypairs => generated 403 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:51:07 user devstack@n-api.service[72088]: DEBUG dbcounter [-] [72088] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=72088) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:51:07 user devstack@n-api.service[72088]: DEBUG dbcounter [-] [72088] Writing DB stats nova_cell1:SELECT=19,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=72088) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:51:07 user devstack@n-api.service[72088]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 11 19:51:07 user devstack@n-api.service[72088]: Tue Apr 11 19:51:07 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.0.0.210) !!! Apr 11 19:51:07 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [None req-1518ab9e-3de6-42ad-a638-204233c33741 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1892471232", "imageRef": "bf3454f9-a827-4dc1-a960-dc67109c289a", "flavorRef": "42", "key_name": "tempest-TestMinimumBasicScenario-1152467569", "networks": [{"uuid": "9d90c2b0-40f8-4911-a518-b03cdd738924"}]}} {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:51:07 user devstack@n-api.service[72088]: DEBUG nova.network.neutron [None req-1518ab9e-3de6-42ad-a638-204233c33741 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] validate_networks() for [('9d90c2b0-40f8-4911-a518-b03cdd738924', None, None, None, None, None)] {{(pid=72088) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 11 19:51:07 user devstack@n-api.service[72088]: DEBUG nova.virt.hardware [None req-1518ab9e-3de6-42ad-a638-204233c33741 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Flavor limits 0:0:0 {{(pid=72088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 19:51:07 user devstack@n-api.service[72088]: DEBUG nova.virt.hardware [None req-1518ab9e-3de6-42ad-a638-204233c33741 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Image limits 0:0:0 {{(pid=72088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 19:51:07 user devstack@n-api.service[72088]: DEBUG nova.virt.hardware [None req-1518ab9e-3de6-42ad-a638-204233c33741 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Flavor pref 0:0:0 {{(pid=72088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 19:51:07 user devstack@n-api.service[72088]: DEBUG nova.virt.hardware [None req-1518ab9e-3de6-42ad-a638-204233c33741 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Image pref 0:0:0 {{(pid=72088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 19:51:07 user devstack@n-api.service[72088]: DEBUG nova.virt.hardware [None req-1518ab9e-3de6-42ad-a638-204233c33741 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 19:51:07 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-1518ab9e-3de6-42ad-a638-204233c33741 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:51:07 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-1518ab9e-3de6-42ad-a638-204233c33741 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:51:07 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-1518ab9e-3de6-42ad-a638-204233c33741 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:51:07 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-1518ab9e-3de6-42ad-a638-204233c33741 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:51:07 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-1518ab9e-3de6-42ad-a638-204233c33741 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:51:07 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-1518ab9e-3de6-42ad-a638-204233c33741 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:51:07 user devstack@n-api.service[72088]: DEBUG nova.quota [None req-1518ab9e-3de6-42ad-a638-204233c33741 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Getting quotas for project ae5919e23c6a4c54b3a05a422c232c9f. Resources: {'ram', 'instances', 'cores'} {{(pid=72088) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 19:51:07 user devstack@n-api.service[72088]: DEBUG nova.quota [None req-1518ab9e-3de6-42ad-a638-204233c33741 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Getting quotas for user 2fbfa8948ce64dff92344749d2f0f0c7 and project ae5919e23c6a4c54b3a05a422c232c9f. Resources: {'ram', 'instances', 'cores'} {{(pid=72088) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 19:51:07 user devstack@n-api.service[72088]: DEBUG nova.compute.api [None req-1518ab9e-3de6-42ad-a638-204233c33741 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Going to run 1 instances... {{(pid=72088) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 11 19:51:07 user devstack@n-api.service[72088]: DEBUG nova.compute.api [None req-1518ab9e-3de6-42ad-a638-204233c33741 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] [instance: 52298792-b22d-4c8e-ba29-babc5653e2cc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bf3454f9-a827-4dc1-a960-dc67109c289a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=72088) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 11 19:51:07 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [None req-1518ab9e-3de6-42ad-a638-204233c33741 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.597497 Apr 11 19:51:07 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 345/1054] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 11 19:51:07 2023] POST /compute/v2.1/servers => generated 378 bytes in 599 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 11 19:51:07 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [None req-ffba518b-d5ac-492b-bd13-f513d25ca648 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Calling method '>' {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:51:07 user devstack@n-api.service[72090]: DEBUG nova.compute.api [None req-ffba518b-d5ac-492b-bd13-f513d25ca648 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] [instance: 52298792-b22d-4c8e-ba29-babc5653e2cc] Fetching instance by UUID {{(pid=72090) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:51:07 user devstack@n-api.service[72090]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 11 19:51:07 user devstack@n-api.service[72090]: Tue Apr 11 19:51:07 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/52298792-b22d-4c8e-ba29-babc5653e2cc (ip 10.0.0.210) !!! Apr 11 19:51:07 user devstack@n-api.service[72090]: DEBUG dbcounter [-] [72090] Writing DB stats nova_api:SELECT=6 {{(pid=72090) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:51:07 user devstack@n-api.service[72090]: DEBUG dbcounter [-] [72090] Writing DB stats nova_cell1:SELECT=10 {{(pid=72090) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:51:07 user devstack@n-api.service[72090]: DEBUG nova.policy [None req-ffba518b-d5ac-492b-bd13-f513d25ca648 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fbfa8948ce64dff92344749d2f0f0c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5919e23c6a4c54b3a05a422c232c9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72090) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:51:07 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [None req-ffba518b-d5ac-492b-bd13-f513d25ca648 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] 10.0.0.210 "GET /compute/v2.1/servers/52298792-b22d-4c8e-ba29-babc5653e2cc" status: 200 len: 1253 microversion: 2.1 time: 0.071877 Apr 11 19:51:07 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 351/1055] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 19:51:07 2023] GET /compute/v2.1/servers/52298792-b22d-4c8e-ba29-babc5653e2cc => generated 1253 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:51:10 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [req-b7dd3127-4cd1-44df-9899-40d7c2e0658b req-7b354b2f-7736-4bbc-9fed-81e1cc27252d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "52298792-b22d-4c8e-ba29-babc5653e2cc", "tag": "32c90c1c-3212-4427-a38d-f505443bf260"}]} {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:51:10 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-b7dd3127-4cd1-44df-9899-40d7c2e0658b req-7b354b2f-7736-4bbc-9fed-81e1cc27252d service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:51:10 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-b7dd3127-4cd1-44df-9899-40d7c2e0658b req-7b354b2f-7736-4bbc-9fed-81e1cc27252d service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:51:10 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-b7dd3127-4cd1-44df-9899-40d7c2e0658b req-7b354b2f-7736-4bbc-9fed-81e1cc27252d service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:51:10 user devstack@n-api.service[72089]: INFO nova.api.openstack.compute.server_external_events [req-b7dd3127-4cd1-44df-9899-40d7c2e0658b req-7b354b2f-7736-4bbc-9fed-81e1cc27252d service nova] Creating event network-changed:32c90c1c-3212-4427-a38d-f505443bf260 for instance 52298792-b22d-4c8e-ba29-babc5653e2cc on user Apr 11 19:51:10 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [req-b7dd3127-4cd1-44df-9899-40d7c2e0658b req-7b354b2f-7736-4bbc-9fed-81e1cc27252d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033680 Apr 11 19:51:10 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 360/1056] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:51:10 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:51:12 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [req-3d995229-377a-46cd-98af-664d6b2b6807 req-a76b5764-6c2b-47b1-a655-0bfa41d3ebe5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "52298792-b22d-4c8e-ba29-babc5653e2cc", "name": "network-vif-plugged", "status": "completed", "tag": "32c90c1c-3212-4427-a38d-f505443bf260"}]} {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:51:12 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-3d995229-377a-46cd-98af-664d6b2b6807 req-a76b5764-6c2b-47b1-a655-0bfa41d3ebe5 service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:51:12 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-3d995229-377a-46cd-98af-664d6b2b6807 req-a76b5764-6c2b-47b1-a655-0bfa41d3ebe5 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:51:12 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-3d995229-377a-46cd-98af-664d6b2b6807 req-a76b5764-6c2b-47b1-a655-0bfa41d3ebe5 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:51:12 user devstack@n-api.service[72088]: INFO nova.api.openstack.compute.server_external_events [req-3d995229-377a-46cd-98af-664d6b2b6807 req-a76b5764-6c2b-47b1-a655-0bfa41d3ebe5 service nova] Creating event network-vif-plugged:32c90c1c-3212-4427-a38d-f505443bf260 for instance 52298792-b22d-4c8e-ba29-babc5653e2cc on user Apr 11 19:51:12 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [req-3d995229-377a-46cd-98af-664d6b2b6807 req-a76b5764-6c2b-47b1-a655-0bfa41d3ebe5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040084 Apr 11 19:51:12 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 346/1057] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:51:12 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:51:14 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [req-bb3fbeef-f1e8-4a56-b617-83938da9afd6 req-b38340d6-9089-4cc7-8686-dc7eb68d95de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "52298792-b22d-4c8e-ba29-babc5653e2cc", "name": "network-vif-plugged", "status": "completed", "tag": "32c90c1c-3212-4427-a38d-f505443bf260"}]} {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:51:14 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-bb3fbeef-f1e8-4a56-b617-83938da9afd6 req-b38340d6-9089-4cc7-8686-dc7eb68d95de service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:51:14 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-bb3fbeef-f1e8-4a56-b617-83938da9afd6 req-b38340d6-9089-4cc7-8686-dc7eb68d95de service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:51:14 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-bb3fbeef-f1e8-4a56-b617-83938da9afd6 req-b38340d6-9089-4cc7-8686-dc7eb68d95de service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:51:14 user devstack@n-api.service[72090]: INFO nova.api.openstack.compute.server_external_events [req-bb3fbeef-f1e8-4a56-b617-83938da9afd6 req-b38340d6-9089-4cc7-8686-dc7eb68d95de service nova] Creating event network-vif-plugged:32c90c1c-3212-4427-a38d-f505443bf260 for instance 52298792-b22d-4c8e-ba29-babc5653e2cc on user Apr 11 19:51:14 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [req-bb3fbeef-f1e8-4a56-b617-83938da9afd6 req-b38340d6-9089-4cc7-8686-dc7eb68d95de service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031999 Apr 11 19:51:14 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 352/1058] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:51:14 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:51:17 user devstack@n-api.service[72089]: DEBUG dbcounter [-] [72089] Writing DB stats nova_cell0:SELECT=4 {{(pid=72089) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:51:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [None req-bc60a5d8-abe9-41f3-bc83-0d299559b780 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Calling method '>' {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:51:17 user devstack@n-api.service[72089]: DEBUG nova.compute.api [None req-bc60a5d8-abe9-41f3-bc83-0d299559b780 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] [instance: 478eb884-ba19-4a4b-b1eb-a2e59d6beef0] Fetching instance by UUID {{(pid=72089) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:51:17 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-bc60a5d8-abe9-41f3-bc83-0d299559b780 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:51:17 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-bc60a5d8-abe9-41f3-bc83-0d299559b780 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:51:17 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-bc60a5d8-abe9-41f3-bc83-0d299559b780 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:51:17 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-bc60a5d8-abe9-41f3-bc83-0d299559b780 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:51:17 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-bc60a5d8-abe9-41f3-bc83-0d299559b780 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:51:17 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-bc60a5d8-abe9-41f3-bc83-0d299559b780 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:51:17 user devstack@n-api.service[72089]: INFO nova.api.openstack.wsgi [None req-bc60a5d8-abe9-41f3-bc83-0d299559b780 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] HTTP exception thrown: Instance 478eb884-ba19-4a4b-b1eb-a2e59d6beef0 could not be found. Apr 11 19:51:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [None req-bc60a5d8-abe9-41f3-bc83-0d299559b780 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Request method failure captured: Apr 11 19:51:17 user devstack@n-api.service[72089]: request: GET /compute/v2.1/servers/478eb884-ba19-4a4b-b1eb-a2e59d6beef0 HTTP/1.1 Apr 11 19:51:17 user devstack@n-api.service[72089]: Accept: application/json Apr 11 19:51:17 user devstack@n-api.service[72089]: Accept-Encoding: identity Apr 11 19:51:17 user devstack@n-api.service[72089]: Connection: close Apr 11 19:51:17 user devstack@n-api.service[72089]: Content-Length: 0 Apr 11 19:51:17 user devstack@n-api.service[72089]: Content-Type: application/json Apr 11 19:51:17 user devstack@n-api.service[72089]: Host: 10.0.0.210 Apr 11 19:51:17 user devstack@n-api.service[72089]: Openstack-System-Scope: None Apr 11 19:51:17 user devstack@n-api.service[72089]: User-Agent: python-urllib3/1.26.15 Apr 11 19:51:17 user devstack@n-api.service[72089]: X-Auth-Token: gAAAAABkNbR4bCdkWtJpeyTsYZLFONPnT_zinIH4x1SzpVTs_DUY92yHhUdZ1Be5ca42ne_MV0QfkvMTUzrjmQhXISCBCO99II9OZKv9BampoJ3QG4FhhPTvET8iKhYbJ7Ipqcffw1qgQYkqrkjqNHSIVG9eRSX49OVMWaaVKfSqTXnjihDuVyI Apr 11 19:51:17 user devstack@n-api.service[72089]: X-Domain-Id: None Apr 11 19:51:17 user devstack@n-api.service[72089]: X-Domain-Name: None Apr 11 19:51:17 user devstack@n-api.service[72089]: X-Identity-Status: Confirmed Apr 11 19:51:17 user devstack@n-api.service[72089]: X-Is-Admin-Project: True Apr 11 19:51:17 user devstack@n-api.service[72089]: X-Project-Domain-Id: default Apr 11 19:51:17 user devstack@n-api.service[72089]: X-Project-Domain-Name: Default Apr 11 19:51:17 user devstack@n-api.service[72089]: X-Project-Id: 60a7381a31b84e97a068528f90813773 Apr 11 19:51:17 user devstack@n-api.service[72089]: X-Project-Name: tempest-ServerActionsTestJSON-37730514 Apr 11 19:51:17 user devstack@n-api.service[72089]: X-Role: reader,member Apr 11 19:51:17 user devstack@n-api.service[72089]: X-Roles: reader,member Apr 11 19:51:17 user devstack@n-api.service[72089]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/60a7381a31b84e97a068528f90813773"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/60a7381a31b84e97a068528f90813773"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/60a7381a31b84e97a068528f90813773"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 11 19:51:17 user devstack@n-api.service[72089]: X-Tenant: tempest-ServerActionsTestJSON-37730514 Apr 11 19:51:17 user devstack@n-api.service[72089]: X-Tenant-Id: 60a7381a31b84e97a068528f90813773 Apr 11 19:51:17 user devstack@n-api.service[72089]: X-Tenant-Name: tempest-ServerActionsTestJSON-37730514 Apr 11 19:51:17 user devstack@n-api.service[72089]: X-User: tempest-ServerActionsTestJSON-37730514-project-member Apr 11 19:51:17 user devstack@n-api.service[72089]: X-User-Domain-Id: default Apr 11 19:51:17 user devstack@n-api.service[72089]: X-User-Domain-Name: Default Apr 11 19:51:17 user devstack@n-api.service[72089]: X-User-Id: 05fb551c320a48f98a4ec00a7f7492d7 Apr 11 19:51:17 user devstack@n-api.service[72089]: X-User-Name: tempest-ServerActionsTestJSON-37730514-project-member Apr 11 19:51:17 user devstack@n-api.service[72089]: method: > Apr 11 19:51:17 user devstack@n-api.service[72089]: exception: Instance 478eb884-ba19-4a4b-b1eb-a2e59d6beef0 could not be found. Apr 11 19:51:17 user devstack@n-api.service[72089]: action_args: {'id': '478eb884-ba19-4a4b-b1eb-a2e59d6beef0'} Apr 11 19:51:17 user devstack@n-api.service[72089]: {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 19:51:17 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:51:17 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 19:51:17 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 19:51:17 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 19:51:17 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 19:51:17 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 19:51:17 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 19:51:17 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 19:51:17 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 19:51:17 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 478eb884-ba19-4a4b-b1eb-a2e59d6beef0 could not be found. Apr 11 19:51:17 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi Apr 11 19:51:17 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 19:51:17 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi Apr 11 19:51:17 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:51:17 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 19:51:17 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 19:51:17 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 19:51:17 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 19:51:17 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 19:51:17 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 19:51:17 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 19:51:17 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 19:51:17 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 19:51:17 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 19:51:17 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 19:51:17 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 19:51:17 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 478eb884-ba19-4a4b-b1eb-a2e59d6beef0 could not be found. Apr 11 19:51:17 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi Apr 11 19:51:17 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 19:51:17 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi Apr 11 19:51:17 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:51:17 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 19:51:17 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 19:51:17 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 19:51:17 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 19:51:17 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 478eb884-ba19-4a4b-b1eb-a2e59d6beef0 could not be found. Apr 11 19:51:17 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi Apr 11 19:51:17 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [None req-bc60a5d8-abe9-41f3-bc83-0d299559b780 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Returning 404 to user: Instance 478eb884-ba19-4a4b-b1eb-a2e59d6beef0 could not be found. {{(pid=72089) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 19:51:17 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [None req-bc60a5d8-abe9-41f3-bc83-0d299559b780 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] 10.0.0.210 "GET /compute/v2.1/servers/478eb884-ba19-4a4b-b1eb-a2e59d6beef0" status: 404 len: 111 microversion: 2.1 time: 0.036839 Apr 11 19:51:17 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 361/1059] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 19:51:17 2023] GET /compute/v2.1/servers/478eb884-ba19-4a4b-b1eb-a2e59d6beef0 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 19:51:19 user devstack@n-api.service[72088]: DEBUG dbcounter [-] [72088] Writing DB stats nova_cell0:SELECT=2 {{(pid=72088) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:51:19 user devstack@n-api.service[72088]: DEBUG dbcounter [-] [72088] Writing DB stats nova_cell0:SELECT=6 {{(pid=72088) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:51:19 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [None req-f7f4d5f7-33c9-4b8e-9bc9-b0ce4eb850d3 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Calling method '>' {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:51:19 user devstack@n-api.service[72088]: DEBUG nova.compute.api [None req-f7f4d5f7-33c9-4b8e-9bc9-b0ce4eb850d3 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] [instance: 647674d8-af53-405a-8116-4b7a01549bdf] Fetching instance by UUID {{(pid=72088) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:51:19 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-f7f4d5f7-33c9-4b8e-9bc9-b0ce4eb850d3 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:51:19 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-f7f4d5f7-33c9-4b8e-9bc9-b0ce4eb850d3 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:51:19 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-f7f4d5f7-33c9-4b8e-9bc9-b0ce4eb850d3 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:51:19 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-f7f4d5f7-33c9-4b8e-9bc9-b0ce4eb850d3 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:51:19 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-f7f4d5f7-33c9-4b8e-9bc9-b0ce4eb850d3 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:51:19 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-f7f4d5f7-33c9-4b8e-9bc9-b0ce4eb850d3 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:51:19 user devstack@n-api.service[72088]: INFO nova.api.openstack.wsgi [None req-f7f4d5f7-33c9-4b8e-9bc9-b0ce4eb850d3 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] HTTP exception thrown: Instance 647674d8-af53-405a-8116-4b7a01549bdf could not be found. Apr 11 19:51:19 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [None req-f7f4d5f7-33c9-4b8e-9bc9-b0ce4eb850d3 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Request method failure captured: Apr 11 19:51:19 user devstack@n-api.service[72088]: request: DELETE /compute/v2.1/servers/647674d8-af53-405a-8116-4b7a01549bdf HTTP/1.1 Apr 11 19:51:19 user devstack@n-api.service[72088]: Accept: application/json Apr 11 19:51:19 user devstack@n-api.service[72088]: Accept-Encoding: identity Apr 11 19:51:19 user devstack@n-api.service[72088]: Connection: close Apr 11 19:51:19 user devstack@n-api.service[72088]: Content-Length: 0 Apr 11 19:51:19 user devstack@n-api.service[72088]: Content-Type: application/json Apr 11 19:51:19 user devstack@n-api.service[72088]: Host: 10.0.0.210 Apr 11 19:51:19 user devstack@n-api.service[72088]: Openstack-System-Scope: None Apr 11 19:51:19 user devstack@n-api.service[72088]: User-Agent: python-urllib3/1.26.15 Apr 11 19:51:19 user devstack@n-api.service[72088]: X-Auth-Token: gAAAAABkNbR4bCdkWtJpeyTsYZLFONPnT_zinIH4x1SzpVTs_DUY92yHhUdZ1Be5ca42ne_MV0QfkvMTUzrjmQhXISCBCO99II9OZKv9BampoJ3QG4FhhPTvET8iKhYbJ7Ipqcffw1qgQYkqrkjqNHSIVG9eRSX49OVMWaaVKfSqTXnjihDuVyI Apr 11 19:51:19 user devstack@n-api.service[72088]: X-Domain-Id: None Apr 11 19:51:19 user devstack@n-api.service[72088]: X-Domain-Name: None Apr 11 19:51:19 user devstack@n-api.service[72088]: X-Identity-Status: Confirmed Apr 11 19:51:19 user devstack@n-api.service[72088]: X-Is-Admin-Project: True Apr 11 19:51:19 user devstack@n-api.service[72088]: X-Project-Domain-Id: default Apr 11 19:51:19 user devstack@n-api.service[72088]: X-Project-Domain-Name: Default Apr 11 19:51:19 user devstack@n-api.service[72088]: X-Project-Id: 60a7381a31b84e97a068528f90813773 Apr 11 19:51:19 user devstack@n-api.service[72088]: X-Project-Name: tempest-ServerActionsTestJSON-37730514 Apr 11 19:51:19 user devstack@n-api.service[72088]: X-Role: reader,member Apr 11 19:51:19 user devstack@n-api.service[72088]: X-Roles: reader,member Apr 11 19:51:19 user devstack@n-api.service[72088]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/60a7381a31b84e97a068528f90813773"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/60a7381a31b84e97a068528f90813773"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/60a7381a31b84e97a068528f90813773"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 11 19:51:19 user devstack@n-api.service[72088]: X-Tenant: tempest-ServerActionsTestJSON-37730514 Apr 11 19:51:19 user devstack@n-api.service[72088]: X-Tenant-Id: 60a7381a31b84e97a068528f90813773 Apr 11 19:51:19 user devstack@n-api.service[72088]: X-Tenant-Name: tempest-ServerActionsTestJSON-37730514 Apr 11 19:51:19 user devstack@n-api.service[72088]: X-User: tempest-ServerActionsTestJSON-37730514-project-member Apr 11 19:51:19 user devstack@n-api.service[72088]: X-User-Domain-Id: default Apr 11 19:51:19 user devstack@n-api.service[72088]: X-User-Domain-Name: Default Apr 11 19:51:19 user devstack@n-api.service[72088]: X-User-Id: 05fb551c320a48f98a4ec00a7f7492d7 Apr 11 19:51:19 user devstack@n-api.service[72088]: X-User-Name: tempest-ServerActionsTestJSON-37730514-project-member Apr 11 19:51:19 user devstack@n-api.service[72088]: method: > Apr 11 19:51:19 user devstack@n-api.service[72088]: exception: Instance 647674d8-af53-405a-8116-4b7a01549bdf could not be found. Apr 11 19:51:19 user devstack@n-api.service[72088]: action_args: {'id': '647674d8-af53-405a-8116-4b7a01549bdf'} Apr 11 19:51:19 user devstack@n-api.service[72088]: {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 19:51:19 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:51:19 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 19:51:19 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 19:51:19 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 19:51:19 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 19:51:19 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 19:51:19 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 19:51:19 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 19:51:19 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 19:51:19 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 647674d8-af53-405a-8116-4b7a01549bdf could not be found. Apr 11 19:51:19 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi Apr 11 19:51:19 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 19:51:19 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi Apr 11 19:51:19 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:51:19 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 19:51:19 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 19:51:19 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 19:51:19 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 19:51:19 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 19:51:19 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 19:51:19 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 11 19:51:19 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 11 19:51:19 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 11 19:51:19 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 11 19:51:19 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 19:51:19 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 19:51:19 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 19:51:19 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 19:51:19 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 647674d8-af53-405a-8116-4b7a01549bdf could not be found. Apr 11 19:51:19 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi Apr 11 19:51:19 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 19:51:19 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi Apr 11 19:51:19 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:51:19 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 19:51:19 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 19:51:19 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 19:51:19 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 19:51:19 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 647674d8-af53-405a-8116-4b7a01549bdf could not be found. Apr 11 19:51:19 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi Apr 11 19:51:19 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [None req-f7f4d5f7-33c9-4b8e-9bc9-b0ce4eb850d3 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Returning 404 to user: Instance 647674d8-af53-405a-8116-4b7a01549bdf could not be found. {{(pid=72088) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 19:51:19 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [None req-f7f4d5f7-33c9-4b8e-9bc9-b0ce4eb850d3 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/647674d8-af53-405a-8116-4b7a01549bdf" status: 404 len: 111 microversion: 2.1 time: 0.037259 Apr 11 19:51:19 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 347/1060] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 19:51:19 2023] DELETE /compute/v2.1/servers/647674d8-af53-405a-8116-4b7a01549bdf => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 19:51:19 user devstack@n-api.service[72090]: DEBUG dbcounter [-] [72090] Writing DB stats nova_cell0:SELECT=2 {{(pid=72090) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:51:19 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [None req-5d0e9d9b-7513-4b15-81d5-61cb6935b022 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Calling method '>' {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:51:19 user devstack@n-api.service[72090]: DEBUG nova.compute.api [None req-5d0e9d9b-7513-4b15-81d5-61cb6935b022 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] [instance: 647674d8-af53-405a-8116-4b7a01549bdf] Fetching instance by UUID {{(pid=72090) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:51:19 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-5d0e9d9b-7513-4b15-81d5-61cb6935b022 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:51:19 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-5d0e9d9b-7513-4b15-81d5-61cb6935b022 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:51:19 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-5d0e9d9b-7513-4b15-81d5-61cb6935b022 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:51:19 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-5d0e9d9b-7513-4b15-81d5-61cb6935b022 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:51:19 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-5d0e9d9b-7513-4b15-81d5-61cb6935b022 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:51:19 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-5d0e9d9b-7513-4b15-81d5-61cb6935b022 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:51:19 user devstack@n-api.service[72090]: INFO nova.api.openstack.wsgi [None req-5d0e9d9b-7513-4b15-81d5-61cb6935b022 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] HTTP exception thrown: Instance 647674d8-af53-405a-8116-4b7a01549bdf could not be found. Apr 11 19:51:19 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [None req-5d0e9d9b-7513-4b15-81d5-61cb6935b022 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Request method failure captured: Apr 11 19:51:19 user devstack@n-api.service[72090]: request: GET /compute/v2.1/servers/647674d8-af53-405a-8116-4b7a01549bdf HTTP/1.1 Apr 11 19:51:19 user devstack@n-api.service[72090]: Accept: application/json Apr 11 19:51:19 user devstack@n-api.service[72090]: Accept-Encoding: identity Apr 11 19:51:19 user devstack@n-api.service[72090]: Connection: close Apr 11 19:51:19 user devstack@n-api.service[72090]: Content-Length: 0 Apr 11 19:51:19 user devstack@n-api.service[72090]: Content-Type: application/json Apr 11 19:51:19 user devstack@n-api.service[72090]: Host: 10.0.0.210 Apr 11 19:51:19 user devstack@n-api.service[72090]: Openstack-System-Scope: None Apr 11 19:51:19 user devstack@n-api.service[72090]: User-Agent: python-urllib3/1.26.15 Apr 11 19:51:19 user devstack@n-api.service[72090]: X-Auth-Token: gAAAAABkNbR4bCdkWtJpeyTsYZLFONPnT_zinIH4x1SzpVTs_DUY92yHhUdZ1Be5ca42ne_MV0QfkvMTUzrjmQhXISCBCO99II9OZKv9BampoJ3QG4FhhPTvET8iKhYbJ7Ipqcffw1qgQYkqrkjqNHSIVG9eRSX49OVMWaaVKfSqTXnjihDuVyI Apr 11 19:51:19 user devstack@n-api.service[72090]: X-Domain-Id: None Apr 11 19:51:19 user devstack@n-api.service[72090]: X-Domain-Name: None Apr 11 19:51:19 user devstack@n-api.service[72090]: X-Identity-Status: Confirmed Apr 11 19:51:19 user devstack@n-api.service[72090]: X-Is-Admin-Project: True Apr 11 19:51:19 user devstack@n-api.service[72090]: X-Project-Domain-Id: default Apr 11 19:51:19 user devstack@n-api.service[72090]: X-Project-Domain-Name: Default Apr 11 19:51:19 user devstack@n-api.service[72090]: X-Project-Id: 60a7381a31b84e97a068528f90813773 Apr 11 19:51:19 user devstack@n-api.service[72090]: X-Project-Name: tempest-ServerActionsTestJSON-37730514 Apr 11 19:51:19 user devstack@n-api.service[72090]: X-Role: reader,member Apr 11 19:51:19 user devstack@n-api.service[72090]: X-Roles: reader,member Apr 11 19:51:19 user devstack@n-api.service[72090]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/60a7381a31b84e97a068528f90813773"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/60a7381a31b84e97a068528f90813773"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/60a7381a31b84e97a068528f90813773"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 11 19:51:19 user devstack@n-api.service[72090]: X-Tenant: tempest-ServerActionsTestJSON-37730514 Apr 11 19:51:19 user devstack@n-api.service[72090]: X-Tenant-Id: 60a7381a31b84e97a068528f90813773 Apr 11 19:51:19 user devstack@n-api.service[72090]: X-Tenant-Name: tempest-ServerActionsTestJSON-37730514 Apr 11 19:51:19 user devstack@n-api.service[72090]: X-User: tempest-ServerActionsTestJSON-37730514-project-member Apr 11 19:51:19 user devstack@n-api.service[72090]: X-User-Domain-Id: default Apr 11 19:51:19 user devstack@n-api.service[72090]: X-User-Domain-Name: Default Apr 11 19:51:19 user devstack@n-api.service[72090]: X-User-Id: 05fb551c320a48f98a4ec00a7f7492d7 Apr 11 19:51:19 user devstack@n-api.service[72090]: X-User-Name: tempest-ServerActionsTestJSON-37730514-project-member Apr 11 19:51:19 user devstack@n-api.service[72090]: method: > Apr 11 19:51:19 user devstack@n-api.service[72090]: exception: Instance 647674d8-af53-405a-8116-4b7a01549bdf could not be found. Apr 11 19:51:19 user devstack@n-api.service[72090]: action_args: {'id': '647674d8-af53-405a-8116-4b7a01549bdf'} Apr 11 19:51:19 user devstack@n-api.service[72090]: {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 19:51:19 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:51:19 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 19:51:19 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 19:51:19 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 19:51:19 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 19:51:19 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 19:51:19 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 19:51:19 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 19:51:19 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 19:51:19 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 647674d8-af53-405a-8116-4b7a01549bdf could not be found. Apr 11 19:51:19 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi Apr 11 19:51:19 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 19:51:19 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi Apr 11 19:51:19 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:51:19 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 19:51:19 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 19:51:19 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 19:51:19 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 19:51:19 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 19:51:19 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 19:51:19 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 19:51:19 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 19:51:19 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 19:51:19 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 19:51:19 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 19:51:19 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 19:51:19 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 647674d8-af53-405a-8116-4b7a01549bdf could not be found. Apr 11 19:51:19 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi Apr 11 19:51:19 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 19:51:19 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi Apr 11 19:51:19 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:51:19 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 19:51:19 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 19:51:19 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 19:51:19 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 19:51:19 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 647674d8-af53-405a-8116-4b7a01549bdf could not be found. Apr 11 19:51:19 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi Apr 11 19:51:19 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [None req-5d0e9d9b-7513-4b15-81d5-61cb6935b022 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Returning 404 to user: Instance 647674d8-af53-405a-8116-4b7a01549bdf could not be found. {{(pid=72090) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 19:51:19 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [None req-5d0e9d9b-7513-4b15-81d5-61cb6935b022 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] 10.0.0.210 "GET /compute/v2.1/servers/647674d8-af53-405a-8116-4b7a01549bdf" status: 404 len: 111 microversion: 2.1 time: 0.089880 Apr 11 19:51:19 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 353/1061] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 19:51:19 2023] GET /compute/v2.1/servers/647674d8-af53-405a-8116-4b7a01549bdf => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 11 19:51:19 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [None req-1e211808-b28d-46f1-bb3f-3ad1656ffe4f tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Calling method '.version_select at 0x7f119dbe95a0>' {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:51:19 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [None req-1e211808-b28d-46f1-bb3f-3ad1656ffe4f tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-185807874" status: 202 len: 0 microversion: 2.1 time: 0.025978 Apr 11 19:51:19 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 362/1062] 10.0.0.210 () {62 vars in 1295 bytes} [Tue Apr 11 19:51:19 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-185807874 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 19:51:25 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [None req-e3fa18d8-d16f-41f5-93e2-019071289388 tempest-VolumesSnapshotsTestJSON-424443340 tempest-VolumesSnapshotsTestJSON-424443340-project-member] Action: 'create', calling method: .version_select at 0x7f119db59bd0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-266186668"}} {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:51:25 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [None req-e3fa18d8-d16f-41f5-93e2-019071289388 tempest-VolumesSnapshotsTestJSON-424443340 tempest-VolumesSnapshotsTestJSON-424443340-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 0.464105 Apr 11 19:51:25 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 348/1063] 10.0.0.210 () {64 vars in 1232 bytes} [Tue Apr 11 19:51:25 2023] POST /compute/v2.1/os-volumes => generated 344 bytes in 465 msecs (HTTP/1.1 200) 10 headers in 447 bytes (1 switches on core 0) Apr 11 19:51:25 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [None req-1664e3c7-1601-42ff-9abf-cae661e2a99a tempest-VolumesSnapshotsTestJSON-424443340 tempest-VolumesSnapshotsTestJSON-424443340-project-member] Calling method '.version_select at 0x7f119dc0dea0>' {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:51:25 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [None req-1664e3c7-1601-42ff-9abf-cae661e2a99a tempest-VolumesSnapshotsTestJSON-424443340 tempest-VolumesSnapshotsTestJSON-424443340-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/4c0719fc-f838-4a12-9a2b-5bf0d21846ea" status: 200 len: 344 microversion: 2.1 time: 0.071048 Apr 11 19:51:25 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 354/1064] 10.0.0.210 () {62 vars in 1322 bytes} [Tue Apr 11 19:51:25 2023] GET /compute/v2.1/os-volumes/4c0719fc-f838-4a12-9a2b-5bf0d21846ea => generated 344 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:51:26 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [None req-988d1d5f-8e7d-4ad9-9fc0-95953c5e4cd0 tempest-VolumesSnapshotsTestJSON-424443340 tempest-VolumesSnapshotsTestJSON-424443340-project-member] Calling method '.version_select at 0x7f119ddc9510>' {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:51:26 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [None req-988d1d5f-8e7d-4ad9-9fc0-95953c5e4cd0 tempest-VolumesSnapshotsTestJSON-424443340 tempest-VolumesSnapshotsTestJSON-424443340-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/4c0719fc-f838-4a12-9a2b-5bf0d21846ea" status: 200 len: 345 microversion: 2.1 time: 0.061467 Apr 11 19:51:26 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 363/1065] 10.0.0.210 () {62 vars in 1322 bytes} [Tue Apr 11 19:51:26 2023] GET /compute/v2.1/os-volumes/4c0719fc-f838-4a12-9a2b-5bf0d21846ea => generated 345 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:51:26 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [None req-0aac836d-d98f-4145-bb47-811813ea9c92 tempest-VolumesSnapshotsTestJSON-424443340 tempest-VolumesSnapshotsTestJSON-424443340-project-member] Action: 'create', calling method: .version_select at 0x7f119db5a5f0>, body: {"snapshot": {"volume_id": "4c0719fc-f838-4a12-9a2b-5bf0d21846ea", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1463006032"}} {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:51:27 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [None req-0aac836d-d98f-4145-bb47-811813ea9c92 tempest-VolumesSnapshotsTestJSON-424443340 tempest-VolumesSnapshotsTestJSON-424443340-project-member] 10.0.0.210 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.150506 Apr 11 19:51:27 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 349/1066] 10.0.0.210 () {64 vars in 1239 bytes} [Tue Apr 11 19:51:26 2023] POST /compute/v2.1/os-snapshots => generated 287 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:51:27 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [None req-b9748e44-acae-4a8b-992f-65734985333e tempest-VolumesSnapshotsTestJSON-424443340 tempest-VolumesSnapshotsTestJSON-424443340-project-member] Calling method '.version_select at 0x7f119e083010>' {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:51:27 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [None req-b9748e44-acae-4a8b-992f-65734985333e tempest-VolumesSnapshotsTestJSON-424443340 tempest-VolumesSnapshotsTestJSON-424443340-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots/5903c272-ee96-4f9b-b31d-a0beaffa37e0" status: 200 len: 287 microversion: 2.1 time: 0.038320 Apr 11 19:51:27 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 355/1067] 10.0.0.210 () {62 vars in 1328 bytes} [Tue Apr 11 19:51:27 2023] GET /compute/v2.1/os-snapshots/5903c272-ee96-4f9b-b31d-a0beaffa37e0 => generated 287 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:51:27 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [None req-d90fc699-072b-4e5a-a470-f61442c29916 tempest-VolumesSnapshotsTestJSON-424443340 tempest-VolumesSnapshotsTestJSON-424443340-project-member] Calling method '.version_select at 0x7f119dff3a30>' {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:51:27 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [None req-d90fc699-072b-4e5a-a470-f61442c29916 tempest-VolumesSnapshotsTestJSON-424443340 tempest-VolumesSnapshotsTestJSON-424443340-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.041650 Apr 11 19:51:27 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 364/1068] 10.0.0.210 () {62 vars in 1217 bytes} [Tue Apr 11 19:51:27 2023] GET /compute/v2.1/os-snapshots => generated 290 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:51:27 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [None req-95fd0efc-4a2c-4e30-af19-673b73ddb200 tempest-VolumesSnapshotsTestJSON-424443340 tempest-VolumesSnapshotsTestJSON-424443340-project-member] Calling method '.version_select at 0x7f119deafb50>' {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:51:27 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [None req-95fd0efc-4a2c-4e30-af19-673b73ddb200 tempest-VolumesSnapshotsTestJSON-424443340 tempest-VolumesSnapshotsTestJSON-424443340-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots/5903c272-ee96-4f9b-b31d-a0beaffa37e0" status: 200 len: 287 microversion: 2.1 time: 0.036583 Apr 11 19:51:27 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 350/1069] 10.0.0.210 () {62 vars in 1328 bytes} [Tue Apr 11 19:51:27 2023] GET /compute/v2.1/os-snapshots/5903c272-ee96-4f9b-b31d-a0beaffa37e0 => generated 287 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:51:28 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [None req-cd382bd0-5fba-4ba6-b86f-ee1dbdcd870f tempest-VolumesSnapshotsTestJSON-424443340 tempest-VolumesSnapshotsTestJSON-424443340-project-member] Calling method '.version_select at 0x7f119d906050>' {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:51:28 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [None req-cd382bd0-5fba-4ba6-b86f-ee1dbdcd870f tempest-VolumesSnapshotsTestJSON-424443340 tempest-VolumesSnapshotsTestJSON-424443340-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots/5903c272-ee96-4f9b-b31d-a0beaffa37e0" status: 200 len: 288 microversion: 2.1 time: 0.032879 Apr 11 19:51:28 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 356/1070] 10.0.0.210 () {62 vars in 1328 bytes} [Tue Apr 11 19:51:28 2023] GET /compute/v2.1/os-snapshots/5903c272-ee96-4f9b-b31d-a0beaffa37e0 => generated 288 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:51:28 user devstack@n-api.service[72089]: DEBUG dbcounter [-] [72089] Writing DB stats nova_cell1:SELECT=4 {{(pid=72089) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:51:28 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [None req-6c9365b5-3a4f-427b-8088-bc69a68f9f9d tempest-VolumesSnapshotsTestJSON-424443340 tempest-VolumesSnapshotsTestJSON-424443340-project-member] Calling method '.version_select at 0x7f119dbe9360>' {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:51:28 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [None req-6c9365b5-3a4f-427b-8088-bc69a68f9f9d tempest-VolumesSnapshotsTestJSON-424443340 tempest-VolumesSnapshotsTestJSON-424443340-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-snapshots/5903c272-ee96-4f9b-b31d-a0beaffa37e0" status: 202 len: 0 microversion: 2.1 time: 0.065547 Apr 11 19:51:28 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 365/1071] 10.0.0.210 () {62 vars in 1331 bytes} [Tue Apr 11 19:51:28 2023] DELETE /compute/v2.1/os-snapshots/5903c272-ee96-4f9b-b31d-a0beaffa37e0 => generated 0 bytes in 67 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 19:51:28 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [None req-a45076dd-1ae7-4f74-a284-b9037de7c79e tempest-VolumesSnapshotsTestJSON-424443340 tempest-VolumesSnapshotsTestJSON-424443340-project-member] Calling method '.version_select at 0x7f119f4b9000>' {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:51:28 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [None req-a45076dd-1ae7-4f74-a284-b9037de7c79e tempest-VolumesSnapshotsTestJSON-424443340 tempest-VolumesSnapshotsTestJSON-424443340-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots/5903c272-ee96-4f9b-b31d-a0beaffa37e0" status: 200 len: 287 microversion: 2.1 time: 0.035945 Apr 11 19:51:28 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 351/1072] 10.0.0.210 () {62 vars in 1328 bytes} [Tue Apr 11 19:51:28 2023] GET /compute/v2.1/os-snapshots/5903c272-ee96-4f9b-b31d-a0beaffa37e0 => generated 287 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:51:29 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [None req-90779a9c-2ddd-4327-8172-f066365ee118 tempest-VolumesSnapshotsTestJSON-424443340 tempest-VolumesSnapshotsTestJSON-424443340-project-member] Calling method '.version_select at 0x7f119e081090>' {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:51:29 user devstack@n-api.service[72090]: INFO nova.api.openstack.wsgi [None req-90779a9c-2ddd-4327-8172-f066365ee118 tempest-VolumesSnapshotsTestJSON-424443340 tempest-VolumesSnapshotsTestJSON-424443340-project-member] HTTP exception thrown: Snapshot 5903c272-ee96-4f9b-b31d-a0beaffa37e0 could not be found. Apr 11 19:51:29 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [None req-90779a9c-2ddd-4327-8172-f066365ee118 tempest-VolumesSnapshotsTestJSON-424443340 tempest-VolumesSnapshotsTestJSON-424443340-project-member] Request method failure captured: Apr 11 19:51:29 user devstack@n-api.service[72090]: request: GET /compute/v2.1/os-snapshots/5903c272-ee96-4f9b-b31d-a0beaffa37e0 HTTP/1.1 Apr 11 19:51:29 user devstack@n-api.service[72090]: Accept: application/json Apr 11 19:51:29 user devstack@n-api.service[72090]: Accept-Encoding: identity Apr 11 19:51:29 user devstack@n-api.service[72090]: Connection: close Apr 11 19:51:29 user devstack@n-api.service[72090]: Content-Length: 0 Apr 11 19:51:29 user devstack@n-api.service[72090]: Content-Type: application/json Apr 11 19:51:29 user devstack@n-api.service[72090]: Host: 10.0.0.210 Apr 11 19:51:29 user devstack@n-api.service[72090]: Openstack-System-Scope: None Apr 11 19:51:29 user devstack@n-api.service[72090]: User-Agent: python-urllib3/1.26.15 Apr 11 19:51:29 user devstack@n-api.service[72090]: X-Auth-Token: gAAAAABkNbo9tq9VKjvtcVxnlpEFZUMkrcUgmmcWB-Mmton4wmZ7Csj-btKUHrefMxuSq5BBVs8Yw2j-CHTO0kzYky_t7pLrDNWjzg8uNU21T5leg33PFEWjfrlaG54Y7fbfOlFzlLMfLdOZyXTsDdlVmeJIGVV9Oz9l8ps_6K7HXyrpenYPoBE Apr 11 19:51:29 user devstack@n-api.service[72090]: X-Domain-Id: None Apr 11 19:51:29 user devstack@n-api.service[72090]: X-Domain-Name: None Apr 11 19:51:29 user devstack@n-api.service[72090]: X-Identity-Status: Confirmed Apr 11 19:51:29 user devstack@n-api.service[72090]: X-Is-Admin-Project: True Apr 11 19:51:29 user devstack@n-api.service[72090]: X-Project-Domain-Id: default Apr 11 19:51:29 user devstack@n-api.service[72090]: X-Project-Domain-Name: Default Apr 11 19:51:29 user devstack@n-api.service[72090]: X-Project-Id: 1093fa471d8440e5b7a2b15b02fdcf1b Apr 11 19:51:29 user devstack@n-api.service[72090]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-424443340 Apr 11 19:51:29 user devstack@n-api.service[72090]: X-Role: reader,member Apr 11 19:51:29 user devstack@n-api.service[72090]: X-Roles: reader,member Apr 11 19:51:29 user devstack@n-api.service[72090]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/1093fa471d8440e5b7a2b15b02fdcf1b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/1093fa471d8440e5b7a2b15b02fdcf1b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/1093fa471d8440e5b7a2b15b02fdcf1b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 11 19:51:29 user devstack@n-api.service[72090]: X-Tenant: tempest-VolumesSnapshotsTestJSON-424443340 Apr 11 19:51:29 user devstack@n-api.service[72090]: X-Tenant-Id: 1093fa471d8440e5b7a2b15b02fdcf1b Apr 11 19:51:29 user devstack@n-api.service[72090]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-424443340 Apr 11 19:51:29 user devstack@n-api.service[72090]: X-User: tempest-VolumesSnapshotsTestJSON-424443340-project-member Apr 11 19:51:29 user devstack@n-api.service[72090]: X-User-Domain-Id: default Apr 11 19:51:29 user devstack@n-api.service[72090]: X-User-Domain-Name: Default Apr 11 19:51:29 user devstack@n-api.service[72090]: X-User-Id: 86f028324429414dafccc0f3e1c867f2 Apr 11 19:51:29 user devstack@n-api.service[72090]: X-User-Name: tempest-VolumesSnapshotsTestJSON-424443340-project-member Apr 11 19:51:29 user devstack@n-api.service[72090]: method: Apr 11 19:51:29 user devstack@n-api.service[72090]: exception: Snapshot 5903c272-ee96-4f9b-b31d-a0beaffa37e0 could not be found. Apr 11 19:51:29 user devstack@n-api.service[72090]: action_args: {'id': '5903c272-ee96-4f9b-b31d-a0beaffa37e0'} Apr 11 19:51:29 user devstack@n-api.service[72090]: {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 19:51:29 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:51:29 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Apr 11 19:51:29 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Apr 11 19:51:29 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Apr 11 19:51:29 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Apr 11 19:51:29 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volume_snapshots.py", line 174, in get Apr 11 19:51:29 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Apr 11 19:51:29 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 11 19:51:29 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 11 19:51:29 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 11 19:51:29 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 11 19:51:29 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 11 19:51:29 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 11 19:51:29 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 11 19:51:29 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 11 19:51:29 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 5903c272-ee96-4f9b-b31d-a0beaffa37e0 could not be found. (HTTP 404) (Request-ID: req-0462bd8c-983e-4ebb-ac6c-6cf930aa5465) Apr 11 19:51:29 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi Apr 11 19:51:29 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 19:51:29 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi Apr 11 19:51:29 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:51:29 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Apr 11 19:51:29 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Apr 11 19:51:29 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 11 19:51:29 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 11 19:51:29 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Apr 11 19:51:29 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Apr 11 19:51:29 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 11 19:51:29 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 11 19:51:29 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Apr 11 19:51:29 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Apr 11 19:51:29 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Apr 11 19:51:29 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Apr 11 19:51:29 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volume_snapshots.py", line 174, in get Apr 11 19:51:29 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Apr 11 19:51:29 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 11 19:51:29 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 11 19:51:29 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 11 19:51:29 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 11 19:51:29 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 11 19:51:29 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 11 19:51:29 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 11 19:51:29 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 11 19:51:29 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 5903c272-ee96-4f9b-b31d-a0beaffa37e0 could not be found. Apr 11 19:51:29 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi Apr 11 19:51:29 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 19:51:29 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi Apr 11 19:51:29 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:51:29 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 19:51:29 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 19:51:29 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 19:51:29 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 19:51:29 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 11 19:51:29 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 11 19:51:29 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 19:51:29 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 19:51:29 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Apr 11 19:51:29 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 19:51:29 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 5903c272-ee96-4f9b-b31d-a0beaffa37e0 could not be found. Apr 11 19:51:29 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi Apr 11 19:51:29 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 19:51:29 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi Apr 11 19:51:29 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:51:29 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 19:51:29 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 19:51:29 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 19:51:29 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 19:51:29 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 5903c272-ee96-4f9b-b31d-a0beaffa37e0 could not be found. Apr 11 19:51:29 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi Apr 11 19:51:29 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [None req-90779a9c-2ddd-4327-8172-f066365ee118 tempest-VolumesSnapshotsTestJSON-424443340 tempest-VolumesSnapshotsTestJSON-424443340-project-member] Returning 404 to user: Snapshot 5903c272-ee96-4f9b-b31d-a0beaffa37e0 could not be found. {{(pid=72090) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 19:51:29 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [None req-90779a9c-2ddd-4327-8172-f066365ee118 tempest-VolumesSnapshotsTestJSON-424443340 tempest-VolumesSnapshotsTestJSON-424443340-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots/5903c272-ee96-4f9b-b31d-a0beaffa37e0" status: 404 len: 111 microversion: 2.1 time: 0.053841 Apr 11 19:51:29 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 357/1073] 10.0.0.210 () {62 vars in 1328 bytes} [Tue Apr 11 19:51:29 2023] GET /compute/v2.1/os-snapshots/5903c272-ee96-4f9b-b31d-a0beaffa37e0 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 19:51:29 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [None req-0eb439c8-045f-45fa-a682-0ac9cabd95bc tempest-VolumesSnapshotsTestJSON-424443340 tempest-VolumesSnapshotsTestJSON-424443340-project-member] Calling method '.version_select at 0x7f119dff05e0>' {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:51:29 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [None req-0eb439c8-045f-45fa-a682-0ac9cabd95bc tempest-VolumesSnapshotsTestJSON-424443340 tempest-VolumesSnapshotsTestJSON-424443340-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/4c0719fc-f838-4a12-9a2b-5bf0d21846ea" status: 202 len: 0 microversion: 2.1 time: 0.063209 Apr 11 19:51:29 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 366/1074] 10.0.0.210 () {62 vars in 1325 bytes} [Tue Apr 11 19:51:29 2023] DELETE /compute/v2.1/os-volumes/4c0719fc-f838-4a12-9a2b-5bf0d21846ea => generated 0 bytes in 65 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 19:51:29 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [None req-1b4fe4a8-3670-4ad0-a622-b36a99bc71ff tempest-VolumesSnapshotsTestJSON-424443340 tempest-VolumesSnapshotsTestJSON-424443340-project-member] Calling method '.version_select at 0x7f119deac3a0>' {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:51:29 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [None req-1b4fe4a8-3670-4ad0-a622-b36a99bc71ff tempest-VolumesSnapshotsTestJSON-424443340 tempest-VolumesSnapshotsTestJSON-424443340-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/4c0719fc-f838-4a12-9a2b-5bf0d21846ea" status: 200 len: 344 microversion: 2.1 time: 0.050133 Apr 11 19:51:29 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 352/1075] 10.0.0.210 () {62 vars in 1322 bytes} [Tue Apr 11 19:51:29 2023] GET /compute/v2.1/os-volumes/4c0719fc-f838-4a12-9a2b-5bf0d21846ea => generated 344 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:51:30 user devstack@n-api.service[72090]: DEBUG dbcounter [-] [72090] Writing DB stats nova_api:SELECT=8 {{(pid=72090) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:51:30 user devstack@n-api.service[72090]: DEBUG dbcounter [-] [72090] Writing DB stats nova_cell1:SELECT=4 {{(pid=72090) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:51:30 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [None req-9ad22e42-7795-4b39-810e-6c1bb0a38de6 tempest-VolumesSnapshotsTestJSON-424443340 tempest-VolumesSnapshotsTestJSON-424443340-project-member] Calling method '.version_select at 0x7f119d9885e0>' {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:51:30 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [None req-9ad22e42-7795-4b39-810e-6c1bb0a38de6 tempest-VolumesSnapshotsTestJSON-424443340 tempest-VolumesSnapshotsTestJSON-424443340-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/4c0719fc-f838-4a12-9a2b-5bf0d21846ea" status: 200 len: 344 microversion: 2.1 time: 0.057201 Apr 11 19:51:30 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 358/1076] 10.0.0.210 () {62 vars in 1322 bytes} [Tue Apr 11 19:51:30 2023] GET /compute/v2.1/os-volumes/4c0719fc-f838-4a12-9a2b-5bf0d21846ea => generated 344 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:51:31 user devstack@n-api.service[72089]: DEBUG dbcounter [-] [72089] Writing DB stats nova_api:SELECT=18,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=72089) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:51:31 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [None req-18de1072-8665-44be-8241-a7efe71982cf tempest-VolumesSnapshotsTestJSON-424443340 tempest-VolumesSnapshotsTestJSON-424443340-project-member] Calling method '.version_select at 0x7f119ddc9870>' {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:51:31 user devstack@n-api.service[72089]: INFO nova.api.openstack.wsgi [None req-18de1072-8665-44be-8241-a7efe71982cf tempest-VolumesSnapshotsTestJSON-424443340 tempest-VolumesSnapshotsTestJSON-424443340-project-member] HTTP exception thrown: Volume 4c0719fc-f838-4a12-9a2b-5bf0d21846ea could not be found. Apr 11 19:51:31 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [None req-18de1072-8665-44be-8241-a7efe71982cf tempest-VolumesSnapshotsTestJSON-424443340 tempest-VolumesSnapshotsTestJSON-424443340-project-member] Request method failure captured: Apr 11 19:51:31 user devstack@n-api.service[72089]: request: GET /compute/v2.1/os-volumes/4c0719fc-f838-4a12-9a2b-5bf0d21846ea HTTP/1.1 Apr 11 19:51:31 user devstack@n-api.service[72089]: Accept: application/json Apr 11 19:51:31 user devstack@n-api.service[72089]: Accept-Encoding: identity Apr 11 19:51:31 user devstack@n-api.service[72089]: Connection: close Apr 11 19:51:31 user devstack@n-api.service[72089]: Content-Length: 0 Apr 11 19:51:31 user devstack@n-api.service[72089]: Content-Type: application/json Apr 11 19:51:31 user devstack@n-api.service[72089]: Host: 10.0.0.210 Apr 11 19:51:31 user devstack@n-api.service[72089]: Openstack-System-Scope: None Apr 11 19:51:31 user devstack@n-api.service[72089]: User-Agent: python-urllib3/1.26.15 Apr 11 19:51:31 user devstack@n-api.service[72089]: X-Auth-Token: gAAAAABkNbo9tq9VKjvtcVxnlpEFZUMkrcUgmmcWB-Mmton4wmZ7Csj-btKUHrefMxuSq5BBVs8Yw2j-CHTO0kzYky_t7pLrDNWjzg8uNU21T5leg33PFEWjfrlaG54Y7fbfOlFzlLMfLdOZyXTsDdlVmeJIGVV9Oz9l8ps_6K7HXyrpenYPoBE Apr 11 19:51:31 user devstack@n-api.service[72089]: X-Domain-Id: None Apr 11 19:51:31 user devstack@n-api.service[72089]: X-Domain-Name: None Apr 11 19:51:31 user devstack@n-api.service[72089]: X-Identity-Status: Confirmed Apr 11 19:51:31 user devstack@n-api.service[72089]: X-Is-Admin-Project: True Apr 11 19:51:31 user devstack@n-api.service[72089]: X-Project-Domain-Id: default Apr 11 19:51:31 user devstack@n-api.service[72089]: X-Project-Domain-Name: Default Apr 11 19:51:31 user devstack@n-api.service[72089]: X-Project-Id: 1093fa471d8440e5b7a2b15b02fdcf1b Apr 11 19:51:31 user devstack@n-api.service[72089]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-424443340 Apr 11 19:51:31 user devstack@n-api.service[72089]: X-Role: reader,member Apr 11 19:51:31 user devstack@n-api.service[72089]: X-Roles: reader,member Apr 11 19:51:31 user devstack@n-api.service[72089]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/1093fa471d8440e5b7a2b15b02fdcf1b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/1093fa471d8440e5b7a2b15b02fdcf1b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/1093fa471d8440e5b7a2b15b02fdcf1b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 11 19:51:31 user devstack@n-api.service[72089]: X-Tenant: tempest-VolumesSnapshotsTestJSON-424443340 Apr 11 19:51:31 user devstack@n-api.service[72089]: X-Tenant-Id: 1093fa471d8440e5b7a2b15b02fdcf1b Apr 11 19:51:31 user devstack@n-api.service[72089]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-424443340 Apr 11 19:51:31 user devstack@n-api.service[72089]: X-User: tempest-VolumesSnapshotsTestJSON-424443340-project-member Apr 11 19:51:31 user devstack@n-api.service[72089]: X-User-Domain-Id: default Apr 11 19:51:31 user devstack@n-api.service[72089]: X-User-Domain-Name: Default Apr 11 19:51:31 user devstack@n-api.service[72089]: X-User-Id: 86f028324429414dafccc0f3e1c867f2 Apr 11 19:51:31 user devstack@n-api.service[72089]: X-User-Name: tempest-VolumesSnapshotsTestJSON-424443340-project-member Apr 11 19:51:31 user devstack@n-api.service[72089]: method: Apr 11 19:51:31 user devstack@n-api.service[72089]: exception: Volume 4c0719fc-f838-4a12-9a2b-5bf0d21846ea could not be found. Apr 11 19:51:31 user devstack@n-api.service[72089]: action_args: {'id': '4c0719fc-f838-4a12-9a2b-5bf0d21846ea'} Apr 11 19:51:31 user devstack@n-api.service[72089]: {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 19:51:31 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:51:31 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 11 19:51:31 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 11 19:51:31 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 11 19:51:31 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 11 19:51:31 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 11 19:51:31 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 11 19:51:31 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 11 19:51:31 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 11 19:51:31 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 11 19:51:31 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 11 19:51:31 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 11 19:51:31 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 11 19:51:31 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 11 19:51:31 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 11 19:51:31 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 4c0719fc-f838-4a12-9a2b-5bf0d21846ea could not be found. (HTTP 404) (Request-ID: req-2ddb37ab-3229-4d51-a7cb-7fe409a077c0) Apr 11 19:51:31 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi Apr 11 19:51:31 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 19:51:31 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi Apr 11 19:51:31 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:51:31 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Apr 11 19:51:31 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Apr 11 19:51:31 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 11 19:51:31 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 11 19:51:31 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 11 19:51:31 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 11 19:51:31 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 11 19:51:31 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 11 19:51:31 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 11 19:51:31 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 11 19:51:31 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 11 19:51:31 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 11 19:51:31 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 11 19:51:31 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 11 19:51:31 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 11 19:51:31 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 11 19:51:31 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 11 19:51:31 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 11 19:51:31 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 11 19:51:31 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 11 19:51:31 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 11 19:51:31 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 11 19:51:31 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 4c0719fc-f838-4a12-9a2b-5bf0d21846ea could not be found. Apr 11 19:51:31 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi Apr 11 19:51:31 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 19:51:31 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi Apr 11 19:51:31 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:51:31 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 19:51:31 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 19:51:31 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 19:51:31 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 19:51:31 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 11 19:51:31 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 11 19:51:31 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 19:51:31 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 19:51:31 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Apr 11 19:51:31 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 19:51:31 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 4c0719fc-f838-4a12-9a2b-5bf0d21846ea could not be found. Apr 11 19:51:31 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi Apr 11 19:51:31 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 19:51:31 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi Apr 11 19:51:31 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:51:31 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 19:51:31 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 19:51:31 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 19:51:31 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 19:51:31 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 4c0719fc-f838-4a12-9a2b-5bf0d21846ea could not be found. Apr 11 19:51:31 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi Apr 11 19:51:31 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [None req-18de1072-8665-44be-8241-a7efe71982cf tempest-VolumesSnapshotsTestJSON-424443340 tempest-VolumesSnapshotsTestJSON-424443340-project-member] Returning 404 to user: Volume 4c0719fc-f838-4a12-9a2b-5bf0d21846ea could not be found. {{(pid=72089) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 19:51:31 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [None req-18de1072-8665-44be-8241-a7efe71982cf tempest-VolumesSnapshotsTestJSON-424443340 tempest-VolumesSnapshotsTestJSON-424443340-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/4c0719fc-f838-4a12-9a2b-5bf0d21846ea" status: 404 len: 109 microversion: 2.1 time: 0.039732 Apr 11 19:51:31 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 367/1077] 10.0.0.210 () {62 vars in 1322 bytes} [Tue Apr 11 19:51:31 2023] GET /compute/v2.1/os-volumes/4c0719fc-f838-4a12-9a2b-5bf0d21846ea => generated 109 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 19:51:31 user devstack@n-api.service[72088]: DEBUG dbcounter [-] [72088] Writing DB stats nova_api:SELECT=19,nova_api:INSERT=3 {{(pid=72088) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:51:31 user devstack@n-api.service[72088]: DEBUG dbcounter [-] [72088] Writing DB stats nova_cell1:SELECT=6 {{(pid=72088) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:51:31 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [None req-34fc928c-a586-429d-afe4-b7d6a4855838 tempest-VolumesSnapshotsTestJSON-424443340 tempest-VolumesSnapshotsTestJSON-424443340-project-member] Calling method '.version_select at 0x7f119db079a0>' {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:51:31 user devstack@n-api.service[72088]: INFO nova.api.openstack.wsgi [None req-34fc928c-a586-429d-afe4-b7d6a4855838 tempest-VolumesSnapshotsTestJSON-424443340 tempest-VolumesSnapshotsTestJSON-424443340-project-member] HTTP exception thrown: Volume 4c0719fc-f838-4a12-9a2b-5bf0d21846ea could not be found. Apr 11 19:51:31 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [None req-34fc928c-a586-429d-afe4-b7d6a4855838 tempest-VolumesSnapshotsTestJSON-424443340 tempest-VolumesSnapshotsTestJSON-424443340-project-member] Request method failure captured: Apr 11 19:51:31 user devstack@n-api.service[72088]: request: DELETE /compute/v2.1/os-volumes/4c0719fc-f838-4a12-9a2b-5bf0d21846ea HTTP/1.1 Apr 11 19:51:31 user devstack@n-api.service[72088]: Accept: application/json Apr 11 19:51:31 user devstack@n-api.service[72088]: Accept-Encoding: identity Apr 11 19:51:31 user devstack@n-api.service[72088]: Connection: close Apr 11 19:51:31 user devstack@n-api.service[72088]: Content-Length: 0 Apr 11 19:51:31 user devstack@n-api.service[72088]: Content-Type: application/json Apr 11 19:51:31 user devstack@n-api.service[72088]: Host: 10.0.0.210 Apr 11 19:51:31 user devstack@n-api.service[72088]: Openstack-System-Scope: None Apr 11 19:51:31 user devstack@n-api.service[72088]: User-Agent: python-urllib3/1.26.15 Apr 11 19:51:31 user devstack@n-api.service[72088]: X-Auth-Token: gAAAAABkNbo9tq9VKjvtcVxnlpEFZUMkrcUgmmcWB-Mmton4wmZ7Csj-btKUHrefMxuSq5BBVs8Yw2j-CHTO0kzYky_t7pLrDNWjzg8uNU21T5leg33PFEWjfrlaG54Y7fbfOlFzlLMfLdOZyXTsDdlVmeJIGVV9Oz9l8ps_6K7HXyrpenYPoBE Apr 11 19:51:31 user devstack@n-api.service[72088]: X-Domain-Id: None Apr 11 19:51:31 user devstack@n-api.service[72088]: X-Domain-Name: None Apr 11 19:51:31 user devstack@n-api.service[72088]: X-Identity-Status: Confirmed Apr 11 19:51:31 user devstack@n-api.service[72088]: X-Is-Admin-Project: True Apr 11 19:51:31 user devstack@n-api.service[72088]: X-Project-Domain-Id: default Apr 11 19:51:31 user devstack@n-api.service[72088]: X-Project-Domain-Name: Default Apr 11 19:51:31 user devstack@n-api.service[72088]: X-Project-Id: 1093fa471d8440e5b7a2b15b02fdcf1b Apr 11 19:51:31 user devstack@n-api.service[72088]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-424443340 Apr 11 19:51:31 user devstack@n-api.service[72088]: X-Role: reader,member Apr 11 19:51:31 user devstack@n-api.service[72088]: X-Roles: reader,member Apr 11 19:51:31 user devstack@n-api.service[72088]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/1093fa471d8440e5b7a2b15b02fdcf1b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/1093fa471d8440e5b7a2b15b02fdcf1b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/1093fa471d8440e5b7a2b15b02fdcf1b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 11 19:51:31 user devstack@n-api.service[72088]: X-Tenant: tempest-VolumesSnapshotsTestJSON-424443340 Apr 11 19:51:31 user devstack@n-api.service[72088]: X-Tenant-Id: 1093fa471d8440e5b7a2b15b02fdcf1b Apr 11 19:51:31 user devstack@n-api.service[72088]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-424443340 Apr 11 19:51:31 user devstack@n-api.service[72088]: X-User: tempest-VolumesSnapshotsTestJSON-424443340-project-member Apr 11 19:51:31 user devstack@n-api.service[72088]: X-User-Domain-Id: default Apr 11 19:51:31 user devstack@n-api.service[72088]: X-User-Domain-Name: Default Apr 11 19:51:31 user devstack@n-api.service[72088]: X-User-Id: 86f028324429414dafccc0f3e1c867f2 Apr 11 19:51:31 user devstack@n-api.service[72088]: X-User-Name: tempest-VolumesSnapshotsTestJSON-424443340-project-member Apr 11 19:51:31 user devstack@n-api.service[72088]: method: Apr 11 19:51:31 user devstack@n-api.service[72088]: exception: Volume 4c0719fc-f838-4a12-9a2b-5bf0d21846ea could not be found. Apr 11 19:51:31 user devstack@n-api.service[72088]: action_args: {'id': '4c0719fc-f838-4a12-9a2b-5bf0d21846ea'} Apr 11 19:51:31 user devstack@n-api.service[72088]: {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 19:51:31 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:51:31 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 11 19:51:31 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 11 19:51:31 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Apr 11 19:51:31 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Apr 11 19:51:31 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Apr 11 19:51:31 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi return self._delete(loc) Apr 11 19:51:31 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 313, in _delete Apr 11 19:51:31 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Apr 11 19:51:31 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 229, in delete Apr 11 19:51:31 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Apr 11 19:51:31 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 11 19:51:31 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 11 19:51:31 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 11 19:51:31 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 11 19:51:31 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 4c0719fc-f838-4a12-9a2b-5bf0d21846ea could not be found. (HTTP 404) (Request-ID: req-273309e4-9831-47f0-a4cb-b42bfa76f742) Apr 11 19:51:31 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi Apr 11 19:51:31 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 19:51:31 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi Apr 11 19:51:31 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:51:31 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Apr 11 19:51:31 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Apr 11 19:51:31 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 11 19:51:31 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 11 19:51:31 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 11 19:51:31 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 11 19:51:31 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 11 19:51:31 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 11 19:51:31 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 11 19:51:31 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 11 19:51:31 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Apr 11 19:51:31 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Apr 11 19:51:31 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Apr 11 19:51:31 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi return self._delete(loc) Apr 11 19:51:31 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 313, in _delete Apr 11 19:51:31 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Apr 11 19:51:31 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 229, in delete Apr 11 19:51:31 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Apr 11 19:51:31 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 11 19:51:31 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 11 19:51:31 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 11 19:51:31 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 11 19:51:31 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 4c0719fc-f838-4a12-9a2b-5bf0d21846ea could not be found. Apr 11 19:51:31 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi Apr 11 19:51:31 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 19:51:31 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi Apr 11 19:51:31 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:51:31 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 19:51:31 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 19:51:31 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 19:51:31 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 19:51:31 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 11 19:51:31 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 11 19:51:31 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 19:51:31 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 19:51:31 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Apr 11 19:51:31 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 19:51:31 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 4c0719fc-f838-4a12-9a2b-5bf0d21846ea could not be found. Apr 11 19:51:31 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi Apr 11 19:51:31 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 19:51:31 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi Apr 11 19:51:31 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:51:31 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 19:51:31 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 19:51:31 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 19:51:31 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 19:51:31 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 4c0719fc-f838-4a12-9a2b-5bf0d21846ea could not be found. Apr 11 19:51:31 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi Apr 11 19:51:31 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [None req-34fc928c-a586-429d-afe4-b7d6a4855838 tempest-VolumesSnapshotsTestJSON-424443340 tempest-VolumesSnapshotsTestJSON-424443340-project-member] Returning 404 to user: Volume 4c0719fc-f838-4a12-9a2b-5bf0d21846ea could not be found. {{(pid=72088) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 19:51:31 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [None req-34fc928c-a586-429d-afe4-b7d6a4855838 tempest-VolumesSnapshotsTestJSON-424443340 tempest-VolumesSnapshotsTestJSON-424443340-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/4c0719fc-f838-4a12-9a2b-5bf0d21846ea" status: 404 len: 109 microversion: 2.1 time: 0.042960 Apr 11 19:51:31 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 353/1078] 10.0.0.210 () {62 vars in 1325 bytes} [Tue Apr 11 19:51:31 2023] DELETE /compute/v2.1/os-volumes/4c0719fc-f838-4a12-9a2b-5bf0d21846ea => generated 109 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 19:51:31 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [None req-107fa36c-bde4-4ab4-af91-38a5e2d1f6e3 tempest-VolumesSnapshotsTestJSON-424443340 tempest-VolumesSnapshotsTestJSON-424443340-project-member] Calling method '.version_select at 0x7f119d98b250>' {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:51:31 user devstack@n-api.service[72090]: INFO nova.api.openstack.wsgi [None req-107fa36c-bde4-4ab4-af91-38a5e2d1f6e3 tempest-VolumesSnapshotsTestJSON-424443340 tempest-VolumesSnapshotsTestJSON-424443340-project-member] HTTP exception thrown: Volume 4c0719fc-f838-4a12-9a2b-5bf0d21846ea could not be found. Apr 11 19:51:31 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [None req-107fa36c-bde4-4ab4-af91-38a5e2d1f6e3 tempest-VolumesSnapshotsTestJSON-424443340 tempest-VolumesSnapshotsTestJSON-424443340-project-member] Request method failure captured: Apr 11 19:51:31 user devstack@n-api.service[72090]: request: GET /compute/v2.1/os-volumes/4c0719fc-f838-4a12-9a2b-5bf0d21846ea HTTP/1.1 Apr 11 19:51:31 user devstack@n-api.service[72090]: Accept: application/json Apr 11 19:51:31 user devstack@n-api.service[72090]: Accept-Encoding: identity Apr 11 19:51:31 user devstack@n-api.service[72090]: Connection: close Apr 11 19:51:31 user devstack@n-api.service[72090]: Content-Length: 0 Apr 11 19:51:31 user devstack@n-api.service[72090]: Content-Type: application/json Apr 11 19:51:31 user devstack@n-api.service[72090]: Host: 10.0.0.210 Apr 11 19:51:31 user devstack@n-api.service[72090]: Openstack-System-Scope: None Apr 11 19:51:31 user devstack@n-api.service[72090]: User-Agent: python-urllib3/1.26.15 Apr 11 19:51:31 user devstack@n-api.service[72090]: X-Auth-Token: gAAAAABkNbo9tq9VKjvtcVxnlpEFZUMkrcUgmmcWB-Mmton4wmZ7Csj-btKUHrefMxuSq5BBVs8Yw2j-CHTO0kzYky_t7pLrDNWjzg8uNU21T5leg33PFEWjfrlaG54Y7fbfOlFzlLMfLdOZyXTsDdlVmeJIGVV9Oz9l8ps_6K7HXyrpenYPoBE Apr 11 19:51:31 user devstack@n-api.service[72090]: X-Domain-Id: None Apr 11 19:51:31 user devstack@n-api.service[72090]: X-Domain-Name: None Apr 11 19:51:31 user devstack@n-api.service[72090]: X-Identity-Status: Confirmed Apr 11 19:51:31 user devstack@n-api.service[72090]: X-Is-Admin-Project: True Apr 11 19:51:31 user devstack@n-api.service[72090]: X-Project-Domain-Id: default Apr 11 19:51:31 user devstack@n-api.service[72090]: X-Project-Domain-Name: Default Apr 11 19:51:31 user devstack@n-api.service[72090]: X-Project-Id: 1093fa471d8440e5b7a2b15b02fdcf1b Apr 11 19:51:31 user devstack@n-api.service[72090]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-424443340 Apr 11 19:51:31 user devstack@n-api.service[72090]: X-Role: reader,member Apr 11 19:51:31 user devstack@n-api.service[72090]: X-Roles: reader,member Apr 11 19:51:31 user devstack@n-api.service[72090]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/1093fa471d8440e5b7a2b15b02fdcf1b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/1093fa471d8440e5b7a2b15b02fdcf1b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/1093fa471d8440e5b7a2b15b02fdcf1b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 11 19:51:31 user devstack@n-api.service[72090]: X-Tenant: tempest-VolumesSnapshotsTestJSON-424443340 Apr 11 19:51:31 user devstack@n-api.service[72090]: X-Tenant-Id: 1093fa471d8440e5b7a2b15b02fdcf1b Apr 11 19:51:31 user devstack@n-api.service[72090]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-424443340 Apr 11 19:51:31 user devstack@n-api.service[72090]: X-User: tempest-VolumesSnapshotsTestJSON-424443340-project-member Apr 11 19:51:31 user devstack@n-api.service[72090]: X-User-Domain-Id: default Apr 11 19:51:31 user devstack@n-api.service[72090]: X-User-Domain-Name: Default Apr 11 19:51:31 user devstack@n-api.service[72090]: X-User-Id: 86f028324429414dafccc0f3e1c867f2 Apr 11 19:51:31 user devstack@n-api.service[72090]: X-User-Name: tempest-VolumesSnapshotsTestJSON-424443340-project-member Apr 11 19:51:31 user devstack@n-api.service[72090]: method: Apr 11 19:51:31 user devstack@n-api.service[72090]: exception: Volume 4c0719fc-f838-4a12-9a2b-5bf0d21846ea could not be found. Apr 11 19:51:31 user devstack@n-api.service[72090]: action_args: {'id': '4c0719fc-f838-4a12-9a2b-5bf0d21846ea'} Apr 11 19:51:31 user devstack@n-api.service[72090]: {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 19:51:31 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:51:31 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 11 19:51:31 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 11 19:51:31 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 11 19:51:31 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 11 19:51:31 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 11 19:51:31 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 11 19:51:31 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 11 19:51:31 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 11 19:51:31 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 11 19:51:31 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 11 19:51:31 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 11 19:51:31 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 11 19:51:31 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 11 19:51:31 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 11 19:51:31 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 4c0719fc-f838-4a12-9a2b-5bf0d21846ea could not be found. (HTTP 404) (Request-ID: req-20ce4c7c-0f15-401a-a997-42ab7e28120a) Apr 11 19:51:31 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi Apr 11 19:51:31 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 19:51:31 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi Apr 11 19:51:31 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:51:31 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Apr 11 19:51:31 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Apr 11 19:51:31 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 11 19:51:31 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 11 19:51:31 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 11 19:51:31 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 11 19:51:31 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 11 19:51:31 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 11 19:51:31 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 11 19:51:31 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 11 19:51:31 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 11 19:51:31 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 11 19:51:31 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 11 19:51:31 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 11 19:51:31 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 11 19:51:31 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 11 19:51:31 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 11 19:51:31 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 11 19:51:31 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 11 19:51:31 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 11 19:51:31 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 11 19:51:31 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 11 19:51:31 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 4c0719fc-f838-4a12-9a2b-5bf0d21846ea could not be found. Apr 11 19:51:31 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi Apr 11 19:51:31 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 19:51:31 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi Apr 11 19:51:31 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:51:31 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 19:51:31 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 19:51:31 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 19:51:31 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 19:51:31 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 11 19:51:31 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 11 19:51:31 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 19:51:31 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 19:51:31 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Apr 11 19:51:31 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 19:51:31 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 4c0719fc-f838-4a12-9a2b-5bf0d21846ea could not be found. Apr 11 19:51:31 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi Apr 11 19:51:31 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 19:51:31 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi Apr 11 19:51:31 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:51:31 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 19:51:31 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 19:51:31 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 19:51:31 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 19:51:31 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 4c0719fc-f838-4a12-9a2b-5bf0d21846ea could not be found. Apr 11 19:51:31 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi Apr 11 19:51:31 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [None req-107fa36c-bde4-4ab4-af91-38a5e2d1f6e3 tempest-VolumesSnapshotsTestJSON-424443340 tempest-VolumesSnapshotsTestJSON-424443340-project-member] Returning 404 to user: Volume 4c0719fc-f838-4a12-9a2b-5bf0d21846ea could not be found. {{(pid=72090) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 19:51:31 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [None req-107fa36c-bde4-4ab4-af91-38a5e2d1f6e3 tempest-VolumesSnapshotsTestJSON-424443340 tempest-VolumesSnapshotsTestJSON-424443340-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/4c0719fc-f838-4a12-9a2b-5bf0d21846ea" status: 404 len: 109 microversion: 2.1 time: 0.041009 Apr 11 19:51:31 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 359/1079] 10.0.0.210 () {62 vars in 1322 bytes} [Tue Apr 11 19:51:31 2023] GET /compute/v2.1/os-volumes/4c0719fc-f838-4a12-9a2b-5bf0d21846ea => generated 109 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 19:51:57 user devstack@n-api.service[72089]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 11 19:51:57 user devstack@n-api.service[72089]: Tue Apr 11 19:51:57 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/52298792-b22d-4c8e-ba29-babc5653e2cc (ip 10.0.0.210) !!! Apr 11 19:51:57 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [None req-3eacecf4-866d-421c-8b09-b421046339ab tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Calling method '>' {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:51:57 user devstack@n-api.service[72089]: DEBUG nova.compute.api [None req-3eacecf4-866d-421c-8b09-b421046339ab tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] [instance: 52298792-b22d-4c8e-ba29-babc5653e2cc] Fetching instance by UUID {{(pid=72089) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:51:57 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-3eacecf4-866d-421c-8b09-b421046339ab tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:51:57 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-3eacecf4-866d-421c-8b09-b421046339ab tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:51:57 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-3eacecf4-866d-421c-8b09-b421046339ab tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:51:57 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-3eacecf4-866d-421c-8b09-b421046339ab tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:51:57 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-3eacecf4-866d-421c-8b09-b421046339ab tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:51:57 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-3eacecf4-866d-421c-8b09-b421046339ab tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:51:58 user devstack@n-api.service[72089]: DEBUG nova.policy [None req-3eacecf4-866d-421c-8b09-b421046339ab tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fbfa8948ce64dff92344749d2f0f0c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5919e23c6a4c54b3a05a422c232c9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72089) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:51:58 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [None req-3eacecf4-866d-421c-8b09-b421046339ab tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] 10.0.0.210 "GET /compute/v2.1/servers/52298792-b22d-4c8e-ba29-babc5653e2cc" status: 200 len: 1538 microversion: 2.1 time: 0.192759 Apr 11 19:51:58 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 368/1080] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 19:51:57 2023] GET /compute/v2.1/servers/52298792-b22d-4c8e-ba29-babc5653e2cc => generated 1538 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:52:58 user devstack@n-api.service[72088]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 11 19:52:58 user devstack@n-api.service[72088]: Tue Apr 11 19:52:58 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/52298792-b22d-4c8e-ba29-babc5653e2cc (ip 10.0.0.210) !!! Apr 11 19:52:58 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [None req-03250971-8fdf-4e4d-8d91-f5cdb2bb2c0b tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Calling method '>' {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:52:58 user devstack@n-api.service[72088]: DEBUG nova.compute.api [None req-03250971-8fdf-4e4d-8d91-f5cdb2bb2c0b tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] [instance: 52298792-b22d-4c8e-ba29-babc5653e2cc] Fetching instance by UUID {{(pid=72088) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:52:58 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-03250971-8fdf-4e4d-8d91-f5cdb2bb2c0b tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:52:58 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-03250971-8fdf-4e4d-8d91-f5cdb2bb2c0b tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:52:58 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-03250971-8fdf-4e4d-8d91-f5cdb2bb2c0b tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:52:58 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-03250971-8fdf-4e4d-8d91-f5cdb2bb2c0b tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:52:58 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-03250971-8fdf-4e4d-8d91-f5cdb2bb2c0b tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:52:58 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-03250971-8fdf-4e4d-8d91-f5cdb2bb2c0b tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:52:58 user devstack@n-api.service[72088]: DEBUG nova.policy [None req-03250971-8fdf-4e4d-8d91-f5cdb2bb2c0b tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fbfa8948ce64dff92344749d2f0f0c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5919e23c6a4c54b3a05a422c232c9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72088) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:52:58 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [None req-03250971-8fdf-4e4d-8d91-f5cdb2bb2c0b tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] 10.0.0.210 "GET /compute/v2.1/servers/52298792-b22d-4c8e-ba29-babc5653e2cc" status: 200 len: 1538 microversion: 2.1 time: 0.339527 Apr 11 19:52:58 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 354/1081] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 19:52:58 2023] GET /compute/v2.1/servers/52298792-b22d-4c8e-ba29-babc5653e2cc => generated 1538 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:52:58 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [None req-69652e4d-ae7f-4737-b4cf-05b75fa9f39d tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Calling method '>' {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:52:58 user devstack@n-api.service[72090]: DEBUG nova.policy [None req-69652e4d-ae7f-4737-b4cf-05b75fa9f39d tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2fbfa8948ce64dff92344749d2f0f0c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5919e23c6a4c54b3a05a422c232c9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72090) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:52:58 user devstack@n-api.service[72090]: DEBUG nova.compute.api [None req-69652e4d-ae7f-4737-b4cf-05b75fa9f39d tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Searching by: {'deleted': False, 'project_id': 'ae5919e23c6a4c54b3a05a422c232c9f'} {{(pid=72090) get_all /opt/stack/nova/nova/compute/api.py:3019}} Apr 11 19:52:58 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-69652e4d-ae7f-4737-b4cf-05b75fa9f39d tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:52:58 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-69652e4d-ae7f-4737-b4cf-05b75fa9f39d tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:52:58 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-69652e4d-ae7f-4737-b4cf-05b75fa9f39d tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:52:58 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-69652e4d-ae7f-4737-b4cf-05b75fa9f39d tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:52:58 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-69652e4d-ae7f-4737-b4cf-05b75fa9f39d tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:52:58 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-69652e4d-ae7f-4737-b4cf-05b75fa9f39d tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:52:58 user devstack@n-api.service[72090]: DEBUG nova.compute.multi_cell_list [None req-69652e4d-ae7f-4737-b4cf-05b75fa9f39d tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=72090) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Apr 11 19:52:58 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [None req-69652e4d-ae7f-4737-b4cf-05b75fa9f39d tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] 10.0.0.210 "GET /compute/v2.1/servers" status: 200 len: 341 microversion: 2.1 time: 0.179841 Apr 11 19:52:58 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 360/1082] 10.0.0.210 () {62 vars in 1202 bytes} [Tue Apr 11 19:52:58 2023] GET /compute/v2.1/servers => generated 341 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:52:58 user devstack@n-api.service[72089]: DEBUG dbcounter [-] [72089] Writing DB stats nova_api:SELECT=2 {{(pid=72089) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:52:58 user devstack@n-api.service[72089]: DEBUG dbcounter [-] [72089] Writing DB stats nova_cell1:SELECT=6 {{(pid=72089) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:52:58 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [None req-2a327e09-2c25-4b40-8718-b3702832ba2b tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Calling method '>' {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:52:58 user devstack@n-api.service[72089]: DEBUG nova.compute.api [None req-2a327e09-2c25-4b40-8718-b3702832ba2b tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] [instance: 52298792-b22d-4c8e-ba29-babc5653e2cc] Fetching instance by UUID {{(pid=72089) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:52:58 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-2a327e09-2c25-4b40-8718-b3702832ba2b tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:52:58 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-2a327e09-2c25-4b40-8718-b3702832ba2b tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:52:58 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-2a327e09-2c25-4b40-8718-b3702832ba2b tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:52:58 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-2a327e09-2c25-4b40-8718-b3702832ba2b tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:52:58 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-2a327e09-2c25-4b40-8718-b3702832ba2b tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:52:58 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-2a327e09-2c25-4b40-8718-b3702832ba2b tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:52:58 user devstack@n-api.service[72089]: DEBUG nova.policy [None req-2a327e09-2c25-4b40-8718-b3702832ba2b tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fbfa8948ce64dff92344749d2f0f0c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5919e23c6a4c54b3a05a422c232c9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72089) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:52:58 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [None req-2a327e09-2c25-4b40-8718-b3702832ba2b tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] 10.0.0.210 "GET /compute/v2.1/servers/52298792-b22d-4c8e-ba29-babc5653e2cc" status: 200 len: 1538 microversion: 2.1 time: 0.223348 Apr 11 19:52:58 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 369/1083] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 19:52:58 2023] GET /compute/v2.1/servers/52298792-b22d-4c8e-ba29-babc5653e2cc => generated 1538 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:53:00 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [None req-0fbb1517-ba49-4340-b2c4-0d148f3626e1 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "54b75fb4-6f33-4acd-b9e2-4759c27ac582"}} {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:53:00 user devstack@n-api.service[72088]: DEBUG nova.compute.api [None req-0fbb1517-ba49-4340-b2c4-0d148f3626e1 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] [instance: 52298792-b22d-4c8e-ba29-babc5653e2cc] Fetching instance by UUID {{(pid=72088) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:53:00 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-0fbb1517-ba49-4340-b2c4-0d148f3626e1 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:53:00 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-0fbb1517-ba49-4340-b2c4-0d148f3626e1 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:53:00 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-0fbb1517-ba49-4340-b2c4-0d148f3626e1 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:53:00 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-0fbb1517-ba49-4340-b2c4-0d148f3626e1 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:53:00 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-0fbb1517-ba49-4340-b2c4-0d148f3626e1 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:53:00 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-0fbb1517-ba49-4340-b2c4-0d148f3626e1 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:53:00 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [None req-0fbb1517-ba49-4340-b2c4-0d148f3626e1 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] 10.0.0.210 "POST /compute/v2.1/servers/52298792-b22d-4c8e-ba29-babc5653e2cc/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.328519 Apr 11 19:53:00 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 355/1084] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Apr 11 19:53:00 2023] POST /compute/v2.1/servers/52298792-b22d-4c8e-ba29-babc5653e2cc/os-volume_attachments => generated 194 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:53:08 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [None req-672ce558-45b4-42de-aeaf-dbc01b53534a tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Calling method '>' {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:53:08 user devstack@n-api.service[72090]: DEBUG nova.compute.api [None req-672ce558-45b4-42de-aeaf-dbc01b53534a tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] [instance: 52298792-b22d-4c8e-ba29-babc5653e2cc] Fetching instance by UUID {{(pid=72090) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:53:08 user devstack@n-api.service[72090]: DEBUG dbcounter [-] [72090] Writing DB stats nova_api:SELECT=2 {{(pid=72090) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:53:08 user devstack@n-api.service[72090]: DEBUG dbcounter [-] [72090] Writing DB stats nova_cell0:SELECT=2 {{(pid=72090) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:53:08 user devstack@n-api.service[72090]: DEBUG dbcounter [-] [72090] Writing DB stats nova_cell1:SELECT=8 {{(pid=72090) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:53:08 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-672ce558-45b4-42de-aeaf-dbc01b53534a tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:53:08 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-672ce558-45b4-42de-aeaf-dbc01b53534a tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:53:08 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-672ce558-45b4-42de-aeaf-dbc01b53534a tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:53:08 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-672ce558-45b4-42de-aeaf-dbc01b53534a tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:53:08 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-672ce558-45b4-42de-aeaf-dbc01b53534a tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:53:08 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-672ce558-45b4-42de-aeaf-dbc01b53534a tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:53:08 user devstack@n-api.service[72090]: DEBUG nova.policy [None req-672ce558-45b4-42de-aeaf-dbc01b53534a tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fbfa8948ce64dff92344749d2f0f0c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5919e23c6a4c54b3a05a422c232c9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72090) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:53:08 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [None req-672ce558-45b4-42de-aeaf-dbc01b53534a tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] 10.0.0.210 "GET /compute/v2.1/servers/52298792-b22d-4c8e-ba29-babc5653e2cc" status: 200 len: 1584 microversion: 2.1 time: 0.167991 Apr 11 19:53:08 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 361/1085] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 19:53:08 2023] GET /compute/v2.1/servers/52298792-b22d-4c8e-ba29-babc5653e2cc => generated 1584 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:53:10 user devstack@n-api.service[72089]: DEBUG dbcounter [-] [72089] Writing DB stats nova_api:SELECT=2 {{(pid=72089) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:53:10 user devstack@n-api.service[72089]: DEBUG dbcounter [-] [72089] Writing DB stats nova_cell1:SELECT=6 {{(pid=72089) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:53:10 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [req-62572ae7-3391-4627-9095-c4703c1f06ad req-c2b8a8a0-91c8-4162-a658-6c8b56f6398c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "52298792-b22d-4c8e-ba29-babc5653e2cc", "tag": "32c90c1c-3212-4427-a38d-f505443bf260"}]} {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:53:10 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-62572ae7-3391-4627-9095-c4703c1f06ad req-c2b8a8a0-91c8-4162-a658-6c8b56f6398c service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:53:10 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-62572ae7-3391-4627-9095-c4703c1f06ad req-c2b8a8a0-91c8-4162-a658-6c8b56f6398c service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:53:10 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-62572ae7-3391-4627-9095-c4703c1f06ad req-c2b8a8a0-91c8-4162-a658-6c8b56f6398c service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:53:10 user devstack@n-api.service[72089]: INFO nova.api.openstack.compute.server_external_events [req-62572ae7-3391-4627-9095-c4703c1f06ad req-c2b8a8a0-91c8-4162-a658-6c8b56f6398c service nova] Creating event network-changed:32c90c1c-3212-4427-a38d-f505443bf260 for instance 52298792-b22d-4c8e-ba29-babc5653e2cc on user Apr 11 19:53:10 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [req-62572ae7-3391-4627-9095-c4703c1f06ad req-c2b8a8a0-91c8-4162-a658-6c8b56f6398c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091470 Apr 11 19:53:10 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 370/1086] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:53:10 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:53:12 user devstack@n-api.service[72088]: DEBUG dbcounter [-] [72088] Writing DB stats nova_api:SELECT=4 {{(pid=72088) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:53:12 user devstack@n-api.service[72088]: DEBUG dbcounter [-] [72088] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=72088) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:53:12 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [None req-937aa1c9-ac8c-46a9-b148-73de167e6f44 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1635554149"}} {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:53:12 user devstack@n-api.service[72088]: DEBUG nova.compute.api [None req-937aa1c9-ac8c-46a9-b148-73de167e6f44 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] [instance: 52298792-b22d-4c8e-ba29-babc5653e2cc] Fetching instance by UUID {{(pid=72088) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:53:12 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-937aa1c9-ac8c-46a9-b148-73de167e6f44 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:53:12 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-937aa1c9-ac8c-46a9-b148-73de167e6f44 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:53:12 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-937aa1c9-ac8c-46a9-b148-73de167e6f44 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:53:12 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-937aa1c9-ac8c-46a9-b148-73de167e6f44 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:53:12 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-937aa1c9-ac8c-46a9-b148-73de167e6f44 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:53:12 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-937aa1c9-ac8c-46a9-b148-73de167e6f44 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:53:12 user devstack@n-api.service[72088]: INFO nova.network.security_group_api [None req-937aa1c9-ac8c-46a9-b148-73de167e6f44 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Adding security group 2890df96-d667-4e7e-bbd2-aad6aae0d2a6 to port 32c90c1c-3212-4427-a38d-f505443bf260 Apr 11 19:53:12 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [None req-937aa1c9-ac8c-46a9-b148-73de167e6f44 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] 10.0.0.210 "POST /compute/v2.1/servers/52298792-b22d-4c8e-ba29-babc5653e2cc/action" status: 202 len: 0 microversion: 2.1 time: 0.561108 Apr 11 19:53:12 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 356/1087] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Apr 11 19:53:12 2023] POST /compute/v2.1/servers/52298792-b22d-4c8e-ba29-babc5653e2cc/action => generated 0 bytes in 563 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 19:53:12 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [None req-aa248115-8012-4faa-80f7-6a521f8ed83f tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Calling method '>' {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:53:12 user devstack@n-api.service[72090]: DEBUG nova.compute.api [None req-aa248115-8012-4faa-80f7-6a521f8ed83f tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] [instance: 52298792-b22d-4c8e-ba29-babc5653e2cc] Fetching instance by UUID {{(pid=72090) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:53:12 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-aa248115-8012-4faa-80f7-6a521f8ed83f tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:53:12 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-aa248115-8012-4faa-80f7-6a521f8ed83f tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:53:12 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-aa248115-8012-4faa-80f7-6a521f8ed83f tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:53:12 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-aa248115-8012-4faa-80f7-6a521f8ed83f tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:53:12 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-aa248115-8012-4faa-80f7-6a521f8ed83f tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:53:12 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-aa248115-8012-4faa-80f7-6a521f8ed83f tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:53:12 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [req-7266e50f-8c5e-4cb9-b7a8-3eb8f7bfeaac req-514968d7-2b74-4fdf-ae08-cd9b37e6d9d8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "52298792-b22d-4c8e-ba29-babc5653e2cc", "tag": "32c90c1c-3212-4427-a38d-f505443bf260"}]} {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:53:12 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-7266e50f-8c5e-4cb9-b7a8-3eb8f7bfeaac req-514968d7-2b74-4fdf-ae08-cd9b37e6d9d8 service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:53:12 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-7266e50f-8c5e-4cb9-b7a8-3eb8f7bfeaac req-514968d7-2b74-4fdf-ae08-cd9b37e6d9d8 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:53:12 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-7266e50f-8c5e-4cb9-b7a8-3eb8f7bfeaac req-514968d7-2b74-4fdf-ae08-cd9b37e6d9d8 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:53:12 user devstack@n-api.service[72090]: DEBUG nova.policy [None req-aa248115-8012-4faa-80f7-6a521f8ed83f tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fbfa8948ce64dff92344749d2f0f0c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5919e23c6a4c54b3a05a422c232c9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72090) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:53:12 user devstack@n-api.service[72089]: INFO nova.api.openstack.compute.server_external_events [req-7266e50f-8c5e-4cb9-b7a8-3eb8f7bfeaac req-514968d7-2b74-4fdf-ae08-cd9b37e6d9d8 service nova] Creating event network-changed:32c90c1c-3212-4427-a38d-f505443bf260 for instance 52298792-b22d-4c8e-ba29-babc5653e2cc on user Apr 11 19:53:12 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [req-7266e50f-8c5e-4cb9-b7a8-3eb8f7bfeaac req-514968d7-2b74-4fdf-ae08-cd9b37e6d9d8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.158352 Apr 11 19:53:12 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 371/1088] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:53:12 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:53:12 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [None req-aa248115-8012-4faa-80f7-6a521f8ed83f tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] 10.0.0.210 "GET /compute/v2.1/servers/52298792-b22d-4c8e-ba29-babc5653e2cc" status: 200 len: 1749 microversion: 2.1 time: 0.165156 Apr 11 19:53:12 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 362/1089] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 19:53:12 2023] GET /compute/v2.1/servers/52298792-b22d-4c8e-ba29-babc5653e2cc => generated 1749 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:53:14 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [None req-ada53cbc-a66c-42ef-817b-5aa5279b3f08 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:53:14 user devstack@n-api.service[72088]: DEBUG nova.compute.api [None req-ada53cbc-a66c-42ef-817b-5aa5279b3f08 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] [instance: 52298792-b22d-4c8e-ba29-babc5653e2cc] Fetching instance by UUID {{(pid=72088) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:53:14 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-ada53cbc-a66c-42ef-817b-5aa5279b3f08 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:53:14 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-ada53cbc-a66c-42ef-817b-5aa5279b3f08 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:53:14 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-ada53cbc-a66c-42ef-817b-5aa5279b3f08 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:53:14 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-ada53cbc-a66c-42ef-817b-5aa5279b3f08 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:53:14 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-ada53cbc-a66c-42ef-817b-5aa5279b3f08 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:53:14 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-ada53cbc-a66c-42ef-817b-5aa5279b3f08 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:53:14 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [None req-ada53cbc-a66c-42ef-817b-5aa5279b3f08 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] 10.0.0.210 "POST /compute/v2.1/servers/52298792-b22d-4c8e-ba29-babc5653e2cc/action" status: 202 len: 0 microversion: 2.1 time: 0.091479 Apr 11 19:53:14 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 357/1090] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Apr 11 19:53:14 2023] POST /compute/v2.1/servers/52298792-b22d-4c8e-ba29-babc5653e2cc/action => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 19:53:14 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [None req-5916253d-a0c7-49b3-a3e1-e4745db2da62 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Calling method '>' {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:53:14 user devstack@n-api.service[72089]: DEBUG nova.compute.api [None req-5916253d-a0c7-49b3-a3e1-e4745db2da62 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] [instance: 52298792-b22d-4c8e-ba29-babc5653e2cc] Fetching instance by UUID {{(pid=72089) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:53:14 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-5916253d-a0c7-49b3-a3e1-e4745db2da62 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:53:14 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-5916253d-a0c7-49b3-a3e1-e4745db2da62 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:53:14 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-5916253d-a0c7-49b3-a3e1-e4745db2da62 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:53:14 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-5916253d-a0c7-49b3-a3e1-e4745db2da62 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:53:14 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-5916253d-a0c7-49b3-a3e1-e4745db2da62 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:53:14 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-5916253d-a0c7-49b3-a3e1-e4745db2da62 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:53:14 user devstack@n-api.service[72089]: DEBUG nova.policy [None req-5916253d-a0c7-49b3-a3e1-e4745db2da62 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fbfa8948ce64dff92344749d2f0f0c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5919e23c6a4c54b3a05a422c232c9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72089) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:53:14 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [None req-5916253d-a0c7-49b3-a3e1-e4745db2da62 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] 10.0.0.210 "GET /compute/v2.1/servers/52298792-b22d-4c8e-ba29-babc5653e2cc" status: 200 len: 1751 microversion: 2.1 time: 0.222214 Apr 11 19:53:14 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 372/1091] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 19:53:14 2023] GET /compute/v2.1/servers/52298792-b22d-4c8e-ba29-babc5653e2cc => generated 1751 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:53:15 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [req-73e7a7f8-36a9-4ab1-9b0c-00f854e9da6a req-c4bf6ab5-853d-446f-8c30-5571b88964bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "52298792-b22d-4c8e-ba29-babc5653e2cc", "name": "network-vif-unplugged", "status": "completed", "tag": "32c90c1c-3212-4427-a38d-f505443bf260"}]} {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:53:15 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-73e7a7f8-36a9-4ab1-9b0c-00f854e9da6a req-c4bf6ab5-853d-446f-8c30-5571b88964bb service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:53:15 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-73e7a7f8-36a9-4ab1-9b0c-00f854e9da6a req-c4bf6ab5-853d-446f-8c30-5571b88964bb service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:53:15 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-73e7a7f8-36a9-4ab1-9b0c-00f854e9da6a req-c4bf6ab5-853d-446f-8c30-5571b88964bb service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:53:15 user devstack@n-api.service[72090]: INFO nova.api.openstack.compute.server_external_events [req-73e7a7f8-36a9-4ab1-9b0c-00f854e9da6a req-c4bf6ab5-853d-446f-8c30-5571b88964bb service nova] Creating event network-vif-unplugged:32c90c1c-3212-4427-a38d-f505443bf260 for instance 52298792-b22d-4c8e-ba29-babc5653e2cc on user Apr 11 19:53:15 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [req-73e7a7f8-36a9-4ab1-9b0c-00f854e9da6a req-c4bf6ab5-853d-446f-8c30-5571b88964bb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.039572 Apr 11 19:53:15 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 363/1092] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:53:15 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:53:17 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [req-3b9a2390-ee6c-4386-8455-653955b5e117 req-8c3902c5-4793-49db-b128-a2bc5f5a63a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "52298792-b22d-4c8e-ba29-babc5653e2cc", "name": "network-vif-plugged", "status": "completed", "tag": "32c90c1c-3212-4427-a38d-f505443bf260"}]} {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:53:17 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-3b9a2390-ee6c-4386-8455-653955b5e117 req-8c3902c5-4793-49db-b128-a2bc5f5a63a2 service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:53:17 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-3b9a2390-ee6c-4386-8455-653955b5e117 req-8c3902c5-4793-49db-b128-a2bc5f5a63a2 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:53:17 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-3b9a2390-ee6c-4386-8455-653955b5e117 req-8c3902c5-4793-49db-b128-a2bc5f5a63a2 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:53:17 user devstack@n-api.service[72088]: INFO nova.api.openstack.compute.server_external_events [req-3b9a2390-ee6c-4386-8455-653955b5e117 req-8c3902c5-4793-49db-b128-a2bc5f5a63a2 service nova] Creating event network-vif-plugged:32c90c1c-3212-4427-a38d-f505443bf260 for instance 52298792-b22d-4c8e-ba29-babc5653e2cc on user Apr 11 19:53:17 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [req-3b9a2390-ee6c-4386-8455-653955b5e117 req-8c3902c5-4793-49db-b128-a2bc5f5a63a2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031608 Apr 11 19:53:17 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 358/1093] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:53:17 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:53:19 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [req-8103a83c-f47f-473e-91b7-b5da6d4b7646 req-c5004bc9-ebd5-47d2-a36b-1eaeb9cff337 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "52298792-b22d-4c8e-ba29-babc5653e2cc", "name": "network-vif-plugged", "status": "completed", "tag": "32c90c1c-3212-4427-a38d-f505443bf260"}]} {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:53:19 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-8103a83c-f47f-473e-91b7-b5da6d4b7646 req-c5004bc9-ebd5-47d2-a36b-1eaeb9cff337 service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:53:19 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-8103a83c-f47f-473e-91b7-b5da6d4b7646 req-c5004bc9-ebd5-47d2-a36b-1eaeb9cff337 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:53:19 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-8103a83c-f47f-473e-91b7-b5da6d4b7646 req-c5004bc9-ebd5-47d2-a36b-1eaeb9cff337 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:53:19 user devstack@n-api.service[72089]: INFO nova.api.openstack.compute.server_external_events [req-8103a83c-f47f-473e-91b7-b5da6d4b7646 req-c5004bc9-ebd5-47d2-a36b-1eaeb9cff337 service nova] Creating event network-vif-plugged:32c90c1c-3212-4427-a38d-f505443bf260 for instance 52298792-b22d-4c8e-ba29-babc5653e2cc on user Apr 11 19:53:19 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [req-8103a83c-f47f-473e-91b7-b5da6d4b7646 req-c5004bc9-ebd5-47d2-a36b-1eaeb9cff337 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067280 Apr 11 19:53:19 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 373/1094] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:53:19 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:53:21 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [req-e2db88ba-cc2a-4857-b605-2ae2b577d253 req-3bf161e9-86a8-40ee-83d5-242b9c3802fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "52298792-b22d-4c8e-ba29-babc5653e2cc", "name": "network-vif-plugged", "status": "completed", "tag": "32c90c1c-3212-4427-a38d-f505443bf260"}]} {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:53:21 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-e2db88ba-cc2a-4857-b605-2ae2b577d253 req-3bf161e9-86a8-40ee-83d5-242b9c3802fc service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:53:21 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-e2db88ba-cc2a-4857-b605-2ae2b577d253 req-3bf161e9-86a8-40ee-83d5-242b9c3802fc service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:53:21 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-e2db88ba-cc2a-4857-b605-2ae2b577d253 req-3bf161e9-86a8-40ee-83d5-242b9c3802fc service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:53:21 user devstack@n-api.service[72090]: INFO nova.api.openstack.compute.server_external_events [req-e2db88ba-cc2a-4857-b605-2ae2b577d253 req-3bf161e9-86a8-40ee-83d5-242b9c3802fc service nova] Creating event network-vif-plugged:32c90c1c-3212-4427-a38d-f505443bf260 for instance 52298792-b22d-4c8e-ba29-babc5653e2cc on user Apr 11 19:53:21 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [req-e2db88ba-cc2a-4857-b605-2ae2b577d253 req-3bf161e9-86a8-40ee-83d5-242b9c3802fc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035770 Apr 11 19:53:21 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 364/1095] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:53:21 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:54:04 user devstack@n-api.service[72088]: DEBUG dbcounter [-] [72088] Writing DB stats nova_api:SELECT=6 {{(pid=72088) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:54:04 user devstack@n-api.service[72088]: DEBUG dbcounter [-] [72088] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=72088) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:54:04 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [None req-2d8c8953-ff12-40b3-91a1-f29cebaf6e54 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Calling method '>' {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:54:04 user devstack@n-api.service[72088]: DEBUG nova.compute.api [None req-2d8c8953-ff12-40b3-91a1-f29cebaf6e54 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] [instance: 52298792-b22d-4c8e-ba29-babc5653e2cc] Fetching instance by UUID {{(pid=72088) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:54:04 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-2d8c8953-ff12-40b3-91a1-f29cebaf6e54 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:54:04 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-2d8c8953-ff12-40b3-91a1-f29cebaf6e54 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:54:04 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-2d8c8953-ff12-40b3-91a1-f29cebaf6e54 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:54:04 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-2d8c8953-ff12-40b3-91a1-f29cebaf6e54 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:54:04 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-2d8c8953-ff12-40b3-91a1-f29cebaf6e54 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:54:04 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-2d8c8953-ff12-40b3-91a1-f29cebaf6e54 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:54:04 user devstack@n-api.service[72088]: DEBUG nova.policy [None req-2d8c8953-ff12-40b3-91a1-f29cebaf6e54 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fbfa8948ce64dff92344749d2f0f0c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5919e23c6a4c54b3a05a422c232c9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72088) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:54:04 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [None req-2d8c8953-ff12-40b3-91a1-f29cebaf6e54 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] 10.0.0.210 "GET /compute/v2.1/servers/52298792-b22d-4c8e-ba29-babc5653e2cc" status: 200 len: 1749 microversion: 2.1 time: 0.173083 Apr 11 19:54:04 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 359/1096] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 19:54:04 2023] GET /compute/v2.1/servers/52298792-b22d-4c8e-ba29-babc5653e2cc => generated 1749 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:55:04 user devstack@n-api.service[72089]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 11 19:55:04 user devstack@n-api.service[72089]: Tue Apr 11 19:55:04 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/52298792-b22d-4c8e-ba29-babc5653e2cc/action (ip 10.0.0.210) !!! Apr 11 19:55:04 user devstack@n-api.service[72089]: DEBUG dbcounter [-] [72089] Writing DB stats nova_api:SELECT=8 {{(pid=72089) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:55:04 user devstack@n-api.service[72089]: DEBUG dbcounter [-] [72089] Writing DB stats nova_cell1:SELECT=12 {{(pid=72089) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:55:04 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [None req-2a4363d9-1700-4f04-99f2-3bf16a5b6e6c tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1635554149"}} {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:55:04 user devstack@n-api.service[72089]: DEBUG nova.compute.api [None req-2a4363d9-1700-4f04-99f2-3bf16a5b6e6c tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] [instance: 52298792-b22d-4c8e-ba29-babc5653e2cc] Fetching instance by UUID {{(pid=72089) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:55:04 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-2a4363d9-1700-4f04-99f2-3bf16a5b6e6c tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:55:04 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-2a4363d9-1700-4f04-99f2-3bf16a5b6e6c tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:55:04 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-2a4363d9-1700-4f04-99f2-3bf16a5b6e6c tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:55:04 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-2a4363d9-1700-4f04-99f2-3bf16a5b6e6c tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:55:04 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-2a4363d9-1700-4f04-99f2-3bf16a5b6e6c tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:55:04 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-2a4363d9-1700-4f04-99f2-3bf16a5b6e6c tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:55:05 user devstack@n-api.service[72089]: INFO nova.network.security_group_api [None req-2a4363d9-1700-4f04-99f2-3bf16a5b6e6c tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Removing security group 2890df96-d667-4e7e-bbd2-aad6aae0d2a6 from port 32c90c1c-3212-4427-a38d-f505443bf260 Apr 11 19:55:05 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [None req-2a4363d9-1700-4f04-99f2-3bf16a5b6e6c tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] 10.0.0.210 "POST /compute/v2.1/servers/52298792-b22d-4c8e-ba29-babc5653e2cc/action" status: 202 len: 0 microversion: 2.1 time: 0.589528 Apr 11 19:55:05 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 374/1097] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Apr 11 19:55:04 2023] POST /compute/v2.1/servers/52298792-b22d-4c8e-ba29-babc5653e2cc/action => generated 0 bytes in 592 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 19:55:05 user devstack@n-api.service[72090]: DEBUG dbcounter [-] [72090] Writing DB stats nova_api:SELECT=8 {{(pid=72090) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:55:05 user devstack@n-api.service[72090]: DEBUG dbcounter [-] [72090] Writing DB stats nova_cell1:SELECT=16 {{(pid=72090) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:55:05 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [req-2fc8912d-31c5-4175-97e5-ec583313d4af req-95855cb8-34eb-44dd-8e0f-49fb4f17af81 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "52298792-b22d-4c8e-ba29-babc5653e2cc", "tag": "32c90c1c-3212-4427-a38d-f505443bf260"}]} {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:55:05 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-2fc8912d-31c5-4175-97e5-ec583313d4af req-95855cb8-34eb-44dd-8e0f-49fb4f17af81 service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:55:05 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-2fc8912d-31c5-4175-97e5-ec583313d4af req-95855cb8-34eb-44dd-8e0f-49fb4f17af81 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:55:05 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-2fc8912d-31c5-4175-97e5-ec583313d4af req-95855cb8-34eb-44dd-8e0f-49fb4f17af81 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:55:05 user devstack@n-api.service[72090]: INFO nova.api.openstack.compute.server_external_events [req-2fc8912d-31c5-4175-97e5-ec583313d4af req-95855cb8-34eb-44dd-8e0f-49fb4f17af81 service nova] Creating event network-changed:32c90c1c-3212-4427-a38d-f505443bf260 for instance 52298792-b22d-4c8e-ba29-babc5653e2cc on user Apr 11 19:55:05 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [req-2fc8912d-31c5-4175-97e5-ec583313d4af req-95855cb8-34eb-44dd-8e0f-49fb4f17af81 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046571 Apr 11 19:55:05 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 365/1098] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:55:05 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:55:06 user devstack@n-api.service[72088]: DEBUG dbcounter [-] [72088] Writing DB stats nova_api:SELECT=2 {{(pid=72088) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:55:06 user devstack@n-api.service[72088]: DEBUG dbcounter [-] [72088] Writing DB stats nova_cell1:SELECT=6 {{(pid=72088) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:55:06 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [None req-ad37ae1d-11ed-405a-8f9e-e95599c803a4 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Calling method '>' {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:55:06 user devstack@n-api.service[72089]: DEBUG nova.compute.api [None req-ad37ae1d-11ed-405a-8f9e-e95599c803a4 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] [instance: 52298792-b22d-4c8e-ba29-babc5653e2cc] Fetching instance by UUID {{(pid=72089) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:55:06 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-ad37ae1d-11ed-405a-8f9e-e95599c803a4 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:55:06 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-ad37ae1d-11ed-405a-8f9e-e95599c803a4 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:55:06 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-ad37ae1d-11ed-405a-8f9e-e95599c803a4 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:55:06 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-ad37ae1d-11ed-405a-8f9e-e95599c803a4 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:55:06 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-ad37ae1d-11ed-405a-8f9e-e95599c803a4 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:55:06 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-ad37ae1d-11ed-405a-8f9e-e95599c803a4 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:55:06 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [req-9fbe5c4b-0f2d-4a69-89b0-48023be41d60 req-56e123a8-5318-4d92-801a-6f8d331b45f4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "52298792-b22d-4c8e-ba29-babc5653e2cc", "tag": "32c90c1c-3212-4427-a38d-f505443bf260"}]} {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:55:06 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-9fbe5c4b-0f2d-4a69-89b0-48023be41d60 req-56e123a8-5318-4d92-801a-6f8d331b45f4 service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:55:06 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-9fbe5c4b-0f2d-4a69-89b0-48023be41d60 req-56e123a8-5318-4d92-801a-6f8d331b45f4 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:55:06 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-9fbe5c4b-0f2d-4a69-89b0-48023be41d60 req-56e123a8-5318-4d92-801a-6f8d331b45f4 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:55:06 user devstack@n-api.service[72088]: INFO nova.api.openstack.compute.server_external_events [req-9fbe5c4b-0f2d-4a69-89b0-48023be41d60 req-56e123a8-5318-4d92-801a-6f8d331b45f4 service nova] Creating event network-changed:32c90c1c-3212-4427-a38d-f505443bf260 for instance 52298792-b22d-4c8e-ba29-babc5653e2cc on user Apr 11 19:55:06 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [req-9fbe5c4b-0f2d-4a69-89b0-48023be41d60 req-56e123a8-5318-4d92-801a-6f8d331b45f4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.130802 Apr 11 19:55:06 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 360/1099] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:55:06 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:55:06 user devstack@n-api.service[72089]: DEBUG nova.objects.instance [None req-ad37ae1d-11ed-405a-8f9e-e95599c803a4 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Lazy-loading 'services' on Instance uuid 52298792-b22d-4c8e-ba29-babc5653e2cc {{(pid=72089) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 11 19:55:06 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [None req-ad37ae1d-11ed-405a-8f9e-e95599c803a4 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/52298792-b22d-4c8e-ba29-babc5653e2cc/os-volume_attachments/54b75fb4-6f33-4acd-b9e2-4759c27ac582" status: 202 len: 0 microversion: 2.1 time: 0.191967 Apr 11 19:55:06 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 375/1100] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Apr 11 19:55:06 2023] DELETE /compute/v2.1/servers/52298792-b22d-4c8e-ba29-babc5653e2cc/os-volume_attachments/54b75fb4-6f33-4acd-b9e2-4759c27ac582 => generated 0 bytes in 193 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 19:55:06 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [None req-cdfcffc4-58ae-4fca-b877-c6d4cd8e4767 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Calling method '>' {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:55:06 user devstack@n-api.service[72090]: DEBUG nova.compute.api [None req-cdfcffc4-58ae-4fca-b877-c6d4cd8e4767 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] [instance: 52298792-b22d-4c8e-ba29-babc5653e2cc] Fetching instance by UUID {{(pid=72090) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:55:06 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-cdfcffc4-58ae-4fca-b877-c6d4cd8e4767 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:55:06 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-cdfcffc4-58ae-4fca-b877-c6d4cd8e4767 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:55:06 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-cdfcffc4-58ae-4fca-b877-c6d4cd8e4767 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:55:06 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-cdfcffc4-58ae-4fca-b877-c6d4cd8e4767 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:55:06 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-cdfcffc4-58ae-4fca-b877-c6d4cd8e4767 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:55:06 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-cdfcffc4-58ae-4fca-b877-c6d4cd8e4767 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:55:06 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [None req-cdfcffc4-58ae-4fca-b877-c6d4cd8e4767 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] 10.0.0.210 "GET /compute/v2.1/servers/52298792-b22d-4c8e-ba29-babc5653e2cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058255 Apr 11 19:55:06 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 366/1101] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Apr 11 19:55:06 2023] GET /compute/v2.1/servers/52298792-b22d-4c8e-ba29-babc5653e2cc/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:55:56 user devstack@n-api.service[72088]: DEBUG dbcounter [-] [72088] Writing DB stats nova_api:SELECT=2 {{(pid=72088) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:55:56 user devstack@n-api.service[72088]: DEBUG dbcounter [-] [72088] Writing DB stats nova_cell1:SELECT=2 {{(pid=72088) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:55:56 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [None req-a030ff04-0ff9-4752-8aac-d55df1765120 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Calling method '>' {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:55:56 user devstack@n-api.service[72088]: DEBUG nova.compute.api [None req-a030ff04-0ff9-4752-8aac-d55df1765120 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] [instance: 52298792-b22d-4c8e-ba29-babc5653e2cc] Fetching instance by UUID {{(pid=72088) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:55:56 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-a030ff04-0ff9-4752-8aac-d55df1765120 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:55:56 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-a030ff04-0ff9-4752-8aac-d55df1765120 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:55:56 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-a030ff04-0ff9-4752-8aac-d55df1765120 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:55:56 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-a030ff04-0ff9-4752-8aac-d55df1765120 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:55:56 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-a030ff04-0ff9-4752-8aac-d55df1765120 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:55:56 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-a030ff04-0ff9-4752-8aac-d55df1765120 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:55:56 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [None req-a030ff04-0ff9-4752-8aac-d55df1765120 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] 10.0.0.210 "GET /compute/v2.1/servers/52298792-b22d-4c8e-ba29-babc5653e2cc/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.051763 Apr 11 19:55:56 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 361/1102] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Apr 11 19:55:56 2023] GET /compute/v2.1/servers/52298792-b22d-4c8e-ba29-babc5653e2cc/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 11 19:55:56 user devstack@n-api.service[72089]: DEBUG dbcounter [-] [72089] Writing DB stats nova_api:SELECT=4 {{(pid=72089) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:55:56 user devstack@n-api.service[72089]: DEBUG dbcounter [-] [72089] Writing DB stats nova_cell1:SELECT=13,nova_cell1:INSERT=1 {{(pid=72089) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:55:56 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [None req-d3f4e8b5-7846-4bf5-8522-aa34d70eafd4 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Calling method '>' {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:55:56 user devstack@n-api.service[72089]: DEBUG nova.compute.api [None req-d3f4e8b5-7846-4bf5-8522-aa34d70eafd4 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] [instance: 52298792-b22d-4c8e-ba29-babc5653e2cc] Fetching instance by UUID {{(pid=72089) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:55:56 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-d3f4e8b5-7846-4bf5-8522-aa34d70eafd4 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:55:56 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-d3f4e8b5-7846-4bf5-8522-aa34d70eafd4 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:55:56 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-d3f4e8b5-7846-4bf5-8522-aa34d70eafd4 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:55:56 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-d3f4e8b5-7846-4bf5-8522-aa34d70eafd4 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:55:56 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-d3f4e8b5-7846-4bf5-8522-aa34d70eafd4 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:55:56 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-d3f4e8b5-7846-4bf5-8522-aa34d70eafd4 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:55:56 user devstack@n-api.service[72089]: INFO nova.api.openstack.wsgi [None req-d3f4e8b5-7846-4bf5-8522-aa34d70eafd4 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] HTTP exception thrown: Instance 52298792-b22d-4c8e-ba29-babc5653e2cc is not attached to volume 54b75fb4-6f33-4acd-b9e2-4759c27ac582 Apr 11 19:55:56 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [None req-d3f4e8b5-7846-4bf5-8522-aa34d70eafd4 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Request method failure captured: Apr 11 19:55:56 user devstack@n-api.service[72089]: request: DELETE /compute/v2.1/servers/52298792-b22d-4c8e-ba29-babc5653e2cc/os-volume_attachments/54b75fb4-6f33-4acd-b9e2-4759c27ac582 HTTP/1.1 Apr 11 19:55:56 user devstack@n-api.service[72089]: Accept: application/json Apr 11 19:55:56 user devstack@n-api.service[72089]: Accept-Encoding: identity Apr 11 19:55:56 user devstack@n-api.service[72089]: Connection: close Apr 11 19:55:56 user devstack@n-api.service[72089]: Content-Length: 0 Apr 11 19:55:56 user devstack@n-api.service[72089]: Content-Type: application/json Apr 11 19:55:56 user devstack@n-api.service[72089]: Host: 10.0.0.210 Apr 11 19:55:56 user devstack@n-api.service[72089]: Openstack-System-Scope: None Apr 11 19:55:56 user devstack@n-api.service[72089]: User-Agent: python-urllib3/1.26.15 Apr 11 19:55:56 user devstack@n-api.service[72089]: X-Auth-Token: gAAAAABkNboi_g8bsRhtx8uaOa5NWTf4uxnOLtVcon7BuOvG4wwTk-gCtYgZk-W-EpML2K-XvGIiaXLcQATSJp7kx203_AqQj-mT36BIS4okttmIUV_Cpre-05H_v5q-f1j-VDoVyV8P9rncakZQzBmdXgp-4Pcbg0qPnqEsmlb5AUO9F8sYDKU Apr 11 19:55:56 user devstack@n-api.service[72089]: X-Domain-Id: None Apr 11 19:55:56 user devstack@n-api.service[72089]: X-Domain-Name: None Apr 11 19:55:56 user devstack@n-api.service[72089]: X-Identity-Status: Confirmed Apr 11 19:55:56 user devstack@n-api.service[72089]: X-Is-Admin-Project: True Apr 11 19:55:56 user devstack@n-api.service[72089]: X-Project-Domain-Id: default Apr 11 19:55:56 user devstack@n-api.service[72089]: X-Project-Domain-Name: Default Apr 11 19:55:56 user devstack@n-api.service[72089]: X-Project-Id: ae5919e23c6a4c54b3a05a422c232c9f Apr 11 19:55:56 user devstack@n-api.service[72089]: X-Project-Name: tempest-TestMinimumBasicScenario-1332908423 Apr 11 19:55:56 user devstack@n-api.service[72089]: X-Role: reader,member Apr 11 19:55:56 user devstack@n-api.service[72089]: X-Roles: reader,member Apr 11 19:55:56 user devstack@n-api.service[72089]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ae5919e23c6a4c54b3a05a422c232c9f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/ae5919e23c6a4c54b3a05a422c232c9f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ae5919e23c6a4c54b3a05a422c232c9f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 11 19:55:56 user devstack@n-api.service[72089]: X-Tenant: tempest-TestMinimumBasicScenario-1332908423 Apr 11 19:55:56 user devstack@n-api.service[72089]: X-Tenant-Id: ae5919e23c6a4c54b3a05a422c232c9f Apr 11 19:55:56 user devstack@n-api.service[72089]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1332908423 Apr 11 19:55:56 user devstack@n-api.service[72089]: X-User: tempest-TestMinimumBasicScenario-1332908423-project-member Apr 11 19:55:56 user devstack@n-api.service[72089]: X-User-Domain-Id: default Apr 11 19:55:56 user devstack@n-api.service[72089]: X-User-Domain-Name: Default Apr 11 19:55:56 user devstack@n-api.service[72089]: X-User-Id: 2fbfa8948ce64dff92344749d2f0f0c7 Apr 11 19:55:56 user devstack@n-api.service[72089]: X-User-Name: tempest-TestMinimumBasicScenario-1332908423-project-member Apr 11 19:55:56 user devstack@n-api.service[72089]: method: > Apr 11 19:55:56 user devstack@n-api.service[72089]: exception: Instance 52298792-b22d-4c8e-ba29-babc5653e2cc is not attached to volume 54b75fb4-6f33-4acd-b9e2-4759c27ac582 Apr 11 19:55:56 user devstack@n-api.service[72089]: action_args: {'server_id': '52298792-b22d-4c8e-ba29-babc5653e2cc', 'id': '54b75fb4-6f33-4acd-b9e2-4759c27ac582'} Apr 11 19:55:56 user devstack@n-api.service[72089]: {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 19:55:56 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:55:56 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Apr 11 19:55:56 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Apr 11 19:55:56 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Apr 11 19:55:56 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Apr 11 19:55:56 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Apr 11 19:55:56 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Apr 11 19:55:56 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 54b75fb4-6f33-4acd-b9e2-4759c27ac582. Apr 11 19:55:56 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi Apr 11 19:55:56 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 19:55:56 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi Apr 11 19:55:56 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:55:56 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 19:55:56 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 19:55:56 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 19:55:56 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 19:55:56 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 19:55:56 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 19:55:56 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Apr 11 19:55:56 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Apr 11 19:55:56 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 52298792-b22d-4c8e-ba29-babc5653e2cc is not attached to volume 54b75fb4-6f33-4acd-b9e2-4759c27ac582 Apr 11 19:55:56 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi Apr 11 19:55:56 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 19:55:56 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi Apr 11 19:55:56 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:55:56 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 19:55:56 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 19:55:56 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 19:55:56 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 19:55:56 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 52298792-b22d-4c8e-ba29-babc5653e2cc is not attached to volume 54b75fb4-6f33-4acd-b9e2-4759c27ac582 Apr 11 19:55:56 user devstack@n-api.service[72089]: ERROR nova.api.openstack.wsgi Apr 11 19:55:56 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [None req-d3f4e8b5-7846-4bf5-8522-aa34d70eafd4 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Returning 404 to user: Instance 52298792-b22d-4c8e-ba29-babc5653e2cc is not attached to volume 54b75fb4-6f33-4acd-b9e2-4759c27ac582 {{(pid=72089) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 19:55:56 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [None req-d3f4e8b5-7846-4bf5-8522-aa34d70eafd4 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/52298792-b22d-4c8e-ba29-babc5653e2cc/os-volume_attachments/54b75fb4-6f33-4acd-b9e2-4759c27ac582" status: 404 len: 154 microversion: 2.1 time: 0.105760 Apr 11 19:55:56 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 376/1103] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Apr 11 19:55:56 2023] DELETE /compute/v2.1/servers/52298792-b22d-4c8e-ba29-babc5653e2cc/os-volume_attachments/54b75fb4-6f33-4acd-b9e2-4759c27ac582 => generated 154 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 19:55:58 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [None req-e1b40888-b1d8-4d2e-8c91-35c11e099d52 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Calling method '>' {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:55:58 user devstack@n-api.service[72090]: DEBUG nova.compute.api [None req-e1b40888-b1d8-4d2e-8c91-35c11e099d52 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] [instance: 52298792-b22d-4c8e-ba29-babc5653e2cc] Fetching instance by UUID {{(pid=72090) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:55:58 user devstack@n-api.service[72090]: DEBUG dbcounter [-] [72090] Writing DB stats nova_api:SELECT=4 {{(pid=72090) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:55:58 user devstack@n-api.service[72090]: DEBUG dbcounter [-] [72090] Writing DB stats nova_cell1:SELECT=8 {{(pid=72090) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:55:58 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-e1b40888-b1d8-4d2e-8c91-35c11e099d52 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:55:58 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-e1b40888-b1d8-4d2e-8c91-35c11e099d52 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:55:58 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-e1b40888-b1d8-4d2e-8c91-35c11e099d52 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:55:58 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-e1b40888-b1d8-4d2e-8c91-35c11e099d52 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:55:58 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-e1b40888-b1d8-4d2e-8c91-35c11e099d52 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:55:58 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-e1b40888-b1d8-4d2e-8c91-35c11e099d52 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:55:58 user devstack@n-api.service[72090]: DEBUG nova.compute.api [None req-e1b40888-b1d8-4d2e-8c91-35c11e099d52 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] [instance: 52298792-b22d-4c8e-ba29-babc5653e2cc] Going to try to terminate instance {{(pid=72090) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 11 19:55:58 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [None req-e1b40888-b1d8-4d2e-8c91-35c11e099d52 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/52298792-b22d-4c8e-ba29-babc5653e2cc" status: 204 len: 0 microversion: 2.1 time: 0.120433 Apr 11 19:55:58 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 367/1104] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 19:55:58 2023] DELETE /compute/v2.1/servers/52298792-b22d-4c8e-ba29-babc5653e2cc => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Apr 11 19:55:58 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [None req-af931059-59e3-4a29-aae2-e671bb58baba tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Calling method '>' {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:55:58 user devstack@n-api.service[72088]: DEBUG nova.compute.api [None req-af931059-59e3-4a29-aae2-e671bb58baba tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] [instance: 52298792-b22d-4c8e-ba29-babc5653e2cc] Fetching instance by UUID {{(pid=72088) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:55:58 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-af931059-59e3-4a29-aae2-e671bb58baba tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:55:58 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-af931059-59e3-4a29-aae2-e671bb58baba tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:55:58 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-af931059-59e3-4a29-aae2-e671bb58baba tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:55:58 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-af931059-59e3-4a29-aae2-e671bb58baba tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:55:58 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-af931059-59e3-4a29-aae2-e671bb58baba tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:55:58 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-af931059-59e3-4a29-aae2-e671bb58baba tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:55:58 user devstack@n-api.service[72088]: DEBUG nova.policy [None req-af931059-59e3-4a29-aae2-e671bb58baba tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fbfa8948ce64dff92344749d2f0f0c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5919e23c6a4c54b3a05a422c232c9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72088) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:55:58 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [None req-af931059-59e3-4a29-aae2-e671bb58baba tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] 10.0.0.210 "GET /compute/v2.1/servers/52298792-b22d-4c8e-ba29-babc5653e2cc" status: 200 len: 1544 microversion: 2.1 time: 0.212936 Apr 11 19:55:58 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 362/1105] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 19:55:58 2023] GET /compute/v2.1/servers/52298792-b22d-4c8e-ba29-babc5653e2cc => generated 1544 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:55:58 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [req-28c5c1d1-3ff7-4fae-864c-432b90c9b261 req-a167af2e-373a-4f19-b1c8-61886ac7a716 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "52298792-b22d-4c8e-ba29-babc5653e2cc", "name": "network-vif-unplugged", "status": "completed", "tag": "32c90c1c-3212-4427-a38d-f505443bf260"}]} {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:55:58 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-28c5c1d1-3ff7-4fae-864c-432b90c9b261 req-a167af2e-373a-4f19-b1c8-61886ac7a716 service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:55:58 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-28c5c1d1-3ff7-4fae-864c-432b90c9b261 req-a167af2e-373a-4f19-b1c8-61886ac7a716 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:55:58 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-28c5c1d1-3ff7-4fae-864c-432b90c9b261 req-a167af2e-373a-4f19-b1c8-61886ac7a716 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:55:58 user devstack@n-api.service[72089]: INFO nova.api.openstack.compute.server_external_events [req-28c5c1d1-3ff7-4fae-864c-432b90c9b261 req-a167af2e-373a-4f19-b1c8-61886ac7a716 service nova] Creating event network-vif-unplugged:32c90c1c-3212-4427-a38d-f505443bf260 for instance 52298792-b22d-4c8e-ba29-babc5653e2cc on user Apr 11 19:55:58 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [req-28c5c1d1-3ff7-4fae-864c-432b90c9b261 req-a167af2e-373a-4f19-b1c8-61886ac7a716 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036151 Apr 11 19:55:58 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 377/1106] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:55:58 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:56:00 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [req-90d10586-72ab-47ce-9204-9c986a4ffc2d req-0c1e3c89-17ed-49ca-bbaf-41f2c9266838 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "52298792-b22d-4c8e-ba29-babc5653e2cc", "name": "network-vif-plugged", "status": "completed", "tag": "32c90c1c-3212-4427-a38d-f505443bf260"}, {"server_uuid": "52298792-b22d-4c8e-ba29-babc5653e2cc", "name": "network-vif-deleted", "tag": "32c90c1c-3212-4427-a38d-f505443bf260"}]} {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:56:00 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-90d10586-72ab-47ce-9204-9c986a4ffc2d req-0c1e3c89-17ed-49ca-bbaf-41f2c9266838 service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:56:00 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-90d10586-72ab-47ce-9204-9c986a4ffc2d req-0c1e3c89-17ed-49ca-bbaf-41f2c9266838 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:56:00 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-90d10586-72ab-47ce-9204-9c986a4ffc2d req-0c1e3c89-17ed-49ca-bbaf-41f2c9266838 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:56:00 user devstack@n-api.service[72090]: INFO nova.api.openstack.compute.server_external_events [req-90d10586-72ab-47ce-9204-9c986a4ffc2d req-0c1e3c89-17ed-49ca-bbaf-41f2c9266838 service nova] Creating event network-vif-plugged:32c90c1c-3212-4427-a38d-f505443bf260 for instance 52298792-b22d-4c8e-ba29-babc5653e2cc on user Apr 11 19:56:00 user devstack@n-api.service[72090]: INFO nova.api.openstack.compute.server_external_events [req-90d10586-72ab-47ce-9204-9c986a4ffc2d req-0c1e3c89-17ed-49ca-bbaf-41f2c9266838 service nova] Creating event network-vif-deleted:32c90c1c-3212-4427-a38d-f505443bf260 for instance 52298792-b22d-4c8e-ba29-babc5653e2cc on user Apr 11 19:56:00 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [req-90d10586-72ab-47ce-9204-9c986a4ffc2d req-0c1e3c89-17ed-49ca-bbaf-41f2c9266838 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.030651 Apr 11 19:56:00 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 368/1107] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:56:00 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:56:48 user devstack@n-api.service[72088]: ERROR oslo.messaging._drivers.impl_rabbit [-] [37953f4a-6990-464c-80d9-520500f9582d] AMQP server on 10.0.0.210:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 11 19:56:48 user devstack@n-api.service[72088]: DEBUG dbcounter [-] [72088] Writing DB stats nova_api:SELECT=4 {{(pid=72088) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:56:48 user devstack@n-api.service[72088]: DEBUG dbcounter [-] [72088] Writing DB stats nova_cell1:SELECT=12 {{(pid=72088) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:56:48 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [None req-5f45565c-2ab6-4e5e-9d77-46f3dab81cc8 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Calling method '>' {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:56:48 user devstack@n-api.service[72088]: DEBUG nova.compute.api [None req-5f45565c-2ab6-4e5e-9d77-46f3dab81cc8 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] [instance: 52298792-b22d-4c8e-ba29-babc5653e2cc] Fetching instance by UUID {{(pid=72088) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:56:48 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-5f45565c-2ab6-4e5e-9d77-46f3dab81cc8 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:56:48 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-5f45565c-2ab6-4e5e-9d77-46f3dab81cc8 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:56:48 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-5f45565c-2ab6-4e5e-9d77-46f3dab81cc8 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:56:48 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-5f45565c-2ab6-4e5e-9d77-46f3dab81cc8 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:56:48 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-5f45565c-2ab6-4e5e-9d77-46f3dab81cc8 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:56:48 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-5f45565c-2ab6-4e5e-9d77-46f3dab81cc8 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:56:48 user devstack@n-api.service[72088]: INFO nova.api.openstack.wsgi [None req-5f45565c-2ab6-4e5e-9d77-46f3dab81cc8 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] HTTP exception thrown: Instance 52298792-b22d-4c8e-ba29-babc5653e2cc could not be found. Apr 11 19:56:48 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [None req-5f45565c-2ab6-4e5e-9d77-46f3dab81cc8 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Request method failure captured: Apr 11 19:56:48 user devstack@n-api.service[72088]: request: GET /compute/v2.1/servers/52298792-b22d-4c8e-ba29-babc5653e2cc HTTP/1.1 Apr 11 19:56:48 user devstack@n-api.service[72088]: Accept: application/json Apr 11 19:56:48 user devstack@n-api.service[72088]: Accept-Encoding: identity Apr 11 19:56:48 user devstack@n-api.service[72088]: Connection: close Apr 11 19:56:48 user devstack@n-api.service[72088]: Content-Length: 0 Apr 11 19:56:48 user devstack@n-api.service[72088]: Content-Type: application/json Apr 11 19:56:48 user devstack@n-api.service[72088]: Host: 10.0.0.210 Apr 11 19:56:48 user devstack@n-api.service[72088]: Openstack-System-Scope: None Apr 11 19:56:48 user devstack@n-api.service[72088]: User-Agent: python-urllib3/1.26.15 Apr 11 19:56:48 user devstack@n-api.service[72088]: X-Auth-Token: gAAAAABkNboi_g8bsRhtx8uaOa5NWTf4uxnOLtVcon7BuOvG4wwTk-gCtYgZk-W-EpML2K-XvGIiaXLcQATSJp7kx203_AqQj-mT36BIS4okttmIUV_Cpre-05H_v5q-f1j-VDoVyV8P9rncakZQzBmdXgp-4Pcbg0qPnqEsmlb5AUO9F8sYDKU Apr 11 19:56:48 user devstack@n-api.service[72088]: X-Domain-Id: None Apr 11 19:56:48 user devstack@n-api.service[72088]: X-Domain-Name: None Apr 11 19:56:48 user devstack@n-api.service[72088]: X-Identity-Status: Confirmed Apr 11 19:56:48 user devstack@n-api.service[72088]: X-Is-Admin-Project: True Apr 11 19:56:48 user devstack@n-api.service[72088]: X-Project-Domain-Id: default Apr 11 19:56:48 user devstack@n-api.service[72088]: X-Project-Domain-Name: Default Apr 11 19:56:48 user devstack@n-api.service[72088]: X-Project-Id: ae5919e23c6a4c54b3a05a422c232c9f Apr 11 19:56:48 user devstack@n-api.service[72088]: X-Project-Name: tempest-TestMinimumBasicScenario-1332908423 Apr 11 19:56:48 user devstack@n-api.service[72088]: X-Role: reader,member Apr 11 19:56:48 user devstack@n-api.service[72088]: X-Roles: reader,member Apr 11 19:56:48 user devstack@n-api.service[72088]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ae5919e23c6a4c54b3a05a422c232c9f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/ae5919e23c6a4c54b3a05a422c232c9f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ae5919e23c6a4c54b3a05a422c232c9f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 11 19:56:48 user devstack@n-api.service[72088]: X-Tenant: tempest-TestMinimumBasicScenario-1332908423 Apr 11 19:56:48 user devstack@n-api.service[72088]: X-Tenant-Id: ae5919e23c6a4c54b3a05a422c232c9f Apr 11 19:56:48 user devstack@n-api.service[72088]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1332908423 Apr 11 19:56:48 user devstack@n-api.service[72088]: X-User: tempest-TestMinimumBasicScenario-1332908423-project-member Apr 11 19:56:48 user devstack@n-api.service[72088]: X-User-Domain-Id: default Apr 11 19:56:48 user devstack@n-api.service[72088]: X-User-Domain-Name: Default Apr 11 19:56:48 user devstack@n-api.service[72088]: X-User-Id: 2fbfa8948ce64dff92344749d2f0f0c7 Apr 11 19:56:48 user devstack@n-api.service[72088]: X-User-Name: tempest-TestMinimumBasicScenario-1332908423-project-member Apr 11 19:56:48 user devstack@n-api.service[72088]: method: > Apr 11 19:56:48 user devstack@n-api.service[72088]: exception: Instance 52298792-b22d-4c8e-ba29-babc5653e2cc could not be found. Apr 11 19:56:48 user devstack@n-api.service[72088]: action_args: {'id': '52298792-b22d-4c8e-ba29-babc5653e2cc'} Apr 11 19:56:48 user devstack@n-api.service[72088]: {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 19:56:48 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:56:48 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 19:56:48 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 19:56:48 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 19:56:48 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 19:56:48 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 19:56:48 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 19:56:48 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 19:56:48 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 19:56:48 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 52298792-b22d-4c8e-ba29-babc5653e2cc could not be found. Apr 11 19:56:48 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi Apr 11 19:56:48 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 19:56:48 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi Apr 11 19:56:48 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:56:48 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 19:56:48 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 19:56:48 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 19:56:48 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 19:56:48 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 19:56:48 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 19:56:48 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 19:56:48 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 19:56:48 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 19:56:48 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 19:56:48 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 19:56:48 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 19:56:48 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 52298792-b22d-4c8e-ba29-babc5653e2cc could not be found. Apr 11 19:56:48 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi Apr 11 19:56:48 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 19:56:48 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi Apr 11 19:56:48 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 19:56:48 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 19:56:48 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 19:56:48 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 19:56:48 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 19:56:48 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 52298792-b22d-4c8e-ba29-babc5653e2cc could not be found. Apr 11 19:56:48 user devstack@n-api.service[72088]: ERROR nova.api.openstack.wsgi Apr 11 19:56:48 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [None req-5f45565c-2ab6-4e5e-9d77-46f3dab81cc8 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Returning 404 to user: Instance 52298792-b22d-4c8e-ba29-babc5653e2cc could not be found. {{(pid=72088) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 19:56:48 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [None req-5f45565c-2ab6-4e5e-9d77-46f3dab81cc8 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] 10.0.0.210 "GET /compute/v2.1/servers/52298792-b22d-4c8e-ba29-babc5653e2cc" status: 404 len: 111 microversion: 2.1 time: 0.154667 Apr 11 19:56:48 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 363/1108] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 19:56:48 2023] GET /compute/v2.1/servers/52298792-b22d-4c8e-ba29-babc5653e2cc => generated 111 bytes in 156 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 19:56:48 user devstack@n-api.service[72089]: DEBUG dbcounter [-] [72089] Writing DB stats nova_api:SELECT=4 {{(pid=72089) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:56:48 user devstack@n-api.service[72089]: DEBUG dbcounter [-] [72089] Writing DB stats nova_cell1:SELECT=8 {{(pid=72089) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:56:48 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [None req-d34cef2f-7060-47cf-8dc3-5e2ff328f3b1 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Calling method '.version_select at 0x7f119db74c10>' {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:56:48 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [None req-d34cef2f-7060-47cf-8dc3-5e2ff328f3b1 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1152467569" status: 202 len: 0 microversion: 2.1 time: 0.035676 Apr 11 19:56:48 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 378/1109] 10.0.0.210 () {62 vars in 1349 bytes} [Tue Apr 11 19:56:48 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1152467569 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 19:56:50 user devstack@n-api.service[72090]: DEBUG dbcounter [-] [72090] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=72090) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:56:50 user devstack@n-api.service[72090]: DEBUG dbcounter [-] [72090] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=72090) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:56:50 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [None req-ed50822d-f6ad-4cbb-9ac5-868a6155b566 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Action: 'create', calling method: .version_select at 0x7f119d989750>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1895527350", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLbBwZ4GED/tTw/bbYuLWx68FYgHHI5pQQLV1hYCUXSN7QLH6wpR4oKsETXcDq2hZfJmOMdySw0MmRduWvVkMii4pov1h0+m5OkFJ3s0PNpmsF4cBTTyXZMkUmqmxUrOJw=="}} {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:56:50 user devstack@n-api.service[72090]: DEBUG nova.quota [None req-ed50822d-f6ad-4cbb-9ac5-868a6155b566 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Getting quotas for project ae5919e23c6a4c54b3a05a422c232c9f. Resources: {'key_pairs'} {{(pid=72090) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 19:56:50 user devstack@n-api.service[72090]: DEBUG nova.quota [None req-ed50822d-f6ad-4cbb-9ac5-868a6155b566 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Getting quotas for user 2fbfa8948ce64dff92344749d2f0f0c7 and project ae5919e23c6a4c54b3a05a422c232c9f. Resources: {'key_pairs'} {{(pid=72090) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 19:56:50 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [None req-ed50822d-f6ad-4cbb-9ac5-868a6155b566 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.059911 Apr 11 19:56:50 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 369/1110] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Apr 11 19:56:50 2023] POST /compute/v2.1/os-keypairs => generated 403 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:56:51 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [None req-8cfa433f-eb53-4da3-9886-589e2ff7fa2b tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1999494387", "imageRef": "3da59beb-6b63-4e45-84d5-2bf5cf95f676", "flavorRef": "42", "key_name": "tempest-TestMinimumBasicScenario-1895527350", "networks": [{"uuid": "9d90c2b0-40f8-4911-a518-b03cdd738924"}]}} {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:56:51 user devstack@n-api.service[72088]: INFO oslo.messaging._drivers.impl_rabbit [-] [37953f4a-6990-464c-80d9-520500f9582d] Reconnected to AMQP server on 10.0.0.210:5672 via [amqp] client with port 54122. Apr 11 19:56:51 user devstack@n-api.service[72088]: DEBUG nova.network.neutron [None req-8cfa433f-eb53-4da3-9886-589e2ff7fa2b tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] validate_networks() for [('9d90c2b0-40f8-4911-a518-b03cdd738924', None, None, None, None, None)] {{(pid=72088) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 11 19:56:51 user devstack@n-api.service[72088]: DEBUG nova.virt.hardware [None req-8cfa433f-eb53-4da3-9886-589e2ff7fa2b tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Flavor limits 0:0:0 {{(pid=72088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 19:56:51 user devstack@n-api.service[72088]: DEBUG nova.virt.hardware [None req-8cfa433f-eb53-4da3-9886-589e2ff7fa2b tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Image limits 0:0:0 {{(pid=72088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 19:56:51 user devstack@n-api.service[72088]: DEBUG nova.virt.hardware [None req-8cfa433f-eb53-4da3-9886-589e2ff7fa2b tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Flavor pref 0:0:0 {{(pid=72088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 19:56:51 user devstack@n-api.service[72088]: DEBUG nova.virt.hardware [None req-8cfa433f-eb53-4da3-9886-589e2ff7fa2b tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Image pref 0:0:0 {{(pid=72088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 19:56:51 user devstack@n-api.service[72088]: DEBUG nova.virt.hardware [None req-8cfa433f-eb53-4da3-9886-589e2ff7fa2b tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 19:56:51 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-8cfa433f-eb53-4da3-9886-589e2ff7fa2b tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:56:51 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-8cfa433f-eb53-4da3-9886-589e2ff7fa2b tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:56:51 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-8cfa433f-eb53-4da3-9886-589e2ff7fa2b tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:56:51 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-8cfa433f-eb53-4da3-9886-589e2ff7fa2b tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:56:51 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-8cfa433f-eb53-4da3-9886-589e2ff7fa2b tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:56:51 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-8cfa433f-eb53-4da3-9886-589e2ff7fa2b tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:56:51 user devstack@n-api.service[72088]: DEBUG nova.quota [None req-8cfa433f-eb53-4da3-9886-589e2ff7fa2b tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Getting quotas for project ae5919e23c6a4c54b3a05a422c232c9f. Resources: {'ram', 'instances', 'cores'} {{(pid=72088) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 19:56:51 user devstack@n-api.service[72088]: DEBUG nova.quota [None req-8cfa433f-eb53-4da3-9886-589e2ff7fa2b tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Getting quotas for user 2fbfa8948ce64dff92344749d2f0f0c7 and project ae5919e23c6a4c54b3a05a422c232c9f. Resources: {'ram', 'instances', 'cores'} {{(pid=72088) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 19:56:51 user devstack@n-api.service[72088]: DEBUG nova.compute.api [None req-8cfa433f-eb53-4da3-9886-589e2ff7fa2b tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Going to run 1 instances... {{(pid=72088) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 11 19:56:51 user devstack@n-api.service[72088]: DEBUG nova.compute.api [None req-8cfa433f-eb53-4da3-9886-589e2ff7fa2b tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] [instance: 0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3da59beb-6b63-4e45-84d5-2bf5cf95f676',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=72088) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 11 19:56:51 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [None req-8cfa433f-eb53-4da3-9886-589e2ff7fa2b tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.657198 Apr 11 19:56:51 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 364/1111] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 11 19:56:51 2023] POST /compute/v2.1/servers => generated 378 bytes in 659 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 11 19:56:51 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [None req-8a1a1e40-92f8-4266-b772-95d0f2e7121a tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Calling method '>' {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:56:51 user devstack@n-api.service[72089]: DEBUG nova.compute.api [None req-8a1a1e40-92f8-4266-b772-95d0f2e7121a tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] [instance: 0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4] Fetching instance by UUID {{(pid=72089) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:56:51 user devstack@n-api.service[72089]: DEBUG nova.policy [None req-8a1a1e40-92f8-4266-b772-95d0f2e7121a tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fbfa8948ce64dff92344749d2f0f0c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5919e23c6a4c54b3a05a422c232c9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72089) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:56:51 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [None req-8a1a1e40-92f8-4266-b772-95d0f2e7121a tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4" status: 200 len: 1253 microversion: 2.1 time: 0.069600 Apr 11 19:56:51 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 379/1112] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 19:56:51 2023] GET /compute/v2.1/servers/0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4 => generated 1253 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:56:53 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [req-7caf5753-6adc-49b8-92ed-5d60ab3bee62 req-e3d9b11f-a016-484a-ba0c-7f0a8995495e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4", "tag": "90e5197f-3479-4c36-b5f9-b924ec023a53"}]} {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:56:53 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-7caf5753-6adc-49b8-92ed-5d60ab3bee62 req-e3d9b11f-a016-484a-ba0c-7f0a8995495e service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:56:53 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-7caf5753-6adc-49b8-92ed-5d60ab3bee62 req-e3d9b11f-a016-484a-ba0c-7f0a8995495e service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:56:53 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-7caf5753-6adc-49b8-92ed-5d60ab3bee62 req-e3d9b11f-a016-484a-ba0c-7f0a8995495e service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:56:53 user devstack@n-api.service[72090]: INFO nova.api.openstack.compute.server_external_events [req-7caf5753-6adc-49b8-92ed-5d60ab3bee62 req-e3d9b11f-a016-484a-ba0c-7f0a8995495e service nova] Creating event network-changed:90e5197f-3479-4c36-b5f9-b924ec023a53 for instance 0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4 on user Apr 11 19:56:53 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [req-7caf5753-6adc-49b8-92ed-5d60ab3bee62 req-e3d9b11f-a016-484a-ba0c-7f0a8995495e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035867 Apr 11 19:56:53 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 370/1113] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:56:53 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:56:56 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [req-61504779-6d8e-4aa7-9f25-05a2c1abcb3e req-55896521-d3a4-4cf7-9847-cde7ca5eee3b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4", "name": "network-vif-plugged", "status": "completed", "tag": "90e5197f-3479-4c36-b5f9-b924ec023a53"}]} {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:56:56 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-61504779-6d8e-4aa7-9f25-05a2c1abcb3e req-55896521-d3a4-4cf7-9847-cde7ca5eee3b service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:56:56 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-61504779-6d8e-4aa7-9f25-05a2c1abcb3e req-55896521-d3a4-4cf7-9847-cde7ca5eee3b service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:56:56 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-61504779-6d8e-4aa7-9f25-05a2c1abcb3e req-55896521-d3a4-4cf7-9847-cde7ca5eee3b service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:56:56 user devstack@n-api.service[72088]: INFO nova.api.openstack.compute.server_external_events [req-61504779-6d8e-4aa7-9f25-05a2c1abcb3e req-55896521-d3a4-4cf7-9847-cde7ca5eee3b service nova] Creating event network-vif-plugged:90e5197f-3479-4c36-b5f9-b924ec023a53 for instance 0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4 on user Apr 11 19:56:56 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [req-61504779-6d8e-4aa7-9f25-05a2c1abcb3e req-55896521-d3a4-4cf7-9847-cde7ca5eee3b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037445 Apr 11 19:56:56 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 365/1114] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:56:56 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:56:58 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [req-b5f3f01a-e2de-4667-8654-4257a508aefb req-7a7a258c-a166-4665-8984-f79b8ac7060e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4", "name": "network-vif-plugged", "status": "completed", "tag": "90e5197f-3479-4c36-b5f9-b924ec023a53"}]} {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:56:58 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-b5f3f01a-e2de-4667-8654-4257a508aefb req-7a7a258c-a166-4665-8984-f79b8ac7060e service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:56:58 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-b5f3f01a-e2de-4667-8654-4257a508aefb req-7a7a258c-a166-4665-8984-f79b8ac7060e service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:56:58 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-b5f3f01a-e2de-4667-8654-4257a508aefb req-7a7a258c-a166-4665-8984-f79b8ac7060e service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:56:58 user devstack@n-api.service[72089]: INFO nova.api.openstack.compute.server_external_events [req-b5f3f01a-e2de-4667-8654-4257a508aefb req-7a7a258c-a166-4665-8984-f79b8ac7060e service nova] Creating event network-vif-plugged:90e5197f-3479-4c36-b5f9-b924ec023a53 for instance 0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4 on user Apr 11 19:56:58 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [req-b5f3f01a-e2de-4667-8654-4257a508aefb req-7a7a258c-a166-4665-8984-f79b8ac7060e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033346 Apr 11 19:56:58 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 380/1115] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:56:58 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:57:41 user devstack@n-api.service[72090]: DEBUG dbcounter [-] [72090] Writing DB stats nova_cell0:SELECT=4 {{(pid=72090) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:57:41 user devstack@n-api.service[72090]: DEBUG dbcounter [-] [72090] Writing DB stats nova_api:SELECT=13,nova_api:INSERT=1 {{(pid=72090) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:57:41 user devstack@n-api.service[72090]: DEBUG dbcounter [-] [72090] Writing DB stats nova_cell1:SELECT=2 {{(pid=72090) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:57:41 user devstack@n-api.service[72090]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 11 19:57:41 user devstack@n-api.service[72090]: Tue Apr 11 19:57:41 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4 (ip 10.0.0.210) !!! Apr 11 19:57:41 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [None req-c302d4cc-9851-4677-a9ed-66ee137f2ac7 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Calling method '>' {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:57:41 user devstack@n-api.service[72090]: DEBUG nova.compute.api [None req-c302d4cc-9851-4677-a9ed-66ee137f2ac7 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] [instance: 0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4] Fetching instance by UUID {{(pid=72090) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:57:41 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-c302d4cc-9851-4677-a9ed-66ee137f2ac7 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:57:41 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-c302d4cc-9851-4677-a9ed-66ee137f2ac7 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:57:41 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-c302d4cc-9851-4677-a9ed-66ee137f2ac7 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:57:41 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-c302d4cc-9851-4677-a9ed-66ee137f2ac7 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:57:41 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-c302d4cc-9851-4677-a9ed-66ee137f2ac7 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:57:41 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-c302d4cc-9851-4677-a9ed-66ee137f2ac7 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:57:42 user devstack@n-api.service[72090]: DEBUG nova.policy [None req-c302d4cc-9851-4677-a9ed-66ee137f2ac7 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fbfa8948ce64dff92344749d2f0f0c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5919e23c6a4c54b3a05a422c232c9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72090) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:57:42 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [None req-c302d4cc-9851-4677-a9ed-66ee137f2ac7 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4" status: 200 len: 1538 microversion: 2.1 time: 0.224304 Apr 11 19:57:42 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 371/1116] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 19:57:41 2023] GET /compute/v2.1/servers/0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4 => generated 1538 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:58:42 user devstack@n-api.service[72088]: DEBUG dbcounter [-] [72088] Writing DB stats nova_cell0:SELECT=2 {{(pid=72088) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:58:42 user devstack@n-api.service[72088]: DEBUG dbcounter [-] [72088] Writing DB stats nova_cell0:SELECT=6 {{(pid=72088) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:58:42 user devstack@n-api.service[72088]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 11 19:58:42 user devstack@n-api.service[72088]: Tue Apr 11 19:58:42 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4 (ip 10.0.0.210) !!! Apr 11 19:58:42 user devstack@n-api.service[72088]: DEBUG dbcounter [-] [72088] Writing DB stats nova_api:SELECT=19,nova_api:INSERT=3 {{(pid=72088) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:58:42 user devstack@n-api.service[72088]: DEBUG dbcounter [-] [72088] Writing DB stats nova_cell1:SELECT=6 {{(pid=72088) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:58:42 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [None req-62ff12a7-6f24-400c-bf28-7917277a1b87 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Calling method '>' {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:58:42 user devstack@n-api.service[72088]: DEBUG nova.compute.api [None req-62ff12a7-6f24-400c-bf28-7917277a1b87 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] [instance: 0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4] Fetching instance by UUID {{(pid=72088) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:58:42 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-62ff12a7-6f24-400c-bf28-7917277a1b87 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:58:42 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-62ff12a7-6f24-400c-bf28-7917277a1b87 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:58:42 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-62ff12a7-6f24-400c-bf28-7917277a1b87 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:58:42 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-62ff12a7-6f24-400c-bf28-7917277a1b87 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:58:42 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-62ff12a7-6f24-400c-bf28-7917277a1b87 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:58:42 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-62ff12a7-6f24-400c-bf28-7917277a1b87 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:58:42 user devstack@n-api.service[72088]: DEBUG nova.policy [None req-62ff12a7-6f24-400c-bf28-7917277a1b87 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fbfa8948ce64dff92344749d2f0f0c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5919e23c6a4c54b3a05a422c232c9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72088) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:58:42 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [None req-62ff12a7-6f24-400c-bf28-7917277a1b87 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4" status: 200 len: 1538 microversion: 2.1 time: 0.218968 Apr 11 19:58:42 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 366/1117] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 19:58:42 2023] GET /compute/v2.1/servers/0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4 => generated 1538 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:58:42 user devstack@n-api.service[72089]: DEBUG dbcounter [-] [72089] Writing DB stats nova_cell0:SELECT=2 {{(pid=72089) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:58:42 user devstack@n-api.service[72089]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 11 19:58:42 user devstack@n-api.service[72089]: Tue Apr 11 19:58:42 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.0.0.210) !!! Apr 11 19:58:42 user devstack@n-api.service[72089]: DEBUG dbcounter [-] [72089] Writing DB stats nova_api:SELECT=9,nova_api:DELETE=1 {{(pid=72089) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:58:42 user devstack@n-api.service[72089]: DEBUG dbcounter [-] [72089] Writing DB stats nova_cell1:SELECT=2 {{(pid=72089) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:58:42 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [None req-ef12624f-28ea-4b89-b0e3-d736c1e046e9 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Calling method '>' {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:58:42 user devstack@n-api.service[72089]: DEBUG nova.policy [None req-ef12624f-28ea-4b89-b0e3-d736c1e046e9 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2fbfa8948ce64dff92344749d2f0f0c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5919e23c6a4c54b3a05a422c232c9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72089) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:58:42 user devstack@n-api.service[72089]: DEBUG nova.compute.api [None req-ef12624f-28ea-4b89-b0e3-d736c1e046e9 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Searching by: {'deleted': False, 'project_id': 'ae5919e23c6a4c54b3a05a422c232c9f'} {{(pid=72089) get_all /opt/stack/nova/nova/compute/api.py:3019}} Apr 11 19:58:42 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-ef12624f-28ea-4b89-b0e3-d736c1e046e9 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:58:42 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-ef12624f-28ea-4b89-b0e3-d736c1e046e9 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:58:42 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-ef12624f-28ea-4b89-b0e3-d736c1e046e9 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:58:42 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-ef12624f-28ea-4b89-b0e3-d736c1e046e9 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:58:42 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-ef12624f-28ea-4b89-b0e3-d736c1e046e9 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:58:42 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-ef12624f-28ea-4b89-b0e3-d736c1e046e9 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:58:42 user devstack@n-api.service[72089]: DEBUG nova.compute.multi_cell_list [None req-ef12624f-28ea-4b89-b0e3-d736c1e046e9 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=72089) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Apr 11 19:58:42 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [None req-ef12624f-28ea-4b89-b0e3-d736c1e046e9 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] 10.0.0.210 "GET /compute/v2.1/servers" status: 200 len: 341 microversion: 2.1 time: 0.182664 Apr 11 19:58:42 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 381/1118] 10.0.0.210 () {62 vars in 1202 bytes} [Tue Apr 11 19:58:42 2023] GET /compute/v2.1/servers => generated 341 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:58:42 user devstack@n-api.service[72090]: DEBUG dbcounter [-] [72090] Writing DB stats nova_api:SELECT=2 {{(pid=72090) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:58:42 user devstack@n-api.service[72090]: DEBUG dbcounter [-] [72090] Writing DB stats nova_cell1:SELECT=6 {{(pid=72090) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:58:42 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [None req-d43a18bb-7187-4d21-81a7-eb5af3c88b19 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Calling method '>' {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:58:42 user devstack@n-api.service[72090]: DEBUG nova.compute.api [None req-d43a18bb-7187-4d21-81a7-eb5af3c88b19 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] [instance: 0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4] Fetching instance by UUID {{(pid=72090) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:58:42 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-d43a18bb-7187-4d21-81a7-eb5af3c88b19 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:58:42 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-d43a18bb-7187-4d21-81a7-eb5af3c88b19 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:58:42 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-d43a18bb-7187-4d21-81a7-eb5af3c88b19 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:58:42 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-d43a18bb-7187-4d21-81a7-eb5af3c88b19 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:58:42 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-d43a18bb-7187-4d21-81a7-eb5af3c88b19 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:58:42 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-d43a18bb-7187-4d21-81a7-eb5af3c88b19 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:58:42 user devstack@n-api.service[72090]: DEBUG nova.policy [None req-d43a18bb-7187-4d21-81a7-eb5af3c88b19 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fbfa8948ce64dff92344749d2f0f0c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5919e23c6a4c54b3a05a422c232c9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72090) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:58:42 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [None req-d43a18bb-7187-4d21-81a7-eb5af3c88b19 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4" status: 200 len: 1538 microversion: 2.1 time: 0.167809 Apr 11 19:58:42 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 372/1119] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 19:58:42 2023] GET /compute/v2.1/servers/0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4 => generated 1538 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:58:44 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [None req-639af96f-876e-467c-a31e-aca4b01c6709 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a85f292d-3b39-4c88-9675-3953235146c9"}} {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:58:44 user devstack@n-api.service[72088]: DEBUG nova.compute.api [None req-639af96f-876e-467c-a31e-aca4b01c6709 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] [instance: 0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4] Fetching instance by UUID {{(pid=72088) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:58:44 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-639af96f-876e-467c-a31e-aca4b01c6709 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:58:44 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-639af96f-876e-467c-a31e-aca4b01c6709 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:58:44 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-639af96f-876e-467c-a31e-aca4b01c6709 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:58:44 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-639af96f-876e-467c-a31e-aca4b01c6709 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:58:44 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-639af96f-876e-467c-a31e-aca4b01c6709 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:58:44 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-639af96f-876e-467c-a31e-aca4b01c6709 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:58:44 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [None req-639af96f-876e-467c-a31e-aca4b01c6709 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] 10.0.0.210 "POST /compute/v2.1/servers/0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.300352 Apr 11 19:58:44 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 367/1120] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Apr 11 19:58:44 2023] POST /compute/v2.1/servers/0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4/os-volume_attachments => generated 194 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:58:51 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [None req-2f992f89-19b9-4e25-9716-d06c29e278c5 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Calling method '>' {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:58:51 user devstack@n-api.service[72089]: DEBUG nova.compute.api [None req-2f992f89-19b9-4e25-9716-d06c29e278c5 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] [instance: 0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4] Fetching instance by UUID {{(pid=72089) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:58:51 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-2f992f89-19b9-4e25-9716-d06c29e278c5 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:58:51 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-2f992f89-19b9-4e25-9716-d06c29e278c5 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:58:51 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-2f992f89-19b9-4e25-9716-d06c29e278c5 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:58:51 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-2f992f89-19b9-4e25-9716-d06c29e278c5 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:58:51 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-2f992f89-19b9-4e25-9716-d06c29e278c5 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:58:51 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-2f992f89-19b9-4e25-9716-d06c29e278c5 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:58:51 user devstack@n-api.service[72089]: DEBUG nova.policy [None req-2f992f89-19b9-4e25-9716-d06c29e278c5 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fbfa8948ce64dff92344749d2f0f0c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5919e23c6a4c54b3a05a422c232c9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72089) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:58:51 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [None req-2f992f89-19b9-4e25-9716-d06c29e278c5 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4" status: 200 len: 1584 microversion: 2.1 time: 0.210912 Apr 11 19:58:51 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 382/1121] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 19:58:51 2023] GET /compute/v2.1/servers/0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4 => generated 1584 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:58:52 user devstack@n-api.service[72090]: DEBUG dbcounter [-] [72090] Writing DB stats nova_api:SELECT=2 {{(pid=72090) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:58:52 user devstack@n-api.service[72090]: DEBUG dbcounter [-] [72090] Writing DB stats nova_cell1:SELECT=6 {{(pid=72090) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:58:52 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [req-4ca7c475-67c3-468e-9a29-0d0d0fa1e620 req-282c8bed-224a-44d0-811e-e78cbb907287 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4", "tag": "90e5197f-3479-4c36-b5f9-b924ec023a53"}]} {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:58:52 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-4ca7c475-67c3-468e-9a29-0d0d0fa1e620 req-282c8bed-224a-44d0-811e-e78cbb907287 service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:58:52 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-4ca7c475-67c3-468e-9a29-0d0d0fa1e620 req-282c8bed-224a-44d0-811e-e78cbb907287 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:58:52 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-4ca7c475-67c3-468e-9a29-0d0d0fa1e620 req-282c8bed-224a-44d0-811e-e78cbb907287 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:58:52 user devstack@n-api.service[72090]: INFO nova.api.openstack.compute.server_external_events [req-4ca7c475-67c3-468e-9a29-0d0d0fa1e620 req-282c8bed-224a-44d0-811e-e78cbb907287 service nova] Creating event network-changed:90e5197f-3479-4c36-b5f9-b924ec023a53 for instance 0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4 on user Apr 11 19:58:52 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [req-4ca7c475-67c3-468e-9a29-0d0d0fa1e620 req-282c8bed-224a-44d0-811e-e78cbb907287 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098933 Apr 11 19:58:52 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 373/1122] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:58:52 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:58:54 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [None req-5fe96a45-2087-4317-a314-5098b79d508f tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1481550930"}} {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:58:54 user devstack@n-api.service[72088]: DEBUG nova.compute.api [None req-5fe96a45-2087-4317-a314-5098b79d508f tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] [instance: 0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4] Fetching instance by UUID {{(pid=72088) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:58:54 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-5fe96a45-2087-4317-a314-5098b79d508f tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:58:54 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-5fe96a45-2087-4317-a314-5098b79d508f tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:58:54 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-5fe96a45-2087-4317-a314-5098b79d508f tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:58:54 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-5fe96a45-2087-4317-a314-5098b79d508f tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:58:54 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-5fe96a45-2087-4317-a314-5098b79d508f tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:58:54 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-5fe96a45-2087-4317-a314-5098b79d508f tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:58:54 user devstack@n-api.service[72088]: INFO nova.network.security_group_api [None req-5fe96a45-2087-4317-a314-5098b79d508f tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Adding security group a50f7a6e-1dec-4d68-8f5c-b9e4b138a621 to port 90e5197f-3479-4c36-b5f9-b924ec023a53 Apr 11 19:58:55 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [None req-5fe96a45-2087-4317-a314-5098b79d508f tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] 10.0.0.210 "POST /compute/v2.1/servers/0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4/action" status: 202 len: 0 microversion: 2.1 time: 0.874618 Apr 11 19:58:55 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 368/1123] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Apr 11 19:58:54 2023] POST /compute/v2.1/servers/0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4/action => generated 0 bytes in 876 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 19:58:55 user devstack@n-api.service[72089]: DEBUG dbcounter [-] [72089] Writing DB stats nova_cell0:SELECT=2 {{(pid=72089) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:58:55 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [None req-e4fe47c7-4b72-495b-a028-8de1d399c614 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Calling method '>' {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:58:55 user devstack@n-api.service[72090]: DEBUG nova.compute.api [None req-e4fe47c7-4b72-495b-a028-8de1d399c614 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] [instance: 0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4] Fetching instance by UUID {{(pid=72090) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:58:55 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-e4fe47c7-4b72-495b-a028-8de1d399c614 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:58:55 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-e4fe47c7-4b72-495b-a028-8de1d399c614 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:58:55 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-e4fe47c7-4b72-495b-a028-8de1d399c614 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:58:55 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-e4fe47c7-4b72-495b-a028-8de1d399c614 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:58:55 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-e4fe47c7-4b72-495b-a028-8de1d399c614 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:58:55 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-e4fe47c7-4b72-495b-a028-8de1d399c614 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:58:55 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [req-aa141e0b-27f4-4107-bd15-ada71a70ea81 req-f8b16f7c-3e88-4539-a3cf-fa560cf5b184 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4", "tag": "90e5197f-3479-4c36-b5f9-b924ec023a53"}]} {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:58:55 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-aa141e0b-27f4-4107-bd15-ada71a70ea81 req-f8b16f7c-3e88-4539-a3cf-fa560cf5b184 service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:58:55 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-aa141e0b-27f4-4107-bd15-ada71a70ea81 req-f8b16f7c-3e88-4539-a3cf-fa560cf5b184 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:58:55 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-aa141e0b-27f4-4107-bd15-ada71a70ea81 req-f8b16f7c-3e88-4539-a3cf-fa560cf5b184 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:58:55 user devstack@n-api.service[72089]: INFO nova.api.openstack.compute.server_external_events [req-aa141e0b-27f4-4107-bd15-ada71a70ea81 req-f8b16f7c-3e88-4539-a3cf-fa560cf5b184 service nova] Creating event network-changed:90e5197f-3479-4c36-b5f9-b924ec023a53 for instance 0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4 on user Apr 11 19:58:55 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [req-aa141e0b-27f4-4107-bd15-ada71a70ea81 req-f8b16f7c-3e88-4539-a3cf-fa560cf5b184 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079900 Apr 11 19:58:55 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 383/1124] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:58:55 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:58:55 user devstack@n-api.service[72090]: DEBUG nova.policy [None req-e4fe47c7-4b72-495b-a028-8de1d399c614 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fbfa8948ce64dff92344749d2f0f0c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5919e23c6a4c54b3a05a422c232c9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72090) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:58:55 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [None req-e4fe47c7-4b72-495b-a028-8de1d399c614 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4" status: 200 len: 1749 microversion: 2.1 time: 0.170659 Apr 11 19:58:55 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 374/1125] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 19:58:55 2023] GET /compute/v2.1/servers/0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4 => generated 1749 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:58:55 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [None req-60509050-b496-4a3b-92bd-3410e03b0cdd tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:58:55 user devstack@n-api.service[72088]: DEBUG nova.compute.api [None req-60509050-b496-4a3b-92bd-3410e03b0cdd tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] [instance: 0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4] Fetching instance by UUID {{(pid=72088) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:58:55 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-60509050-b496-4a3b-92bd-3410e03b0cdd tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:58:55 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-60509050-b496-4a3b-92bd-3410e03b0cdd tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:58:55 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-60509050-b496-4a3b-92bd-3410e03b0cdd tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:58:55 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-60509050-b496-4a3b-92bd-3410e03b0cdd tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:58:55 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-60509050-b496-4a3b-92bd-3410e03b0cdd tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:58:55 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-60509050-b496-4a3b-92bd-3410e03b0cdd tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:58:55 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [None req-60509050-b496-4a3b-92bd-3410e03b0cdd tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] 10.0.0.210 "POST /compute/v2.1/servers/0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4/action" status: 202 len: 0 microversion: 2.1 time: 0.080889 Apr 11 19:58:55 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 369/1126] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Apr 11 19:58:55 2023] POST /compute/v2.1/servers/0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4/action => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 19:58:55 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [None req-3647543f-3e67-4f61-9423-246da7d81dcd tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Calling method '>' {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:58:55 user devstack@n-api.service[72089]: DEBUG nova.compute.api [None req-3647543f-3e67-4f61-9423-246da7d81dcd tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] [instance: 0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4] Fetching instance by UUID {{(pid=72089) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:58:55 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-3647543f-3e67-4f61-9423-246da7d81dcd tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:58:55 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-3647543f-3e67-4f61-9423-246da7d81dcd tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:58:55 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-3647543f-3e67-4f61-9423-246da7d81dcd tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:58:55 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-3647543f-3e67-4f61-9423-246da7d81dcd tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:58:55 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-3647543f-3e67-4f61-9423-246da7d81dcd tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:58:55 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-3647543f-3e67-4f61-9423-246da7d81dcd tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:58:55 user devstack@n-api.service[72089]: DEBUG nova.policy [None req-3647543f-3e67-4f61-9423-246da7d81dcd tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fbfa8948ce64dff92344749d2f0f0c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5919e23c6a4c54b3a05a422c232c9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72089) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:58:55 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [None req-3647543f-3e67-4f61-9423-246da7d81dcd tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4" status: 200 len: 1741 microversion: 2.1 time: 0.150892 Apr 11 19:58:55 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 384/1127] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 19:58:55 2023] GET /compute/v2.1/servers/0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4 => generated 1741 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:58:58 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [req-7067bdc6-cd32-4e78-855e-873a68ff4983 req-5b48bb2a-63b5-4726-9826-ca1e2dfdd007 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4", "name": "network-vif-unplugged", "status": "completed", "tag": "90e5197f-3479-4c36-b5f9-b924ec023a53"}]} {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:58:58 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-7067bdc6-cd32-4e78-855e-873a68ff4983 req-5b48bb2a-63b5-4726-9826-ca1e2dfdd007 service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:58:58 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-7067bdc6-cd32-4e78-855e-873a68ff4983 req-5b48bb2a-63b5-4726-9826-ca1e2dfdd007 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:58:58 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-7067bdc6-cd32-4e78-855e-873a68ff4983 req-5b48bb2a-63b5-4726-9826-ca1e2dfdd007 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:58:58 user devstack@n-api.service[72090]: INFO nova.api.openstack.compute.server_external_events [req-7067bdc6-cd32-4e78-855e-873a68ff4983 req-5b48bb2a-63b5-4726-9826-ca1e2dfdd007 service nova] Creating event network-vif-unplugged:90e5197f-3479-4c36-b5f9-b924ec023a53 for instance 0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4 on user Apr 11 19:58:58 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [req-7067bdc6-cd32-4e78-855e-873a68ff4983 req-5b48bb2a-63b5-4726-9826-ca1e2dfdd007 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032323 Apr 11 19:58:58 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 375/1128] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:58:58 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:59:00 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [req-3cfd73b2-5bcb-4547-9c16-3b135fddb6cf req-b7472bc7-212b-4e45-b804-52cd8d9f61f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4", "name": "network-vif-plugged", "status": "completed", "tag": "90e5197f-3479-4c36-b5f9-b924ec023a53"}]} {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:59:00 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-3cfd73b2-5bcb-4547-9c16-3b135fddb6cf req-b7472bc7-212b-4e45-b804-52cd8d9f61f6 service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:59:00 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-3cfd73b2-5bcb-4547-9c16-3b135fddb6cf req-b7472bc7-212b-4e45-b804-52cd8d9f61f6 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:59:00 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-3cfd73b2-5bcb-4547-9c16-3b135fddb6cf req-b7472bc7-212b-4e45-b804-52cd8d9f61f6 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:59:00 user devstack@n-api.service[72088]: INFO nova.api.openstack.compute.server_external_events [req-3cfd73b2-5bcb-4547-9c16-3b135fddb6cf req-b7472bc7-212b-4e45-b804-52cd8d9f61f6 service nova] Creating event network-vif-plugged:90e5197f-3479-4c36-b5f9-b924ec023a53 for instance 0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4 on user Apr 11 19:59:00 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [req-3cfd73b2-5bcb-4547-9c16-3b135fddb6cf req-b7472bc7-212b-4e45-b804-52cd8d9f61f6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031926 Apr 11 19:59:00 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 370/1129] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:59:00 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:59:02 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [req-e26cf019-4452-4cb3-97a0-e8906e854fce req-826ffb16-a36d-4f9a-92d4-01714db6bef5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4", "name": "network-vif-plugged", "status": "completed", "tag": "90e5197f-3479-4c36-b5f9-b924ec023a53"}, {"server_uuid": "0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4", "name": "network-vif-plugged", "status": "completed", "tag": "90e5197f-3479-4c36-b5f9-b924ec023a53"}]} {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:59:02 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-e26cf019-4452-4cb3-97a0-e8906e854fce req-826ffb16-a36d-4f9a-92d4-01714db6bef5 service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:59:02 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-e26cf019-4452-4cb3-97a0-e8906e854fce req-826ffb16-a36d-4f9a-92d4-01714db6bef5 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:59:02 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-e26cf019-4452-4cb3-97a0-e8906e854fce req-826ffb16-a36d-4f9a-92d4-01714db6bef5 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:59:02 user devstack@n-api.service[72089]: INFO nova.api.openstack.compute.server_external_events [req-e26cf019-4452-4cb3-97a0-e8906e854fce req-826ffb16-a36d-4f9a-92d4-01714db6bef5 service nova] Creating event network-vif-plugged:90e5197f-3479-4c36-b5f9-b924ec023a53 for instance 0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4 on user Apr 11 19:59:02 user devstack@n-api.service[72089]: INFO nova.api.openstack.compute.server_external_events [req-e26cf019-4452-4cb3-97a0-e8906e854fce req-826ffb16-a36d-4f9a-92d4-01714db6bef5 service nova] Creating event network-vif-plugged:90e5197f-3479-4c36-b5f9-b924ec023a53 for instance 0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4 on user Apr 11 19:59:02 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [req-e26cf019-4452-4cb3-97a0-e8906e854fce req-826ffb16-a36d-4f9a-92d4-01714db6bef5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.035424 Apr 11 19:59:02 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 385/1130] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 19:59:02 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:59:45 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [None req-a1499f6a-201e-498c-b5b5-5564c31b1f87 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Calling method '>' {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:59:45 user devstack@n-api.service[72090]: DEBUG nova.compute.api [None req-a1499f6a-201e-498c-b5b5-5564c31b1f87 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] [instance: 0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4] Fetching instance by UUID {{(pid=72090) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 19:59:45 user devstack@n-api.service[72090]: DEBUG dbcounter [-] [72090] Writing DB stats nova_api:SELECT=6 {{(pid=72090) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:59:45 user devstack@n-api.service[72090]: DEBUG dbcounter [-] [72090] Writing DB stats nova_cell1:SELECT=10 {{(pid=72090) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 19:59:45 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-a1499f6a-201e-498c-b5b5-5564c31b1f87 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:59:45 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-a1499f6a-201e-498c-b5b5-5564c31b1f87 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:59:45 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-a1499f6a-201e-498c-b5b5-5564c31b1f87 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:59:45 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-a1499f6a-201e-498c-b5b5-5564c31b1f87 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 19:59:45 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-a1499f6a-201e-498c-b5b5-5564c31b1f87 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 19:59:45 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-a1499f6a-201e-498c-b5b5-5564c31b1f87 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 19:59:45 user devstack@n-api.service[72090]: DEBUG nova.policy [None req-a1499f6a-201e-498c-b5b5-5564c31b1f87 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fbfa8948ce64dff92344749d2f0f0c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5919e23c6a4c54b3a05a422c232c9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72090) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 19:59:45 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [None req-a1499f6a-201e-498c-b5b5-5564c31b1f87 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4" status: 200 len: 1749 microversion: 2.1 time: 0.173587 Apr 11 19:59:45 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 376/1131] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 19:59:45 2023] GET /compute/v2.1/servers/0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4 => generated 1749 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:00:45 user devstack@n-api.service[72088]: ERROR oslo.messaging._drivers.impl_rabbit [-] [37953f4a-6990-464c-80d9-520500f9582d] AMQP server on 10.0.0.210:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Apr 11 20:00:45 user devstack@n-api.service[72088]: DEBUG dbcounter [-] [72088] Writing DB stats nova_api:SELECT=10 {{(pid=72088) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:00:45 user devstack@n-api.service[72088]: DEBUG dbcounter [-] [72088] Writing DB stats nova_cell1:SELECT=34,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=72088) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:00:45 user devstack@n-api.service[72088]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 11 20:00:45 user devstack@n-api.service[72088]: Tue Apr 11 20:00:45 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4/action (ip 10.0.0.210) !!! Apr 11 20:00:45 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [None req-5a81ed5d-07e0-47c6-ab91-5da69a994dfd tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1481550930"}} {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:00:45 user devstack@n-api.service[72088]: DEBUG nova.compute.api [None req-5a81ed5d-07e0-47c6-ab91-5da69a994dfd tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] [instance: 0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4] Fetching instance by UUID {{(pid=72088) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:00:46 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-5a81ed5d-07e0-47c6-ab91-5da69a994dfd tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:00:46 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-5a81ed5d-07e0-47c6-ab91-5da69a994dfd tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:00:46 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-5a81ed5d-07e0-47c6-ab91-5da69a994dfd tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:00:46 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-5a81ed5d-07e0-47c6-ab91-5da69a994dfd tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:00:46 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-5a81ed5d-07e0-47c6-ab91-5da69a994dfd tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:00:46 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-5a81ed5d-07e0-47c6-ab91-5da69a994dfd tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:00:46 user devstack@n-api.service[72088]: INFO nova.network.security_group_api [None req-5a81ed5d-07e0-47c6-ab91-5da69a994dfd tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Removing security group a50f7a6e-1dec-4d68-8f5c-b9e4b138a621 from port 90e5197f-3479-4c36-b5f9-b924ec023a53 Apr 11 20:00:46 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [None req-5a81ed5d-07e0-47c6-ab91-5da69a994dfd tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] 10.0.0.210 "POST /compute/v2.1/servers/0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4/action" status: 202 len: 0 microversion: 2.1 time: 0.597582 Apr 11 20:00:46 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 371/1132] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Apr 11 20:00:45 2023] POST /compute/v2.1/servers/0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4/action => generated 0 bytes in 600 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 20:00:46 user devstack@n-api.service[72089]: DEBUG dbcounter [-] [72089] Writing DB stats nova_api:SELECT=10 {{(pid=72089) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:00:46 user devstack@n-api.service[72089]: DEBUG dbcounter [-] [72089] Writing DB stats nova_cell1:SELECT=24 {{(pid=72089) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:00:46 user devstack@n-api.service[72089]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 11 20:00:46 user devstack@n-api.service[72089]: Tue Apr 11 20:00:46 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.0.0.210) !!! Apr 11 20:00:46 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [req-7fb00eeb-2783-422e-8bf6-3ed70e65c57e req-cb47cdcd-7b15-4c85-89f9-aacfa621050f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4", "tag": "90e5197f-3479-4c36-b5f9-b924ec023a53"}]} {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:00:46 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-7fb00eeb-2783-422e-8bf6-3ed70e65c57e req-cb47cdcd-7b15-4c85-89f9-aacfa621050f service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:00:46 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-7fb00eeb-2783-422e-8bf6-3ed70e65c57e req-cb47cdcd-7b15-4c85-89f9-aacfa621050f service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:00:46 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-7fb00eeb-2783-422e-8bf6-3ed70e65c57e req-cb47cdcd-7b15-4c85-89f9-aacfa621050f service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:00:46 user devstack@n-api.service[72089]: INFO nova.api.openstack.compute.server_external_events [req-7fb00eeb-2783-422e-8bf6-3ed70e65c57e req-cb47cdcd-7b15-4c85-89f9-aacfa621050f service nova] Creating event network-changed:90e5197f-3479-4c36-b5f9-b924ec023a53 for instance 0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4 on user Apr 11 20:00:46 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [req-7fb00eeb-2783-422e-8bf6-3ed70e65c57e req-cb47cdcd-7b15-4c85-89f9-aacfa621050f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043169 Apr 11 20:00:46 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 386/1133] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 20:00:46 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:00:47 user devstack@n-api.service[72090]: DEBUG dbcounter [-] [72090] Writing DB stats nova_api:SELECT=2 {{(pid=72090) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:00:47 user devstack@n-api.service[72090]: DEBUG dbcounter [-] [72090] Writing DB stats nova_cell1:SELECT=6 {{(pid=72090) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:00:47 user devstack@n-api.service[72090]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 11 20:00:47 user devstack@n-api.service[72090]: Tue Apr 11 20:00:47 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4/os-volume_attachments/a85f292d-3b39-4c88-9675-3953235146c9 (ip 10.0.0.210) !!! Apr 11 20:00:47 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [None req-5a62c9d9-c4f3-42e4-a02e-0ffada1d643e tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Calling method '>' {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:00:47 user devstack@n-api.service[72090]: DEBUG nova.compute.api [None req-5a62c9d9-c4f3-42e4-a02e-0ffada1d643e tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] [instance: 0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4] Fetching instance by UUID {{(pid=72090) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:00:47 user devstack@n-api.service[72088]: INFO oslo.messaging._drivers.impl_rabbit [-] [37953f4a-6990-464c-80d9-520500f9582d] Reconnected to AMQP server on 10.0.0.210:5672 via [amqp] client with port 59018. Apr 11 20:00:47 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-5a62c9d9-c4f3-42e4-a02e-0ffada1d643e tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:00:47 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-5a62c9d9-c4f3-42e4-a02e-0ffada1d643e tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:00:47 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-5a62c9d9-c4f3-42e4-a02e-0ffada1d643e tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:00:47 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-5a62c9d9-c4f3-42e4-a02e-0ffada1d643e tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:00:47 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-5a62c9d9-c4f3-42e4-a02e-0ffada1d643e tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:00:47 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-5a62c9d9-c4f3-42e4-a02e-0ffada1d643e tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:00:47 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [req-56722b6d-e36d-49fc-96ba-c7b6ba4e7dd8 req-c2af5f62-0d3d-4fb1-a639-13ac4a93a249 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4", "tag": "90e5197f-3479-4c36-b5f9-b924ec023a53"}]} {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:00:47 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-56722b6d-e36d-49fc-96ba-c7b6ba4e7dd8 req-c2af5f62-0d3d-4fb1-a639-13ac4a93a249 service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:00:47 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-56722b6d-e36d-49fc-96ba-c7b6ba4e7dd8 req-c2af5f62-0d3d-4fb1-a639-13ac4a93a249 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:00:47 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-56722b6d-e36d-49fc-96ba-c7b6ba4e7dd8 req-c2af5f62-0d3d-4fb1-a639-13ac4a93a249 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:00:47 user devstack@n-api.service[72088]: INFO nova.api.openstack.compute.server_external_events [req-56722b6d-e36d-49fc-96ba-c7b6ba4e7dd8 req-c2af5f62-0d3d-4fb1-a639-13ac4a93a249 service nova] Creating event network-changed:90e5197f-3479-4c36-b5f9-b924ec023a53 for instance 0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4 on user Apr 11 20:00:47 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [req-56722b6d-e36d-49fc-96ba-c7b6ba4e7dd8 req-c2af5f62-0d3d-4fb1-a639-13ac4a93a249 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083975 Apr 11 20:00:47 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 372/1134] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 20:00:47 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:00:47 user devstack@n-api.service[72090]: DEBUG nova.objects.instance [None req-5a62c9d9-c4f3-42e4-a02e-0ffada1d643e tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Lazy-loading 'services' on Instance uuid 0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4 {{(pid=72090) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 11 20:00:47 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [None req-5a62c9d9-c4f3-42e4-a02e-0ffada1d643e tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4/os-volume_attachments/a85f292d-3b39-4c88-9675-3953235146c9" status: 202 len: 0 microversion: 2.1 time: 0.197690 Apr 11 20:00:47 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 377/1135] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Apr 11 20:00:47 2023] DELETE /compute/v2.1/servers/0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4/os-volume_attachments/a85f292d-3b39-4c88-9675-3953235146c9 => generated 0 bytes in 200 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 20:00:47 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [None req-cabe4f00-25b2-4bb6-baec-04e7b8b6b6f5 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Calling method '>' {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:00:47 user devstack@n-api.service[72089]: DEBUG nova.compute.api [None req-cabe4f00-25b2-4bb6-baec-04e7b8b6b6f5 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] [instance: 0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4] Fetching instance by UUID {{(pid=72089) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:00:47 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-cabe4f00-25b2-4bb6-baec-04e7b8b6b6f5 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:00:47 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-cabe4f00-25b2-4bb6-baec-04e7b8b6b6f5 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:00:47 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-cabe4f00-25b2-4bb6-baec-04e7b8b6b6f5 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:00:47 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-cabe4f00-25b2-4bb6-baec-04e7b8b6b6f5 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:00:47 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-cabe4f00-25b2-4bb6-baec-04e7b8b6b6f5 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:00:47 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-cabe4f00-25b2-4bb6-baec-04e7b8b6b6f5 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:00:47 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [None req-cabe4f00-25b2-4bb6-baec-04e7b8b6b6f5 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051472 Apr 11 20:00:47 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 387/1136] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Apr 11 20:00:47 2023] GET /compute/v2.1/servers/0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:01:37 user devstack@n-api.service[72088]: DEBUG dbcounter [-] [72088] Writing DB stats nova_api:SELECT=4 {{(pid=72088) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:01:37 user devstack@n-api.service[72088]: DEBUG dbcounter [-] [72088] Writing DB stats nova_cell1:SELECT=6 {{(pid=72088) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:01:37 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [None req-d638ad90-9af4-460f-962a-ddd4b3aec329 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Calling method '>' {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:01:37 user devstack@n-api.service[72088]: DEBUG nova.compute.api [None req-d638ad90-9af4-460f-962a-ddd4b3aec329 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] [instance: 0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4] Fetching instance by UUID {{(pid=72088) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:01:37 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-d638ad90-9af4-460f-962a-ddd4b3aec329 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:01:37 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-d638ad90-9af4-460f-962a-ddd4b3aec329 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:01:37 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-d638ad90-9af4-460f-962a-ddd4b3aec329 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:01:37 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-d638ad90-9af4-460f-962a-ddd4b3aec329 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:01:37 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-d638ad90-9af4-460f-962a-ddd4b3aec329 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:01:37 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-d638ad90-9af4-460f-962a-ddd4b3aec329 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:01:37 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [None req-d638ad90-9af4-460f-962a-ddd4b3aec329 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048428 Apr 11 20:01:37 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 373/1137] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Apr 11 20:01:37 2023] GET /compute/v2.1/servers/0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 11 20:01:37 user devstack@n-api.service[72090]: ERROR oslo.messaging._drivers.impl_rabbit [-] [49275a45-fc09-414a-ba1c-e5b694238aba] AMQP server on 10.0.0.210:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Apr 11 20:01:37 user devstack@n-api.service[72090]: DEBUG dbcounter [-] [72090] Writing DB stats nova_api:SELECT=2 {{(pid=72090) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:01:37 user devstack@n-api.service[72090]: DEBUG dbcounter [-] [72090] Writing DB stats nova_cell1:SELECT=9,nova_cell1:INSERT=1 {{(pid=72090) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:01:37 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [None req-e590437b-923d-4fee-ba33-c965fd57e10b tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Calling method '>' {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:01:37 user devstack@n-api.service[72090]: DEBUG nova.compute.api [None req-e590437b-923d-4fee-ba33-c965fd57e10b tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] [instance: 0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4] Fetching instance by UUID {{(pid=72090) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:01:37 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-e590437b-923d-4fee-ba33-c965fd57e10b tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:01:37 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-e590437b-923d-4fee-ba33-c965fd57e10b tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:01:37 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-e590437b-923d-4fee-ba33-c965fd57e10b tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:01:37 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-e590437b-923d-4fee-ba33-c965fd57e10b tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:01:37 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-e590437b-923d-4fee-ba33-c965fd57e10b tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:01:37 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-e590437b-923d-4fee-ba33-c965fd57e10b tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:01:37 user devstack@n-api.service[72090]: INFO nova.api.openstack.wsgi [None req-e590437b-923d-4fee-ba33-c965fd57e10b tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] HTTP exception thrown: Instance 0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4 is not attached to volume a85f292d-3b39-4c88-9675-3953235146c9 Apr 11 20:01:37 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [None req-e590437b-923d-4fee-ba33-c965fd57e10b tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Request method failure captured: Apr 11 20:01:37 user devstack@n-api.service[72090]: request: DELETE /compute/v2.1/servers/0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4/os-volume_attachments/a85f292d-3b39-4c88-9675-3953235146c9 HTTP/1.1 Apr 11 20:01:37 user devstack@n-api.service[72090]: Accept: application/json Apr 11 20:01:37 user devstack@n-api.service[72090]: Accept-Encoding: identity Apr 11 20:01:37 user devstack@n-api.service[72090]: Connection: close Apr 11 20:01:37 user devstack@n-api.service[72090]: Content-Length: 0 Apr 11 20:01:37 user devstack@n-api.service[72090]: Content-Type: application/json Apr 11 20:01:37 user devstack@n-api.service[72090]: Host: 10.0.0.210 Apr 11 20:01:37 user devstack@n-api.service[72090]: Openstack-System-Scope: None Apr 11 20:01:37 user devstack@n-api.service[72090]: User-Agent: python-urllib3/1.26.15 Apr 11 20:01:37 user devstack@n-api.service[72090]: X-Auth-Token: gAAAAABkNboi_g8bsRhtx8uaOa5NWTf4uxnOLtVcon7BuOvG4wwTk-gCtYgZk-W-EpML2K-XvGIiaXLcQATSJp7kx203_AqQj-mT36BIS4okttmIUV_Cpre-05H_v5q-f1j-VDoVyV8P9rncakZQzBmdXgp-4Pcbg0qPnqEsmlb5AUO9F8sYDKU Apr 11 20:01:37 user devstack@n-api.service[72090]: X-Domain-Id: None Apr 11 20:01:37 user devstack@n-api.service[72090]: X-Domain-Name: None Apr 11 20:01:37 user devstack@n-api.service[72090]: X-Identity-Status: Confirmed Apr 11 20:01:37 user devstack@n-api.service[72090]: X-Is-Admin-Project: True Apr 11 20:01:37 user devstack@n-api.service[72090]: X-Project-Domain-Id: default Apr 11 20:01:37 user devstack@n-api.service[72090]: X-Project-Domain-Name: Default Apr 11 20:01:37 user devstack@n-api.service[72090]: X-Project-Id: ae5919e23c6a4c54b3a05a422c232c9f Apr 11 20:01:37 user devstack@n-api.service[72090]: X-Project-Name: tempest-TestMinimumBasicScenario-1332908423 Apr 11 20:01:37 user devstack@n-api.service[72090]: X-Role: reader,member Apr 11 20:01:37 user devstack@n-api.service[72090]: X-Roles: reader,member Apr 11 20:01:37 user devstack@n-api.service[72090]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ae5919e23c6a4c54b3a05a422c232c9f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/ae5919e23c6a4c54b3a05a422c232c9f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ae5919e23c6a4c54b3a05a422c232c9f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 11 20:01:37 user devstack@n-api.service[72090]: X-Tenant: tempest-TestMinimumBasicScenario-1332908423 Apr 11 20:01:37 user devstack@n-api.service[72090]: X-Tenant-Id: ae5919e23c6a4c54b3a05a422c232c9f Apr 11 20:01:37 user devstack@n-api.service[72090]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1332908423 Apr 11 20:01:37 user devstack@n-api.service[72090]: X-User: tempest-TestMinimumBasicScenario-1332908423-project-member Apr 11 20:01:37 user devstack@n-api.service[72090]: X-User-Domain-Id: default Apr 11 20:01:37 user devstack@n-api.service[72090]: X-User-Domain-Name: Default Apr 11 20:01:37 user devstack@n-api.service[72090]: X-User-Id: 2fbfa8948ce64dff92344749d2f0f0c7 Apr 11 20:01:37 user devstack@n-api.service[72090]: X-User-Name: tempest-TestMinimumBasicScenario-1332908423-project-member Apr 11 20:01:37 user devstack@n-api.service[72090]: method: > Apr 11 20:01:37 user devstack@n-api.service[72090]: exception: Instance 0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4 is not attached to volume a85f292d-3b39-4c88-9675-3953235146c9 Apr 11 20:01:37 user devstack@n-api.service[72090]: action_args: {'server_id': '0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4', 'id': 'a85f292d-3b39-4c88-9675-3953235146c9'} Apr 11 20:01:37 user devstack@n-api.service[72090]: {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 20:01:37 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 20:01:37 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Apr 11 20:01:37 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Apr 11 20:01:37 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Apr 11 20:01:37 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Apr 11 20:01:37 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Apr 11 20:01:37 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Apr 11 20:01:37 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id a85f292d-3b39-4c88-9675-3953235146c9. Apr 11 20:01:37 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi Apr 11 20:01:37 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 20:01:37 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi Apr 11 20:01:37 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 20:01:37 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 20:01:37 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 20:01:37 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 20:01:37 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 20:01:37 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 20:01:37 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 20:01:37 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Apr 11 20:01:37 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Apr 11 20:01:37 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4 is not attached to volume a85f292d-3b39-4c88-9675-3953235146c9 Apr 11 20:01:37 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi Apr 11 20:01:37 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 20:01:37 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi Apr 11 20:01:37 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 20:01:37 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 20:01:37 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 20:01:37 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 20:01:37 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 20:01:38 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4 is not attached to volume a85f292d-3b39-4c88-9675-3953235146c9 Apr 11 20:01:38 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi Apr 11 20:01:38 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [None req-e590437b-923d-4fee-ba33-c965fd57e10b tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Returning 404 to user: Instance 0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4 is not attached to volume a85f292d-3b39-4c88-9675-3953235146c9 {{(pid=72090) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 20:01:38 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [None req-e590437b-923d-4fee-ba33-c965fd57e10b tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4/os-volume_attachments/a85f292d-3b39-4c88-9675-3953235146c9" status: 404 len: 154 microversion: 2.1 time: 0.107106 Apr 11 20:01:38 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 378/1138] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Apr 11 20:01:37 2023] DELETE /compute/v2.1/servers/0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4/os-volume_attachments/a85f292d-3b39-4c88-9675-3953235146c9 => generated 154 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 20:01:39 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [None req-480f3bec-d089-4014-b9a4-9f7359f8d74c tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Calling method '>' {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:01:39 user devstack@n-api.service[72089]: DEBUG nova.compute.api [None req-480f3bec-d089-4014-b9a4-9f7359f8d74c tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] [instance: 0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4] Fetching instance by UUID {{(pid=72089) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:01:39 user devstack@n-api.service[72089]: DEBUG dbcounter [-] [72089] Writing DB stats nova_api:SELECT=4 {{(pid=72089) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:01:39 user devstack@n-api.service[72089]: DEBUG dbcounter [-] [72089] Writing DB stats nova_cell1:SELECT=8 {{(pid=72089) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:01:39 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-480f3bec-d089-4014-b9a4-9f7359f8d74c tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:01:39 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-480f3bec-d089-4014-b9a4-9f7359f8d74c tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:01:39 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-480f3bec-d089-4014-b9a4-9f7359f8d74c tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:01:39 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-480f3bec-d089-4014-b9a4-9f7359f8d74c tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:01:39 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-480f3bec-d089-4014-b9a4-9f7359f8d74c tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:01:39 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [None req-480f3bec-d089-4014-b9a4-9f7359f8d74c tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:01:39 user devstack@n-api.service[72089]: DEBUG nova.compute.api [None req-480f3bec-d089-4014-b9a4-9f7359f8d74c tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] [instance: 0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4] Going to try to terminate instance {{(pid=72089) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 11 20:01:39 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [None req-480f3bec-d089-4014-b9a4-9f7359f8d74c tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4" status: 204 len: 0 microversion: 2.1 time: 0.214359 Apr 11 20:01:39 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 388/1139] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 20:01:39 2023] DELETE /compute/v2.1/servers/0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Apr 11 20:01:39 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [None req-2d993573-8280-4dd5-b7a8-b581e2982ed2 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Calling method '>' {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:01:39 user devstack@n-api.service[72088]: DEBUG nova.compute.api [None req-2d993573-8280-4dd5-b7a8-b581e2982ed2 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] [instance: 0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4] Fetching instance by UUID {{(pid=72088) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:01:39 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-2d993573-8280-4dd5-b7a8-b581e2982ed2 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:01:39 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-2d993573-8280-4dd5-b7a8-b581e2982ed2 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:01:39 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-2d993573-8280-4dd5-b7a8-b581e2982ed2 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:01:39 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-2d993573-8280-4dd5-b7a8-b581e2982ed2 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:01:39 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-2d993573-8280-4dd5-b7a8-b581e2982ed2 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:01:39 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [None req-2d993573-8280-4dd5-b7a8-b581e2982ed2 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:01:39 user devstack@n-api.service[72088]: DEBUG nova.policy [None req-2d993573-8280-4dd5-b7a8-b581e2982ed2 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fbfa8948ce64dff92344749d2f0f0c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5919e23c6a4c54b3a05a422c232c9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72088) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 20:01:39 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [None req-2d993573-8280-4dd5-b7a8-b581e2982ed2 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4" status: 200 len: 1544 microversion: 2.1 time: 0.208559 Apr 11 20:01:39 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 374/1140] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 20:01:39 2023] GET /compute/v2.1/servers/0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4 => generated 1544 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:01:39 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [req-62bd4c29-5849-432c-96c8-9c3db1e94aed req-102fa9b7-4fd7-4dbc-8cef-6ec371119c91 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4", "name": "network-vif-unplugged", "status": "completed", "tag": "90e5197f-3479-4c36-b5f9-b924ec023a53"}]} {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:01:39 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-62bd4c29-5849-432c-96c8-9c3db1e94aed req-102fa9b7-4fd7-4dbc-8cef-6ec371119c91 service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:01:39 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-62bd4c29-5849-432c-96c8-9c3db1e94aed req-102fa9b7-4fd7-4dbc-8cef-6ec371119c91 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:01:39 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [req-62bd4c29-5849-432c-96c8-9c3db1e94aed req-102fa9b7-4fd7-4dbc-8cef-6ec371119c91 service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:01:39 user devstack@n-api.service[72090]: INFO nova.api.openstack.compute.server_external_events [req-62bd4c29-5849-432c-96c8-9c3db1e94aed req-102fa9b7-4fd7-4dbc-8cef-6ec371119c91 service nova] Creating event network-vif-unplugged:90e5197f-3479-4c36-b5f9-b924ec023a53 for instance 0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4 on user Apr 11 20:01:39 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [req-62bd4c29-5849-432c-96c8-9c3db1e94aed req-102fa9b7-4fd7-4dbc-8cef-6ec371119c91 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.037495 Apr 11 20:01:39 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 379/1141] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 20:01:39 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:01:40 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [req-7f3f557e-53d4-4350-bfd8-3571ae77cac1 req-35b2c95d-3a30-4bd3-942d-8ca5ef06649d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4", "name": "network-vif-deleted", "tag": "90e5197f-3479-4c36-b5f9-b924ec023a53"}]} {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:01:40 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-7f3f557e-53d4-4350-bfd8-3571ae77cac1 req-35b2c95d-3a30-4bd3-942d-8ca5ef06649d service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:01:40 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-7f3f557e-53d4-4350-bfd8-3571ae77cac1 req-35b2c95d-3a30-4bd3-942d-8ca5ef06649d service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:01:40 user devstack@n-api.service[72089]: DEBUG oslo_concurrency.lockutils [req-7f3f557e-53d4-4350-bfd8-3571ae77cac1 req-35b2c95d-3a30-4bd3-942d-8ca5ef06649d service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72089) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:01:40 user devstack@n-api.service[72089]: INFO nova.api.openstack.compute.server_external_events [req-7f3f557e-53d4-4350-bfd8-3571ae77cac1 req-35b2c95d-3a30-4bd3-942d-8ca5ef06649d service nova] Creating event network-vif-deleted:90e5197f-3479-4c36-b5f9-b924ec023a53 for instance 0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4 on user Apr 11 20:01:40 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [req-7f3f557e-53d4-4350-bfd8-3571ae77cac1 req-35b2c95d-3a30-4bd3-942d-8ca5ef06649d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040378 Apr 11 20:01:40 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 389/1142] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 20:01:40 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:01:41 user devstack@n-api.service[72088]: DEBUG nova.api.openstack.wsgi [req-07d037d4-a0d1-4144-98c3-ef7c54f30084 req-392afb72-df53-4522-bb02-dbc63048558a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4", "name": "network-vif-plugged", "status": "completed", "tag": "90e5197f-3479-4c36-b5f9-b924ec023a53"}]} {{(pid=72088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:01:41 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-07d037d4-a0d1-4144-98c3-ef7c54f30084 req-392afb72-df53-4522-bb02-dbc63048558a service nova] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:01:41 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-07d037d4-a0d1-4144-98c3-ef7c54f30084 req-392afb72-df53-4522-bb02-dbc63048558a service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:01:41 user devstack@n-api.service[72088]: DEBUG oslo_concurrency.lockutils [req-07d037d4-a0d1-4144-98c3-ef7c54f30084 req-392afb72-df53-4522-bb02-dbc63048558a service nova] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72088) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:01:41 user devstack@n-api.service[72088]: INFO nova.api.openstack.compute.server_external_events [req-07d037d4-a0d1-4144-98c3-ef7c54f30084 req-392afb72-df53-4522-bb02-dbc63048558a service nova] Creating event network-vif-plugged:90e5197f-3479-4c36-b5f9-b924ec023a53 for instance 0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4 on user Apr 11 20:01:41 user devstack@n-api.service[72088]: INFO nova.api.openstack.requestlog [req-07d037d4-a0d1-4144-98c3-ef7c54f30084 req-392afb72-df53-4522-bb02-dbc63048558a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028883 Apr 11 20:01:41 user devstack@n-api.service[72088]: [pid: 72088|app: 0|req: 375/1143] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 20:01:41 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:02:29 user devstack@n-api.service[72090]: ERROR oslo.messaging._drivers.impl_rabbit [-] [49275a45-fc09-414a-ba1c-e5b694238aba] AMQP server on 10.0.0.210:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 11 20:02:29 user devstack@n-api.service[72090]: DEBUG dbcounter [-] [72090] Writing DB stats nova_api:SELECT=4 {{(pid=72090) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:02:29 user devstack@n-api.service[72090]: DEBUG dbcounter [-] [72090] Writing DB stats nova_cell1:SELECT=8 {{(pid=72090) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:02:29 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [None req-94656642-8d07-41bf-92a4-3f3da6387dbf tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Calling method '>' {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:02:29 user devstack@n-api.service[72090]: DEBUG nova.compute.api [None req-94656642-8d07-41bf-92a4-3f3da6387dbf tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] [instance: 0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4] Fetching instance by UUID {{(pid=72090) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 20:02:29 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-94656642-8d07-41bf-92a4-3f3da6387dbf tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:02:29 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-94656642-8d07-41bf-92a4-3f3da6387dbf tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:02:29 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-94656642-8d07-41bf-92a4-3f3da6387dbf tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:02:29 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-94656642-8d07-41bf-92a4-3f3da6387dbf tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Acquiring lock "a5b388bb-2881-480b-a232-b0dd723a272a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 20:02:29 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-94656642-8d07-41bf-92a4-3f3da6387dbf tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 20:02:29 user devstack@n-api.service[72090]: DEBUG oslo_concurrency.lockutils [None req-94656642-8d07-41bf-92a4-3f3da6387dbf tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Lock "a5b388bb-2881-480b-a232-b0dd723a272a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72090) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 20:02:29 user devstack@n-api.service[72090]: INFO nova.api.openstack.wsgi [None req-94656642-8d07-41bf-92a4-3f3da6387dbf tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] HTTP exception thrown: Instance 0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4 could not be found. Apr 11 20:02:29 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [None req-94656642-8d07-41bf-92a4-3f3da6387dbf tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Request method failure captured: Apr 11 20:02:29 user devstack@n-api.service[72090]: request: GET /compute/v2.1/servers/0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4 HTTP/1.1 Apr 11 20:02:29 user devstack@n-api.service[72090]: Accept: application/json Apr 11 20:02:29 user devstack@n-api.service[72090]: Accept-Encoding: identity Apr 11 20:02:29 user devstack@n-api.service[72090]: Connection: close Apr 11 20:02:29 user devstack@n-api.service[72090]: Content-Length: 0 Apr 11 20:02:29 user devstack@n-api.service[72090]: Content-Type: application/json Apr 11 20:02:29 user devstack@n-api.service[72090]: Host: 10.0.0.210 Apr 11 20:02:29 user devstack@n-api.service[72090]: Openstack-System-Scope: None Apr 11 20:02:29 user devstack@n-api.service[72090]: User-Agent: python-urllib3/1.26.15 Apr 11 20:02:29 user devstack@n-api.service[72090]: X-Auth-Token: gAAAAABkNboi_g8bsRhtx8uaOa5NWTf4uxnOLtVcon7BuOvG4wwTk-gCtYgZk-W-EpML2K-XvGIiaXLcQATSJp7kx203_AqQj-mT36BIS4okttmIUV_Cpre-05H_v5q-f1j-VDoVyV8P9rncakZQzBmdXgp-4Pcbg0qPnqEsmlb5AUO9F8sYDKU Apr 11 20:02:29 user devstack@n-api.service[72090]: X-Domain-Id: None Apr 11 20:02:29 user devstack@n-api.service[72090]: X-Domain-Name: None Apr 11 20:02:29 user devstack@n-api.service[72090]: X-Identity-Status: Confirmed Apr 11 20:02:29 user devstack@n-api.service[72090]: X-Is-Admin-Project: True Apr 11 20:02:29 user devstack@n-api.service[72090]: X-Project-Domain-Id: default Apr 11 20:02:29 user devstack@n-api.service[72090]: X-Project-Domain-Name: Default Apr 11 20:02:29 user devstack@n-api.service[72090]: X-Project-Id: ae5919e23c6a4c54b3a05a422c232c9f Apr 11 20:02:29 user devstack@n-api.service[72090]: X-Project-Name: tempest-TestMinimumBasicScenario-1332908423 Apr 11 20:02:29 user devstack@n-api.service[72090]: X-Role: reader,member Apr 11 20:02:29 user devstack@n-api.service[72090]: X-Roles: reader,member Apr 11 20:02:29 user devstack@n-api.service[72090]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ae5919e23c6a4c54b3a05a422c232c9f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/ae5919e23c6a4c54b3a05a422c232c9f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ae5919e23c6a4c54b3a05a422c232c9f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 11 20:02:29 user devstack@n-api.service[72090]: X-Tenant: tempest-TestMinimumBasicScenario-1332908423 Apr 11 20:02:29 user devstack@n-api.service[72090]: X-Tenant-Id: ae5919e23c6a4c54b3a05a422c232c9f Apr 11 20:02:29 user devstack@n-api.service[72090]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1332908423 Apr 11 20:02:29 user devstack@n-api.service[72090]: X-User: tempest-TestMinimumBasicScenario-1332908423-project-member Apr 11 20:02:29 user devstack@n-api.service[72090]: X-User-Domain-Id: default Apr 11 20:02:29 user devstack@n-api.service[72090]: X-User-Domain-Name: Default Apr 11 20:02:29 user devstack@n-api.service[72090]: X-User-Id: 2fbfa8948ce64dff92344749d2f0f0c7 Apr 11 20:02:29 user devstack@n-api.service[72090]: X-User-Name: tempest-TestMinimumBasicScenario-1332908423-project-member Apr 11 20:02:29 user devstack@n-api.service[72090]: method: > Apr 11 20:02:29 user devstack@n-api.service[72090]: exception: Instance 0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4 could not be found. Apr 11 20:02:29 user devstack@n-api.service[72090]: action_args: {'id': '0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4'} Apr 11 20:02:29 user devstack@n-api.service[72090]: {{(pid=72090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 20:02:29 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 20:02:29 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 20:02:29 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 20:02:29 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 20:02:29 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 20:02:29 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 20:02:29 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 20:02:29 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 20:02:29 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 20:02:29 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4 could not be found. Apr 11 20:02:29 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi Apr 11 20:02:29 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 20:02:29 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi Apr 11 20:02:29 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 20:02:29 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 20:02:29 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 20:02:29 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 20:02:29 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 20:02:29 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 20:02:29 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 20:02:29 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 20:02:29 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 20:02:29 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 20:02:29 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 20:02:29 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 20:02:29 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 20:02:29 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4 could not be found. Apr 11 20:02:29 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi Apr 11 20:02:29 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 20:02:29 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi Apr 11 20:02:29 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 20:02:29 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 20:02:29 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 20:02:29 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 20:02:29 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 20:02:29 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4 could not be found. Apr 11 20:02:29 user devstack@n-api.service[72090]: ERROR nova.api.openstack.wsgi Apr 11 20:02:29 user devstack@n-api.service[72090]: DEBUG nova.api.openstack.wsgi [None req-94656642-8d07-41bf-92a4-3f3da6387dbf tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Returning 404 to user: Instance 0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4 could not be found. {{(pid=72090) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 20:02:29 user devstack@n-api.service[72090]: INFO nova.api.openstack.requestlog [None req-94656642-8d07-41bf-92a4-3f3da6387dbf tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4" status: 404 len: 111 microversion: 2.1 time: 0.141431 Apr 11 20:02:29 user devstack@n-api.service[72090]: [pid: 72090|app: 0|req: 380/1144] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 20:02:29 2023] GET /compute/v2.1/servers/0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4 => generated 111 bytes in 143 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 20:02:29 user devstack@n-api.service[72089]: DEBUG dbcounter [-] [72089] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=72089) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:02:29 user devstack@n-api.service[72089]: DEBUG dbcounter [-] [72089] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=72089) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 20:02:29 user devstack@n-api.service[72089]: DEBUG nova.api.openstack.wsgi [None req-bb3d360f-e941-4881-baad-ec9b48f52fa0 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Calling method '.version_select at 0x7f119dbeaef0>' {{(pid=72089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:02:29 user devstack@n-api.service[72089]: INFO nova.api.openstack.requestlog [None req-bb3d360f-e941-4881-baad-ec9b48f52fa0 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1895527350" status: 202 len: 0 microversion: 2.1 time: 0.040106 Apr 11 20:02:29 user devstack@n-api.service[72089]: [pid: 72089|app: 0|req: 390/1145] 10.0.0.210 () {62 vars in 1349 bytes} [Tue Apr 11 20:02:29 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1895527350 => generated 0 bytes in 42 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)